Dec 05 12:12:33 user nova-compute[75071]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75071) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75071) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75071) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 05 12:12:33 user nova-compute[75071]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:12:33 user nova-compute[75071]: INFO nova.virt.driver [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] Loading compute driver 'libvirt.LibvirtDriver'
Dec 05 12:12:33 user nova-compute[75071]: INFO nova.compute.provider_config [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] Acquiring lock "singleton_lock" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] Acquired lock "singleton_lock" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] Releasing lock "singleton_lock" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] Full set of CONF: {{(pid=75071) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ******************************************************************************** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] Configuration options gathered from: {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ================================================================================ {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] allow_resize_to_same_host      = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] arq_binding_timeout            = 300 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] backdoor_port                  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] backdoor_socket                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] block_device_allocate_retries  = 300 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] block_device_allocate_retries_interval = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cert                           = self.pem {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] compute_monitors               = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] config_dir                     = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] config_drive_format            = iso9660 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] config_source                  = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] console_host                   = user {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] control_exchange               = nova {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cpu_allocation_ratio           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] daemon                         = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] debug                          = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] default_access_ip_network_name = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] default_availability_zone      = nova {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] default_ephemeral_format       = ext4 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] default_green_pool_size        = 1000 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] default_schedule_zone          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] disk_allocation_ratio          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] enable_new_services            = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] enabled_ssl_apis               = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] flat_injected                  = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] force_config_drive             = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] force_raw_images               = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] graceful_shutdown_timeout      = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] heal_instance_info_cache_interval = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] host                           = user {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] instance_build_timeout         = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] instance_delete_interval       = 300 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] instance_name_template         = instance-%08x {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] instance_usage_audit           = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] instance_usage_audit_period    = month {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] internal_service_availability_zone = internal {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] key                            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] live_migration_retry_count     = 30 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] log_config_append              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] log_dir                        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] log_file                       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] log_options                    = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] log_rotate_interval            = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] log_rotate_interval_type       = days {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] log_rotation_type              = none {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] long_rpc_timeout               = 1800 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] max_concurrent_builds          = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] max_concurrent_live_migrations = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] max_concurrent_snapshots       = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] max_local_block_devices        = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] max_logfile_count              = 30 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] max_logfile_size_mb            = 200 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] maximum_instance_delete_attempts = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] metadata_listen                = 0.0.0.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] metadata_listen_port           = 8775 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] metadata_workers               = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] migrate_max_retries            = -1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] mkisofs_cmd                    = genisoimage {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] my_ip                          = 10.0.0.210 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] network_allocate_retries       = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] osapi_compute_listen_port      = 8774 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] osapi_compute_unique_server_name_scope =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] osapi_compute_workers          = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] password_length                = 12 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] periodic_enable                = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] periodic_fuzzy_delay           = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] pointer_model                  = ps2mouse {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] preallocate_images             = none {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] publish_errors                 = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] pybasedir                      = /opt/stack/nova {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ram_allocation_ratio           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] rate_limit_burst               = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] rate_limit_except_level        = CRITICAL {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] rate_limit_interval            = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] reboot_timeout                 = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] reclaim_instance_interval      = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] record                         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] reimage_timeout_per_gb         = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] report_interval                = 120 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] rescue_timeout                 = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] reserved_host_cpus             = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] reserved_host_disk_mb          = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] reserved_host_memory_mb        = 512 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] reserved_huge_pages            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] resize_confirm_window          = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] resize_fs_using_block_device   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] resume_guests_state_on_host_boot = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] rpc_response_timeout           = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] run_external_periodic_tasks    = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] running_deleted_instance_action = reap {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] running_deleted_instance_timeout = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] scheduler_instance_sync_interval = 120 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] service_down_time              = 720 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] servicegroup_driver            = db {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] shelved_offload_time           = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] shelved_poll_interval          = 3600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] shutdown_timeout               = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] source_is_ipv6                 = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ssl_only                       = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] state_path                     = /opt/stack/data/nova {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] sync_power_state_interval      = 600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] sync_power_state_pool_size     = 1000 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] syslog_log_facility            = LOG_USER {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] tempdir                        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] timeout_nbd                    = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] transport_url                  = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] update_resources_interval      = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] use_cow_images                 = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] use_eventlog                   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] use_journal                    = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] use_json                       = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] use_rootwrap_daemon            = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] use_stderr                     = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] use_syslog                     = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vcpu_pin_set                   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vif_plugging_is_fatal          = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vif_plugging_timeout           = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] virt_mkfs                      = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] volume_usage_poll_interval     = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] watch_log_file                 = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] web                            = /usr/share/spice-html5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_concurrency.disable_process_locking = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.auth_strategy              = keystone {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.compute_link_prefix        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.dhcp_domain                = novalocal {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.enable_instance_password   = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.glance_link_prefix         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.instance_list_per_project_cells = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.list_records_by_skipping_down_cells = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.local_metadata_per_cell    = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.max_limit                  = 1000 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.metadata_cache_expiration  = 15 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.neutron_default_tenant_id  = default {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.use_forwarded_for          = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.use_neutron_default_nets   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.vendordata_dynamic_targets = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.vendordata_jsonfile_path   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.backend_argument         = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.config_prefix            = cache.oslo {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.dead_timeout             = 60.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.debug_cache_backend      = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.enable_retry_client      = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.enable_socket_keepalive  = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.enabled                  = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.expiration_time          = 600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.hashclient_retry_attempts = 2 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.memcache_dead_retry      = 300 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.memcache_password        =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.memcache_sasl_enabled    = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.memcache_username        =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.proxies                  = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.retry_attempts           = 2 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.retry_delay              = 0.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.socket_keepalive_count   = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.socket_keepalive_idle    = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.socket_keepalive_interval = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.tls_allowed_ciphers      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.tls_cafile               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.tls_certfile             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.tls_enabled              = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cache.tls_keyfile              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cinder.auth_section            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cinder.auth_type               = password {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cinder.cafile                  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cinder.certfile                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cinder.collect_timing          = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cinder.cross_az_attach         = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cinder.debug                   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:33 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cinder.endpoint_template       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cinder.http_retries            = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cinder.insecure                = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cinder.keyfile                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cinder.os_region_name          = RegionOne {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cinder.split_loggers           = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cinder.timeout                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] compute.cpu_dedicated_set      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] compute.cpu_shared_set         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] compute.image_type_exclude_list = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] compute.resource_provider_association_refresh = 300 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] compute.shutdown_retry_interval = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] conductor.workers              = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] console.allowed_origins        = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] console.ssl_ciphers            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] console.ssl_minimum_version    = default {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] consoleauth.token_ttl          = 600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cyborg.cafile                  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cyborg.certfile                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cyborg.collect_timing          = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cyborg.connect_retries         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cyborg.connect_retry_delay     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cyborg.endpoint_override       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cyborg.insecure                = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cyborg.keyfile                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cyborg.max_version             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cyborg.min_version             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cyborg.region_name             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cyborg.service_name            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cyborg.service_type            = accelerator {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cyborg.split_loggers           = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cyborg.status_code_retries     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cyborg.status_code_retry_delay = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cyborg.timeout                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] cyborg.version                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] database.backend               = sqlalchemy {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] database.connection            = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] database.connection_debug      = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] database.connection_parameters =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] database.connection_recycle_time = 3600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] database.connection_trace      = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] database.db_inc_retry_interval = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] database.db_max_retries        = 20 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] database.db_max_retry_interval = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] database.db_retry_interval     = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] database.max_overflow          = 50 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] database.max_pool_size         = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] database.max_retries           = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] database.mysql_wsrep_sync_wait = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] database.pool_timeout          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] database.retry_interval        = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] database.slave_connection      = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] database.sqlite_synchronous    = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api_database.backend           = sqlalchemy {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api_database.connection        = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api_database.connection_debug  = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api_database.connection_parameters =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api_database.connection_recycle_time = 3600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api_database.connection_trace  = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api_database.db_inc_retry_interval = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api_database.db_max_retries    = 20 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api_database.db_max_retry_interval = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api_database.db_retry_interval = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api_database.max_overflow      = 50 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api_database.max_pool_size     = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api_database.max_retries       = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api_database.pool_timeout      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api_database.retry_interval    = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api_database.slave_connection  = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] api_database.sqlite_synchronous = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] devices.enabled_mdev_types     = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ephemeral_storage_encryption.enabled = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.api_servers             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.cafile                  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.certfile                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.collect_timing          = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.connect_retries         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.connect_retry_delay     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.debug                   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.default_trusted_certificate_ids = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.enable_certificate_validation = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.enable_rbd_download     = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.endpoint_override       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.insecure                = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.keyfile                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.max_version             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.min_version             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.num_retries             = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.rbd_ceph_conf           =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.rbd_connect_timeout     = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.rbd_pool                =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.rbd_user                =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.region_name             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.service_name            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.service_type            = image {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.split_loggers           = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.status_code_retries     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.status_code_retry_delay = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.timeout                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.verify_glance_signatures = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] glance.version                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] guestfs.debug                  = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] hyperv.config_drive_cdrom      = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] hyperv.config_drive_inject_password = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] hyperv.enable_remotefx         = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] hyperv.instances_path_share    =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] hyperv.limit_cpu_features      = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] hyperv.use_multipath_io        = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] hyperv.vswitch_name            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] mks.enabled                    = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] image_cache.manager_interval   = 2400 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] image_cache.precache_concurrency = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] image_cache.remove_unused_base_images = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] image_cache.subdirectory_name  = _base {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.api_max_retries         = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.api_retry_interval      = 2 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.auth_section            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.auth_type               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.cafile                  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.certfile                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.collect_timing          = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.conductor_group         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.connect_retries         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.connect_retry_delay     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.endpoint_override       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.insecure                = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.keyfile                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.max_version             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.min_version             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.peer_list               = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.region_name             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.serial_console_state_timeout = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.service_name            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.service_type            = baremetal {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.split_loggers           = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.status_code_retries     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.status_code_retry_delay = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.timeout                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ironic.version                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] key_manager.fixed_key          = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican.barbican_api_version  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican.barbican_endpoint     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican.barbican_endpoint_type = public {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican.barbican_region_name  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican.cafile                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican.certfile              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican.collect_timing        = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican.insecure              = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican.keyfile               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican.number_of_retries     = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican.retry_delay           = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican.send_service_user_token = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican.split_loggers         = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican.timeout               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican.verify_ssl            = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican.verify_ssl_path       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican_service_user.auth_section = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican_service_user.auth_type = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican_service_user.cafile   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican_service_user.certfile = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican_service_user.collect_timing = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican_service_user.insecure = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican_service_user.keyfile  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican_service_user.split_loggers = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] barbican_service_user.timeout  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vault.approle_role_id          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vault.approle_secret_id        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vault.cafile                   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vault.certfile                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vault.collect_timing           = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vault.insecure                 = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vault.keyfile                  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vault.kv_mountpoint            = secret {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vault.kv_path                  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vault.kv_version               = 2 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vault.namespace                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vault.root_token_id            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vault.split_loggers            = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vault.ssl_ca_crt_file          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vault.timeout                  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vault.use_ssl                  = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.auth_section          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.auth_type             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.cafile                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.certfile              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.collect_timing        = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.connect_retries       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.connect_retry_delay   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.endpoint_override     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.insecure              = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.keyfile               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.max_version           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.min_version           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.region_name           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.service_name          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.service_type          = identity {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.split_loggers         = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.status_code_retries   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.status_code_retry_delay = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.timeout               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] keystone.version               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.connection_uri         =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.cpu_mode               = custom {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: WARNING oslo_config.cfg [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.cpu_power_governor_high = performance {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.cpu_power_management   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.device_detach_attempts = 8 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.device_detach_timeout  = 20 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.disk_cachemodes        = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.disk_prefix            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.enabled_perf_events    = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.file_backed_memory     = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.gid_maps               = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.hw_disk_discard        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.hw_machine_type        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.images_rbd_pool        = rbd {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.images_type            = default {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.images_volume_group    = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.inject_key             = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.inject_partition       = -2 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.inject_password        = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.iscsi_iface            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.iser_use_multipath     = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.live_migration_downtime = 500 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.live_migration_inbound_addr = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.live_migration_scheme  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.live_migration_timeout_action = abort {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.live_migration_tunnelled = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: WARNING oslo_config.cfg [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Dec 05 12:12:34 user nova-compute[75071]: live_migration_uri is deprecated for removal in favor of two other options that
Dec 05 12:12:34 user nova-compute[75071]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Dec 05 12:12:34 user nova-compute[75071]: and ``live_migration_inbound_addr`` respectively.
Dec 05 12:12:34 user nova-compute[75071]: ).  Its value may be silently ignored in the future.
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.live_migration_with_native_tls = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.max_queues             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.nfs_mount_options      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.num_pcie_ports         = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.pmem_namespaces        = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.quobyte_client_cfg     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.rbd_secret_uuid        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.rbd_user               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.rescue_image_id        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.rescue_kernel_id       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.rx_queue_size          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.smbfs_mount_options    =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.snapshot_compression   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.snapshot_image_format  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.sparse_logical_volumes = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.swtpm_enabled          = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.swtpm_group            = tss {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.swtpm_user             = tss {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.sysinfo_serial         = unique {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.tb_cache_size          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.tx_queue_size          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.uid_maps               = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.use_virtio_for_bridges = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.virt_type              = kvm {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.volume_clear           = zero {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.volume_clear_size      = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.volume_use_multipath   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.vzstorage_cache_path   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.auth_section           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.auth_type              = password {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.cafile                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.certfile               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.collect_timing         = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.connect_retries        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.connect_retry_delay    = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.default_floating_pool  = public {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.endpoint_override      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.extension_sync_interval = 600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.http_retries           = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.insecure               = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.keyfile                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.max_version            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.min_version            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.ovs_bridge             = br-int {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.physnets               = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.region_name            = RegionOne {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.service_metadata_proxy = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.service_name           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.service_type           = network {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.split_loggers          = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.status_code_retries    = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.status_code_retry_delay = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.timeout                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] neutron.version                = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] notifications.bdms_in_notifications = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] notifications.default_level    = INFO {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] notifications.notification_format = unversioned {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] notifications.notify_on_state_change = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] pci.alias                      = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] pci.device_spec                = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] pci.report_in_placement        = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.auth_section         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.auth_type            = password {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.cafile               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.certfile             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.collect_timing       = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.connect_retries      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.connect_retry_delay  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.default_domain_id    = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.default_domain_name  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.domain_id            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.domain_name          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.endpoint_override    = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.insecure             = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.keyfile              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.max_version          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.min_version          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.password             = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.project_domain_id    = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.project_domain_name  = Default {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.project_id           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.project_name         = service {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.region_name          = RegionOne {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.service_name         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.service_type         = placement {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.split_loggers        = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.status_code_retries  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.status_code_retry_delay = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.system_scope         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.timeout              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.trust_id             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.user_domain_id       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.user_domain_name     = Default {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.user_id              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.username             = placement {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] placement.version              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] quota.cores                    = 20 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] quota.count_usage_from_placement = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] quota.injected_file_content_bytes = 10240 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] quota.injected_file_path_length = 255 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] quota.injected_files           = 5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] quota.instances                = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] quota.key_pairs                = 100 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] quota.metadata_items           = 128 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] quota.ram                      = 51200 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] quota.recheck_quota            = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] quota.server_group_members     = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] quota.server_groups            = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] rdp.enabled                    = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] scheduler.image_metadata_prefilter = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] scheduler.max_attempts         = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] scheduler.max_placement_results = 1000 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] scheduler.workers              = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.host_subset_size = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.isolated_hosts = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.isolated_images = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.pci_in_placement = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.track_instance_changes = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] metrics.required               = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] metrics.weight_multiplier      = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] metrics.weight_setting         = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] serial_console.enabled         = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] serial_console.port_range      = 10000:20000 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] serial_console.serialproxy_port = 6083 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] service_user.auth_section      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] service_user.auth_type         = password {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] service_user.cafile            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] service_user.certfile          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] service_user.collect_timing    = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] service_user.insecure          = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] service_user.keyfile           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] service_user.send_service_user_token = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] service_user.split_loggers     = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] service_user.timeout           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] spice.agent_enabled            = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] spice.enabled                  = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] spice.html5proxy_port          = 6082 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] spice.image_compression        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] spice.jpeg_compression         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] spice.playback_compression     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] spice.server_listen            = 127.0.0.1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] spice.streaming_mode           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] spice.zlib_compression         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] upgrade_levels.baseapi         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] upgrade_levels.compute         = auto {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] upgrade_levels.conductor       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] upgrade_levels.scheduler       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vendordata_dynamic_auth.cafile = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vendordata_dynamic_auth.certfile = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vendordata_dynamic_auth.insecure = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vendordata_dynamic_auth.timeout = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.api_retry_count         = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.ca_file                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.cache_prefix            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.cluster_name            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.connection_pool_size    = 10 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.console_delay_seconds   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.datastore_regex         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.host_ip                 = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.host_password           = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.host_port               = 443 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.host_username           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.insecure                = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.integration_bridge      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.maximum_objects         = 100 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.pbm_default_policy      = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.pbm_enabled             = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.pbm_wsdl_location       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.serial_port_proxy_uri   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.serial_port_service_uri = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.task_poll_interval      = 0.5 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.use_linked_clone        = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.vnc_keymap              = en-us {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.vnc_port                = 5900 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vmware.vnc_port_total          = 10000 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vnc.auth_schemes               = ['none'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vnc.enabled                    = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vnc.novncproxy_port            = 6080 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vnc.vencrypt_ca_certs          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vnc.vencrypt_client_cert       = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vnc.vencrypt_client_key        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.disable_rootwrap   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.enable_numa_live_migration = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.libvirt_disable_apic = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] wsgi.client_socket_timeout     = 900 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] wsgi.default_pool_size         = 1000 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] wsgi.keep_alive                = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] wsgi.max_header_line           = 16384 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] wsgi.ssl_ca_file               = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] wsgi.ssl_cert_file             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] wsgi.ssl_key_file              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] wsgi.tcp_keepidle              = 600 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] zvm.ca_file                    = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] zvm.cloud_connector_url        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] zvm.reachable_timeout          = 300 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_policy.enforce_new_defaults = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_policy.enforce_scope      = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_policy.policy_default_rule = default {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] profiler.connection_string     = messaging:// {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] profiler.enabled               = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] profiler.es_doc_type           = notification {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] profiler.es_scroll_size        = 10000 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] profiler.es_scroll_time        = 2m {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] profiler.filter_error_trace    = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] profiler.hmac_keys             = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] profiler.sentinel_service_name = mymaster {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] profiler.socket_timeout        = 0.1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] profiler.trace_requests        = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] profiler.trace_sqlalchemy      = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] profiler_jaeger.process_tags   = {} {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] profiler_jaeger.service_name_prefix = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] profiler_otlp.service_name_prefix = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] remote_debug.host              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] remote_debug.port              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_notifications.retry = -1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.auth_section        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.auth_type           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.cafile              = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.certfile            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.collect_timing      = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.connect_retries     = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.connect_retry_delay = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.endpoint_id         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.endpoint_override   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.insecure            = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.keyfile             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.max_version         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.min_version         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.region_name         = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.service_name        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.service_type        = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.split_loggers       = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.status_code_retries = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.status_code_retry_delay = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.timeout             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.valid_interfaces    = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_limit.version             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_reports.file_event_handler = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] oslo_reports.log_dir           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vif_plug_ovs_privileged.group  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] vif_plug_ovs_privileged.user   = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] os_vif_ovs.isolate_vif         = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] os_brick.lock_path             = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] privsep_osbrick.capabilities   = [21] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] privsep_osbrick.group          = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] privsep_osbrick.helper_command = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] privsep_osbrick.user           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] nova_sys_admin.group           = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] nova_sys_admin.helper_command  = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] nova_sys_admin.user            = None {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG oslo_service.service [None req-cba0a949-2876-4dae-8062-6540c9023281 None None] ******************************************************************************** {{(pid=75071) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Dec 05 12:12:34 user nova-compute[75071]: INFO nova.service [-] Starting compute node (version 0.0.0)
Dec 05 12:12:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Connecting to libvirt: qemu:///system {{(pid=75071) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f827c3f2620> {{(pid=75071) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Dec 05 12:12:34 user nova-compute[75071]: libvirt:  error : internal error: could not initialize domain event timer
Dec 05 12:12:34 user nova-compute[75071]: WARNING nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Dec 05 12:12:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f827c3f2620> {{(pid=75071) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Starting native event thread {{(pid=75071) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Starting green dispatch thread {{(pid=75071) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Dec 05 12:12:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Starting connection event dispatch thread {{(pid=75071) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Dec 05 12:12:34 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Connection event '1' reason 'None'
Dec 05 12:12:34 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Dec 05 12:12:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.mount [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Initialising _HostMountState generation 0 {{(pid=75071) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Dec 05 12:12:41 user nova-compute[75071]: INFO nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Libvirt host capabilities <capabilities>
Dec 05 12:12:41 user nova-compute[75071]:   <host>
Dec 05 12:12:41 user nova-compute[75071]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Dec 05 12:12:41 user nova-compute[75071]:     <cpu>
Dec 05 12:12:41 user nova-compute[75071]:       <arch>x86_64</arch>
Dec 05 12:12:41 user nova-compute[75071]:       <model>IvyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <vendor>Intel</vendor>
Dec 05 12:12:41 user nova-compute[75071]:       <microcode version='1070'/>
Dec 05 12:12:41 user nova-compute[75071]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Dec 05 12:12:41 user nova-compute[75071]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature name='ss'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature name='vmx'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature name='pcid'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature name='osxsave'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature name='hypervisor'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature name='arat'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature name='tsc_adjust'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature name='md-clear'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature name='stibp'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature name='arch-capabilities'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature name='ssbd'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature name='invtsc'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature name='rsba'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature name='skip-l1dfl-vmentry'/>
Dec 05 12:12:41 user nova-compute[75071]:       <pages unit='KiB' size='4'/>
Dec 05 12:12:41 user nova-compute[75071]:       <pages unit='KiB' size='2048'/>
Dec 05 12:12:41 user nova-compute[75071]:     </cpu>
Dec 05 12:12:41 user nova-compute[75071]:     <power_management>
Dec 05 12:12:41 user nova-compute[75071]:       <suspend_mem/>
Dec 05 12:12:41 user nova-compute[75071]:       <suspend_disk/>
Dec 05 12:12:41 user nova-compute[75071]:       <suspend_hybrid/>
Dec 05 12:12:41 user nova-compute[75071]:     </power_management>
Dec 05 12:12:41 user nova-compute[75071]:     <iommu support='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     <migration_features>
Dec 05 12:12:41 user nova-compute[75071]:       <live/>
Dec 05 12:12:41 user nova-compute[75071]:       <uri_transports>
Dec 05 12:12:41 user nova-compute[75071]:         <uri_transport>tcp</uri_transport>
Dec 05 12:12:41 user nova-compute[75071]:         <uri_transport>rdma</uri_transport>
Dec 05 12:12:41 user nova-compute[75071]:       </uri_transports>
Dec 05 12:12:41 user nova-compute[75071]:     </migration_features>
Dec 05 12:12:41 user nova-compute[75071]:     <topology>
Dec 05 12:12:41 user nova-compute[75071]:       <cells num='2'>
Dec 05 12:12:41 user nova-compute[75071]:         <cell id='0'>
Dec 05 12:12:41 user nova-compute[75071]:           <memory unit='KiB'>8189224</memory>
Dec 05 12:12:41 user nova-compute[75071]:           <pages unit='KiB' size='4'>2047306</pages>
Dec 05 12:12:41 user nova-compute[75071]:           <pages unit='KiB' size='2048'>0</pages>
Dec 05 12:12:41 user nova-compute[75071]:           <distances>
Dec 05 12:12:41 user nova-compute[75071]:             <sibling id='0' value='10'/>
Dec 05 12:12:41 user nova-compute[75071]:             <sibling id='1' value='20'/>
Dec 05 12:12:41 user nova-compute[75071]:           </distances>
Dec 05 12:12:41 user nova-compute[75071]:           <cpus num='6'>
Dec 05 12:12:41 user nova-compute[75071]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Dec 05 12:12:41 user nova-compute[75071]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Dec 05 12:12:41 user nova-compute[75071]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Dec 05 12:12:41 user nova-compute[75071]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Dec 05 12:12:41 user nova-compute[75071]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Dec 05 12:12:41 user nova-compute[75071]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Dec 05 12:12:41 user nova-compute[75071]:           </cpus>
Dec 05 12:12:41 user nova-compute[75071]:         </cell>
Dec 05 12:12:41 user nova-compute[75071]:         <cell id='1'>
Dec 05 12:12:41 user nova-compute[75071]:           <memory unit='KiB'>8206460</memory>
Dec 05 12:12:41 user nova-compute[75071]:           <pages unit='KiB' size='4'>2051615</pages>
Dec 05 12:12:41 user nova-compute[75071]:           <pages unit='KiB' size='2048'>0</pages>
Dec 05 12:12:41 user nova-compute[75071]:           <distances>
Dec 05 12:12:41 user nova-compute[75071]:             <sibling id='0' value='20'/>
Dec 05 12:12:41 user nova-compute[75071]:             <sibling id='1' value='10'/>
Dec 05 12:12:41 user nova-compute[75071]:           </distances>
Dec 05 12:12:41 user nova-compute[75071]:           <cpus num='6'>
Dec 05 12:12:41 user nova-compute[75071]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Dec 05 12:12:41 user nova-compute[75071]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Dec 05 12:12:41 user nova-compute[75071]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Dec 05 12:12:41 user nova-compute[75071]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Dec 05 12:12:41 user nova-compute[75071]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Dec 05 12:12:41 user nova-compute[75071]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Dec 05 12:12:41 user nova-compute[75071]:           </cpus>
Dec 05 12:12:41 user nova-compute[75071]:         </cell>
Dec 05 12:12:41 user nova-compute[75071]:       </cells>
Dec 05 12:12:41 user nova-compute[75071]:     </topology>
Dec 05 12:12:41 user nova-compute[75071]:     <cache>
Dec 05 12:12:41 user nova-compute[75071]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Dec 05 12:12:41 user nova-compute[75071]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Dec 05 12:12:41 user nova-compute[75071]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Dec 05 12:12:41 user nova-compute[75071]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Dec 05 12:12:41 user nova-compute[75071]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Dec 05 12:12:41 user nova-compute[75071]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Dec 05 12:12:41 user nova-compute[75071]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Dec 05 12:12:41 user nova-compute[75071]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Dec 05 12:12:41 user nova-compute[75071]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Dec 05 12:12:41 user nova-compute[75071]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Dec 05 12:12:41 user nova-compute[75071]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Dec 05 12:12:41 user nova-compute[75071]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Dec 05 12:12:41 user nova-compute[75071]:     </cache>
Dec 05 12:12:41 user nova-compute[75071]:     <secmodel>
Dec 05 12:12:41 user nova-compute[75071]:       <model>apparmor</model>
Dec 05 12:12:41 user nova-compute[75071]:       <doi>0</doi>
Dec 05 12:12:41 user nova-compute[75071]:     </secmodel>
Dec 05 12:12:41 user nova-compute[75071]:     <secmodel>
Dec 05 12:12:41 user nova-compute[75071]:       <model>dac</model>
Dec 05 12:12:41 user nova-compute[75071]:       <doi>0</doi>
Dec 05 12:12:41 user nova-compute[75071]:       <baselabel type='kvm'>+64055:+108</baselabel>
Dec 05 12:12:41 user nova-compute[75071]:       <baselabel type='qemu'>+64055:+108</baselabel>
Dec 05 12:12:41 user nova-compute[75071]:     </secmodel>
Dec 05 12:12:41 user nova-compute[75071]:   </host>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='alpha'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>64</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>clipper</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='armv6l'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>32</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>integratorcp</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>borzoi</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>spitz</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>nuri</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>musca-b1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>versatileab</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>kzm</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>musca-a</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>smdkc210</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>sx1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>z2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>tosa</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>sabrelite</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>realview-eb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>n810</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>n800</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>versatilepb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>terrier</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mainstone</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>midway</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>musicpal</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>microbit</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>cubieboard</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>verdex</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>netduino2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>raspi2b</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>cheetah</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>highbank</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>akita</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>connex</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>collie</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>raspi0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='armv7l'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>32</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>integratorcp</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>borzoi</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>spitz</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>nuri</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>musca-b1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>versatileab</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>kzm</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>musca-a</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>smdkc210</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>sx1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>z2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>tosa</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>sabrelite</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>realview-eb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>n810</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>n800</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>versatilepb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>terrier</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mainstone</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>midway</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>musicpal</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>microbit</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>cubieboard</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>verdex</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>netduino2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>raspi2b</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>cheetah</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>highbank</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>akita</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>connex</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>collie</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>raspi0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='aarch64'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>64</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>integratorcp</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>borzoi</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>spitz</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>nuri</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>musca-b1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>versatileab</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>kzm</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>musca-a</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>smdkc210</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>sx1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>z2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>tosa</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>sabrelite</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>realview-eb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>sbsa-ref</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>n810</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>n800</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>versatilepb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>terrier</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mainstone</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>midway</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>musicpal</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>microbit</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>raspi3ap</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>cubieboard</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>verdex</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>netduino2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>raspi3b</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>raspi2b</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>cheetah</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>highbank</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>akita</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>connex</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>collie</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>raspi0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <acpi default='on' toggle='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='cris'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>32</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>axis-dev88</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='i686'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>32</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-artful</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>x-remote</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>isapc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-disco</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-impish</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-focal</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>microvm</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='kvm'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <pae/>
Dec 05 12:12:41 user nova-compute[75071]:       <nonpae/>
Dec 05 12:12:41 user nova-compute[75071]:       <acpi default='on' toggle='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:       <apic default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='m68k'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>32</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mcf5208evb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>an5206</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>virt-6.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>q800</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>virt-6.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>next-cube</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>virt-6.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='microblaze'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>32</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>petalogix-ml605</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='microblazeel'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>32</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>petalogix-ml605</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='mips'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>32</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='16'>malta</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mipssim</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='mipsel'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>32</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='16'>malta</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mipssim</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='mips64'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>64</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='16'>malta</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mipssim</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>pica61</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>magnum</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='mips64el'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>64</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='16'>malta</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='16'>loongson3-virt</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mipssim</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>pica61</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>magnum</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='16'>boston</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>fuloong2e</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='ppc'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>32</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>g3beige</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mac99</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>ppce500</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>pegasos2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>sam460ex</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>bamboo</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>40p</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>ref405ep</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>taihu</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='ppc64'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>64</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2048'>powernv9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>taihu</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2048'>powernv10</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>ppce500</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>40p</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>pegasos2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>bamboo</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>g3beige</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mac99</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>sam460ex</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>ref405ep</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2048'>powernv8</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='ppc64le'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>64</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2048'>powernv9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>taihu</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2048'>powernv10</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>ppce500</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>40p</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>pegasos2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>bamboo</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>g3beige</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>mac99</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>sam460ex</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>ref405ep</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2048'>powernv8</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='riscv32'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>32</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='8'>spike</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>opentitan</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='5'>sifive_u</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>sifive_e</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='8'>virt</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='riscv64'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>64</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='8'>spike</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='5'>sifive_u</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>shakti_c</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>sifive_e</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='8'>virt</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='s390x'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>64</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='sh4'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>32</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>shix</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>r2d</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='sh4eb'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>64</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>shix</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>r2d</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='sparc'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>32</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>SS-5</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>SS-20</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>LX</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>SPARCClassic</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>leon3_generic</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>SPARCbook</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>SS-4</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>SS-600MP</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>SS-10</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>Voyager</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='sparc64'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>64</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>sun4u</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>niagara</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>sun4v</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='x86_64'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>64</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-artful</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>x-remote</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='1'>isapc</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-disco</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-impish</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-focal</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>microvm</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='kvm'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <acpi default='on' toggle='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:       <apic default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='xtensa'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>32</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>sim</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>kc705</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>ml605</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>ml605-nommu</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>virt</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>lx60-nommu</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>lx200</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>lx200-nommu</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>lx60</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>kc705-nommu</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]:   <guest>
Dec 05 12:12:41 user nova-compute[75071]:     <os_type>hvm</os_type>
Dec 05 12:12:41 user nova-compute[75071]:     <arch name='xtensaeb'>
Dec 05 12:12:41 user nova-compute[75071]:       <wordsize>32</wordsize>
Dec 05 12:12:41 user nova-compute[75071]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='4'>sim</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>kc705</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>ml605</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>ml605-nommu</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>virt</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>lx60-nommu</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>lx200</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>lx200-nommu</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>lx60</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <machine maxCpus='32'>kc705-nommu</machine>
Dec 05 12:12:41 user nova-compute[75071]:       <domain type='qemu'/>
Dec 05 12:12:41 user nova-compute[75071]:     </arch>
Dec 05 12:12:41 user nova-compute[75071]:     <features>
Dec 05 12:12:41 user nova-compute[75071]:       <cpuselection/>
Dec 05 12:12:41 user nova-compute[75071]:       <deviceboot/>
Dec 05 12:12:41 user nova-compute[75071]:       <disksnapshot default='on' toggle='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     </features>
Dec 05 12:12:41 user nova-compute[75071]:   </guest>
Dec 05 12:12:41 user nova-compute[75071]: </capabilities>
Dec 05 12:12:41 user nova-compute[75071]: 
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'q35', 'pc', 'ubuntu'} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Dec 05 12:12:41 user nova-compute[75071]: <domainCapabilities>
Dec 05 12:12:41 user nova-compute[75071]:   <path>/usr/bin/qemu-system-i386</path>
Dec 05 12:12:41 user nova-compute[75071]:   <domain>kvm</domain>
Dec 05 12:12:41 user nova-compute[75071]:   <machine>pc-q35-jammy</machine>
Dec 05 12:12:41 user nova-compute[75071]:   <arch>i686</arch>
Dec 05 12:12:41 user nova-compute[75071]:   <vcpu max='288'/>
Dec 05 12:12:41 user nova-compute[75071]:   <iothreads supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:   <os supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:     <enum name='firmware'/>
Dec 05 12:12:41 user nova-compute[75071]:     <loader supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='type'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>rom</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>pflash</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='readonly'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>yes</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>no</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='secure'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>no</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </loader>
Dec 05 12:12:41 user nova-compute[75071]:   </os>
Dec 05 12:12:41 user nova-compute[75071]:   <cpu>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='host-passthrough' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='hostPassthroughMigratable'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>off</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='maximum' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='maximumMigratable'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>on</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>off</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='host-model' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <vendor>Intel</vendor>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ss'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='vmx'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='pcid'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='hypervisor'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='arat'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='umip'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='md-clear'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='stibp'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ssbd'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ibpb'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ibrs'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='amd-stibp'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='erms'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='lm'/>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='custom' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>qemu64</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>qemu32</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>phenom</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium3</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium2</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>n270</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>kvm64</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>kvm32</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>coreduo</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>core2duo</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>athlon</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Westmere-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Westmere</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Snowridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>SandyBridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Penryn</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G5</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G4</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G3</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G2</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G1</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Nehalem-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Nehalem</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>IvyBridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Icelake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-Rome</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-Milan</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Dhyana</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cooperlake</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Conroe</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>486</model>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:   </cpu>
Dec 05 12:12:41 user nova-compute[75071]:   <memoryBacking supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:     <enum name='sourceType'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>file</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>anonymous</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>memfd</value>
Dec 05 12:12:41 user nova-compute[75071]:     </enum>
Dec 05 12:12:41 user nova-compute[75071]:   </memoryBacking>
Dec 05 12:12:41 user nova-compute[75071]:   <devices>
Dec 05 12:12:41 user nova-compute[75071]:     <disk supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='diskDevice'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>disk</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>cdrom</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>floppy</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>lun</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='bus'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>fdc</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>scsi</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>usb</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>sata</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </disk>
Dec 05 12:12:41 user nova-compute[75071]:     <graphics supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='type'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>sdl</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vnc</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>spice</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>egl-headless</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </graphics>
Dec 05 12:12:41 user nova-compute[75071]:     <video supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='modelType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vga</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>cirrus</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vmvga</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>qxl</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>none</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>bochs</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>ramfb</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </video>
Dec 05 12:12:41 user nova-compute[75071]:     <hostdev supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='mode'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>subsystem</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='startupPolicy'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>default</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>mandatory</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>requisite</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>optional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='subsysType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>usb</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>pci</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>scsi</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='capsType'/>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='pciBackend'/>
Dec 05 12:12:41 user nova-compute[75071]:     </hostdev>
Dec 05 12:12:41 user nova-compute[75071]:     <rng supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='backendModel'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>random</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>egd</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>builtin</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </rng>
Dec 05 12:12:41 user nova-compute[75071]:     <filesystem supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='driverType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>path</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>handle</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtiofs</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </filesystem>
Dec 05 12:12:41 user nova-compute[75071]:     <tpm supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>tpm-tis</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>tpm-crb</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='backendModel'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>passthrough</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>emulator</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </tpm>
Dec 05 12:12:41 user nova-compute[75071]:   </devices>
Dec 05 12:12:41 user nova-compute[75071]:   <features>
Dec 05 12:12:41 user nova-compute[75071]:     <gic supported='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     <vmcoreinfo supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <genid supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <backingStoreInput supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <backup supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <sev supported='no'/>
Dec 05 12:12:41 user nova-compute[75071]:   </features>
Dec 05 12:12:41 user nova-compute[75071]: </domainCapabilities>
Dec 05 12:12:41 user nova-compute[75071]:  {{(pid=75071) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Dec 05 12:12:41 user nova-compute[75071]: <domainCapabilities>
Dec 05 12:12:41 user nova-compute[75071]:   <path>/usr/bin/qemu-system-i386</path>
Dec 05 12:12:41 user nova-compute[75071]:   <domain>kvm</domain>
Dec 05 12:12:41 user nova-compute[75071]:   <machine>pc-q35-6.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:   <arch>i686</arch>
Dec 05 12:12:41 user nova-compute[75071]:   <vcpu max='288'/>
Dec 05 12:12:41 user nova-compute[75071]:   <iothreads supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:   <os supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:     <enum name='firmware'/>
Dec 05 12:12:41 user nova-compute[75071]:     <loader supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='type'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>rom</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>pflash</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='readonly'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>yes</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>no</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='secure'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>no</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </loader>
Dec 05 12:12:41 user nova-compute[75071]:   </os>
Dec 05 12:12:41 user nova-compute[75071]:   <cpu>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='host-passthrough' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='hostPassthroughMigratable'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>off</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='maximum' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='maximumMigratable'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>on</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>off</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='host-model' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <vendor>Intel</vendor>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ss'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='vmx'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='pcid'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='hypervisor'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='arat'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='umip'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='md-clear'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='stibp'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ssbd'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ibpb'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ibrs'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='amd-stibp'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='erms'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='lm'/>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='custom' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>qemu64</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>qemu32</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>phenom</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium3</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium2</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>n270</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>kvm64</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>kvm32</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>coreduo</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>core2duo</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>athlon</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Westmere-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Westmere</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Snowridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>SandyBridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Penryn</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G5</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G4</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G3</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G2</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G1</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Nehalem-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Nehalem</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>IvyBridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Icelake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-Rome</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-Milan</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Dhyana</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cooperlake</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Conroe</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>486</model>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:   </cpu>
Dec 05 12:12:41 user nova-compute[75071]:   <memoryBacking supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:     <enum name='sourceType'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>file</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>anonymous</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>memfd</value>
Dec 05 12:12:41 user nova-compute[75071]:     </enum>
Dec 05 12:12:41 user nova-compute[75071]:   </memoryBacking>
Dec 05 12:12:41 user nova-compute[75071]:   <devices>
Dec 05 12:12:41 user nova-compute[75071]:     <disk supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='diskDevice'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>disk</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>cdrom</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>floppy</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>lun</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='bus'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>fdc</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>scsi</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>usb</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>sata</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </disk>
Dec 05 12:12:41 user nova-compute[75071]:     <graphics supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='type'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>sdl</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vnc</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>spice</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>egl-headless</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </graphics>
Dec 05 12:12:41 user nova-compute[75071]:     <video supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='modelType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vga</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>cirrus</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vmvga</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>qxl</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>none</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>bochs</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>ramfb</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </video>
Dec 05 12:12:41 user nova-compute[75071]:     <hostdev supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='mode'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>subsystem</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='startupPolicy'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>default</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>mandatory</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>requisite</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>optional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='subsysType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>usb</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>pci</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>scsi</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='capsType'/>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='pciBackend'/>
Dec 05 12:12:41 user nova-compute[75071]:     </hostdev>
Dec 05 12:12:41 user nova-compute[75071]:     <rng supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='backendModel'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>random</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>egd</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>builtin</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </rng>
Dec 05 12:12:41 user nova-compute[75071]:     <filesystem supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='driverType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>path</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>handle</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtiofs</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </filesystem>
Dec 05 12:12:41 user nova-compute[75071]:     <tpm supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>tpm-tis</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>tpm-crb</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='backendModel'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>passthrough</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>emulator</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </tpm>
Dec 05 12:12:41 user nova-compute[75071]:   </devices>
Dec 05 12:12:41 user nova-compute[75071]:   <features>
Dec 05 12:12:41 user nova-compute[75071]:     <gic supported='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     <vmcoreinfo supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <genid supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <backingStoreInput supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <backup supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <sev supported='no'/>
Dec 05 12:12:41 user nova-compute[75071]:   </features>
Dec 05 12:12:41 user nova-compute[75071]: </domainCapabilities>
Dec 05 12:12:41 user nova-compute[75071]:  {{(pid=75071) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Dec 05 12:12:41 user nova-compute[75071]: <domainCapabilities>
Dec 05 12:12:41 user nova-compute[75071]:   <path>/usr/bin/qemu-system-i386</path>
Dec 05 12:12:41 user nova-compute[75071]:   <domain>kvm</domain>
Dec 05 12:12:41 user nova-compute[75071]:   <machine>pc-i440fx-6.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:   <arch>i686</arch>
Dec 05 12:12:41 user nova-compute[75071]:   <vcpu max='255'/>
Dec 05 12:12:41 user nova-compute[75071]:   <iothreads supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:   <os supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:     <enum name='firmware'/>
Dec 05 12:12:41 user nova-compute[75071]:     <loader supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='type'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>rom</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>pflash</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='readonly'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>yes</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>no</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='secure'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>no</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </loader>
Dec 05 12:12:41 user nova-compute[75071]:   </os>
Dec 05 12:12:41 user nova-compute[75071]:   <cpu>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='host-passthrough' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='hostPassthroughMigratable'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>off</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='maximum' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='maximumMigratable'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>on</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>off</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='host-model' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <vendor>Intel</vendor>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ss'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='vmx'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='pcid'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='hypervisor'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='arat'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='umip'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='md-clear'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='stibp'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ssbd'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ibpb'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ibrs'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='amd-stibp'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='erms'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='lm'/>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='custom' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>qemu64</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>qemu32</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>phenom</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium3</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium2</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>n270</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>kvm64</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>kvm32</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>coreduo</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>core2duo</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>athlon</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Westmere-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Westmere</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Snowridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>SandyBridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Penryn</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G5</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G4</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G3</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G2</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G1</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Nehalem-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Nehalem</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>IvyBridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Icelake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-Rome</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-Milan</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Dhyana</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cooperlake</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Conroe</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>486</model>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:   </cpu>
Dec 05 12:12:41 user nova-compute[75071]:   <memoryBacking supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:     <enum name='sourceType'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>file</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>anonymous</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>memfd</value>
Dec 05 12:12:41 user nova-compute[75071]:     </enum>
Dec 05 12:12:41 user nova-compute[75071]:   </memoryBacking>
Dec 05 12:12:41 user nova-compute[75071]:   <devices>
Dec 05 12:12:41 user nova-compute[75071]:     <disk supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='diskDevice'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>disk</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>cdrom</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>floppy</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>lun</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='bus'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>ide</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>fdc</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>scsi</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>usb</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>sata</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </disk>
Dec 05 12:12:41 user nova-compute[75071]:     <graphics supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='type'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>sdl</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vnc</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>spice</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>egl-headless</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </graphics>
Dec 05 12:12:41 user nova-compute[75071]:     <video supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='modelType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vga</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>cirrus</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vmvga</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>qxl</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>none</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>bochs</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>ramfb</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </video>
Dec 05 12:12:41 user nova-compute[75071]:     <hostdev supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='mode'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>subsystem</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='startupPolicy'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>default</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>mandatory</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>requisite</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>optional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='subsysType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>usb</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>pci</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>scsi</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='capsType'/>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='pciBackend'/>
Dec 05 12:12:41 user nova-compute[75071]:     </hostdev>
Dec 05 12:12:41 user nova-compute[75071]:     <rng supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='backendModel'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>random</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>egd</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>builtin</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </rng>
Dec 05 12:12:41 user nova-compute[75071]:     <filesystem supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='driverType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>path</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>handle</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtiofs</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </filesystem>
Dec 05 12:12:41 user nova-compute[75071]:     <tpm supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>tpm-tis</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>tpm-crb</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='backendModel'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>passthrough</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>emulator</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </tpm>
Dec 05 12:12:41 user nova-compute[75071]:   </devices>
Dec 05 12:12:41 user nova-compute[75071]:   <features>
Dec 05 12:12:41 user nova-compute[75071]:     <gic supported='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     <vmcoreinfo supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <genid supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <backingStoreInput supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <backup supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <sev supported='no'/>
Dec 05 12:12:41 user nova-compute[75071]:   </features>
Dec 05 12:12:41 user nova-compute[75071]: </domainCapabilities>
Dec 05 12:12:41 user nova-compute[75071]:  {{(pid=75071) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Dec 05 12:12:41 user nova-compute[75071]: <domainCapabilities>
Dec 05 12:12:41 user nova-compute[75071]:   <path>/usr/bin/qemu-system-i386</path>
Dec 05 12:12:41 user nova-compute[75071]:   <domain>kvm</domain>
Dec 05 12:12:41 user nova-compute[75071]:   <machine>pc-i440fx-jammy</machine>
Dec 05 12:12:41 user nova-compute[75071]:   <arch>i686</arch>
Dec 05 12:12:41 user nova-compute[75071]:   <vcpu max='255'/>
Dec 05 12:12:41 user nova-compute[75071]:   <iothreads supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:   <os supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:     <enum name='firmware'/>
Dec 05 12:12:41 user nova-compute[75071]:     <loader supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='type'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>rom</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>pflash</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='readonly'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>yes</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>no</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='secure'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>no</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </loader>
Dec 05 12:12:41 user nova-compute[75071]:   </os>
Dec 05 12:12:41 user nova-compute[75071]:   <cpu>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='host-passthrough' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='hostPassthroughMigratable'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>off</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='maximum' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='maximumMigratable'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>on</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>off</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='host-model' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <vendor>Intel</vendor>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ss'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='vmx'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='pcid'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='hypervisor'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='arat'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='umip'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='md-clear'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='stibp'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ssbd'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ibpb'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ibrs'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='amd-stibp'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='erms'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='lm'/>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='custom' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>qemu64</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>qemu32</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>phenom</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium3</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium2</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>n270</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>kvm64</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>kvm32</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>coreduo</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>core2duo</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>athlon</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Westmere-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Westmere</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Snowridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>SandyBridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Penryn</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G5</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G4</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G3</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G2</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G1</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Nehalem-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Nehalem</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>IvyBridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Icelake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-Rome</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-Milan</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Dhyana</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cooperlake</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Conroe</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>486</model>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:   </cpu>
Dec 05 12:12:41 user nova-compute[75071]:   <memoryBacking supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:     <enum name='sourceType'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>file</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>anonymous</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>memfd</value>
Dec 05 12:12:41 user nova-compute[75071]:     </enum>
Dec 05 12:12:41 user nova-compute[75071]:   </memoryBacking>
Dec 05 12:12:41 user nova-compute[75071]:   <devices>
Dec 05 12:12:41 user nova-compute[75071]:     <disk supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='diskDevice'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>disk</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>cdrom</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>floppy</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>lun</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='bus'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>ide</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>fdc</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>scsi</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>usb</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>sata</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </disk>
Dec 05 12:12:41 user nova-compute[75071]:     <graphics supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='type'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>sdl</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vnc</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>spice</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>egl-headless</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </graphics>
Dec 05 12:12:41 user nova-compute[75071]:     <video supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='modelType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vga</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>cirrus</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vmvga</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>qxl</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>none</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>bochs</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>ramfb</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </video>
Dec 05 12:12:41 user nova-compute[75071]:     <hostdev supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='mode'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>subsystem</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='startupPolicy'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>default</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>mandatory</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>requisite</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>optional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='subsysType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>usb</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>pci</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>scsi</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='capsType'/>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='pciBackend'/>
Dec 05 12:12:41 user nova-compute[75071]:     </hostdev>
Dec 05 12:12:41 user nova-compute[75071]:     <rng supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='backendModel'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>random</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>egd</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>builtin</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </rng>
Dec 05 12:12:41 user nova-compute[75071]:     <filesystem supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='driverType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>path</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>handle</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtiofs</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </filesystem>
Dec 05 12:12:41 user nova-compute[75071]:     <tpm supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>tpm-tis</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>tpm-crb</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='backendModel'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>passthrough</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>emulator</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </tpm>
Dec 05 12:12:41 user nova-compute[75071]:   </devices>
Dec 05 12:12:41 user nova-compute[75071]:   <features>
Dec 05 12:12:41 user nova-compute[75071]:     <gic supported='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     <vmcoreinfo supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <genid supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <backingStoreInput supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <backup supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <sev supported='no'/>
Dec 05 12:12:41 user nova-compute[75071]:   </features>
Dec 05 12:12:41 user nova-compute[75071]: </domainCapabilities>
Dec 05 12:12:41 user nova-compute[75071]:  {{(pid=75071) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'q35', 'pc', 'ubuntu'} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Dec 05 12:12:41 user nova-compute[75071]: <domainCapabilities>
Dec 05 12:12:41 user nova-compute[75071]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 05 12:12:41 user nova-compute[75071]:   <domain>kvm</domain>
Dec 05 12:12:41 user nova-compute[75071]:   <machine>pc-q35-jammy</machine>
Dec 05 12:12:41 user nova-compute[75071]:   <arch>x86_64</arch>
Dec 05 12:12:41 user nova-compute[75071]:   <vcpu max='288'/>
Dec 05 12:12:41 user nova-compute[75071]:   <iothreads supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:   <os supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:     <enum name='firmware'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>efi</value>
Dec 05 12:12:41 user nova-compute[75071]:     </enum>
Dec 05 12:12:41 user nova-compute[75071]:     <loader supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='type'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>rom</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>pflash</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='readonly'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>yes</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>no</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='secure'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>yes</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>no</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </loader>
Dec 05 12:12:41 user nova-compute[75071]:   </os>
Dec 05 12:12:41 user nova-compute[75071]:   <cpu>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='host-passthrough' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='hostPassthroughMigratable'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>on</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>off</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='maximum' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='maximumMigratable'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>on</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>off</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='host-model' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <vendor>Intel</vendor>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ss'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='vmx'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='pcid'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='hypervisor'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='arat'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='umip'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='md-clear'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='stibp'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ssbd'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='invtsc'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ibpb'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ibrs'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='amd-stibp'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='rsba'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='pschange-mc-no'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='erms'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='custom' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>qemu64</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>qemu32</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>phenom</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium3</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium2</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>n270</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>kvm64</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>kvm32</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>coreduo</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>core2duo</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>athlon</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Westmere-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Westmere</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Snowridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>SandyBridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Penryn</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G5</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G4</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G3</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G2</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Opteron_G1</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Nehalem</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>IvyBridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Icelake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-Rome</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-Milan</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Dhyana</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cooperlake</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Conroe</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>486</model>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:   </cpu>
Dec 05 12:12:41 user nova-compute[75071]:   <memoryBacking supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:     <enum name='sourceType'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>file</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>anonymous</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>memfd</value>
Dec 05 12:12:41 user nova-compute[75071]:     </enum>
Dec 05 12:12:41 user nova-compute[75071]:   </memoryBacking>
Dec 05 12:12:41 user nova-compute[75071]:   <devices>
Dec 05 12:12:41 user nova-compute[75071]:     <disk supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='diskDevice'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>disk</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>cdrom</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>floppy</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>lun</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='bus'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>fdc</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>scsi</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>usb</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>sata</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </disk>
Dec 05 12:12:41 user nova-compute[75071]:     <graphics supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='type'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>sdl</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vnc</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>spice</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>egl-headless</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </graphics>
Dec 05 12:12:41 user nova-compute[75071]:     <video supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='modelType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vga</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>cirrus</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vmvga</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>qxl</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>none</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>bochs</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>ramfb</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </video>
Dec 05 12:12:41 user nova-compute[75071]:     <hostdev supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='mode'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>subsystem</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='startupPolicy'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>default</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>mandatory</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>requisite</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>optional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='subsysType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>usb</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>pci</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>scsi</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='capsType'/>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='pciBackend'/>
Dec 05 12:12:41 user nova-compute[75071]:     </hostdev>
Dec 05 12:12:41 user nova-compute[75071]:     <rng supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='backendModel'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>random</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>egd</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>builtin</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </rng>
Dec 05 12:12:41 user nova-compute[75071]:     <filesystem supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='driverType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>path</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>handle</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtiofs</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </filesystem>
Dec 05 12:12:41 user nova-compute[75071]:     <tpm supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>tpm-tis</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>tpm-crb</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='backendModel'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>passthrough</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>emulator</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </tpm>
Dec 05 12:12:41 user nova-compute[75071]:   </devices>
Dec 05 12:12:41 user nova-compute[75071]:   <features>
Dec 05 12:12:41 user nova-compute[75071]:     <gic supported='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     <vmcoreinfo supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <genid supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <backingStoreInput supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <backup supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <sev supported='no'/>
Dec 05 12:12:41 user nova-compute[75071]:   </features>
Dec 05 12:12:41 user nova-compute[75071]: </domainCapabilities>
Dec 05 12:12:41 user nova-compute[75071]:  {{(pid=75071) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Dec 05 12:12:41 user nova-compute[75071]: <domainCapabilities>
Dec 05 12:12:41 user nova-compute[75071]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 05 12:12:41 user nova-compute[75071]:   <domain>kvm</domain>
Dec 05 12:12:41 user nova-compute[75071]:   <machine>pc-q35-6.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:   <arch>x86_64</arch>
Dec 05 12:12:41 user nova-compute[75071]:   <vcpu max='288'/>
Dec 05 12:12:41 user nova-compute[75071]:   <iothreads supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:   <os supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:     <enum name='firmware'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>efi</value>
Dec 05 12:12:41 user nova-compute[75071]:     </enum>
Dec 05 12:12:41 user nova-compute[75071]:     <loader supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='type'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>rom</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>pflash</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='readonly'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>yes</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>no</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='secure'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>yes</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>no</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </loader>
Dec 05 12:12:41 user nova-compute[75071]:   </os>
Dec 05 12:12:41 user nova-compute[75071]:   <cpu>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='host-passthrough' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='hostPassthroughMigratable'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>on</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>off</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='maximum' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='maximumMigratable'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>on</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>off</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='host-model' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <vendor>Intel</vendor>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ss'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='vmx'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='pcid'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='hypervisor'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='arat'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='umip'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='md-clear'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='stibp'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ssbd'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='invtsc'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ibpb'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ibrs'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='amd-stibp'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='rsba'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='pschange-mc-no'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='erms'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='custom' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>qemu64</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>qemu32</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>phenom</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium3</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium2</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>n270</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>kvm64</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>kvm32</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>coreduo</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>core2duo</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>athlon</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Westmere-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Westmere</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Snowridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>SandyBridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Penryn</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G5</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G4</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G3</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G2</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Opteron_G1</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Nehalem</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>IvyBridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Icelake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-Rome</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-Milan</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Dhyana</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cooperlake</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Conroe</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>486</model>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:   </cpu>
Dec 05 12:12:41 user nova-compute[75071]:   <memoryBacking supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:     <enum name='sourceType'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>file</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>anonymous</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>memfd</value>
Dec 05 12:12:41 user nova-compute[75071]:     </enum>
Dec 05 12:12:41 user nova-compute[75071]:   </memoryBacking>
Dec 05 12:12:41 user nova-compute[75071]:   <devices>
Dec 05 12:12:41 user nova-compute[75071]:     <disk supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='diskDevice'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>disk</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>cdrom</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>floppy</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>lun</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='bus'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>fdc</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>scsi</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>usb</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>sata</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </disk>
Dec 05 12:12:41 user nova-compute[75071]:     <graphics supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='type'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>sdl</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vnc</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>spice</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>egl-headless</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </graphics>
Dec 05 12:12:41 user nova-compute[75071]:     <video supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='modelType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vga</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>cirrus</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vmvga</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>qxl</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>none</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>bochs</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>ramfb</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </video>
Dec 05 12:12:41 user nova-compute[75071]:     <hostdev supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='mode'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>subsystem</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='startupPolicy'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>default</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>mandatory</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>requisite</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>optional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='subsysType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>usb</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>pci</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>scsi</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='capsType'/>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='pciBackend'/>
Dec 05 12:12:41 user nova-compute[75071]:     </hostdev>
Dec 05 12:12:41 user nova-compute[75071]:     <rng supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='backendModel'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>random</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>egd</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>builtin</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </rng>
Dec 05 12:12:41 user nova-compute[75071]:     <filesystem supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='driverType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>path</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>handle</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtiofs</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </filesystem>
Dec 05 12:12:41 user nova-compute[75071]:     <tpm supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>tpm-tis</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>tpm-crb</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='backendModel'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>passthrough</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>emulator</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </tpm>
Dec 05 12:12:41 user nova-compute[75071]:   </devices>
Dec 05 12:12:41 user nova-compute[75071]:   <features>
Dec 05 12:12:41 user nova-compute[75071]:     <gic supported='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     <vmcoreinfo supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <genid supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <backingStoreInput supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <backup supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <sev supported='no'/>
Dec 05 12:12:41 user nova-compute[75071]:   </features>
Dec 05 12:12:41 user nova-compute[75071]: </domainCapabilities>
Dec 05 12:12:41 user nova-compute[75071]:  {{(pid=75071) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Dec 05 12:12:41 user nova-compute[75071]: <domainCapabilities>
Dec 05 12:12:41 user nova-compute[75071]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 05 12:12:41 user nova-compute[75071]:   <domain>kvm</domain>
Dec 05 12:12:41 user nova-compute[75071]:   <machine>pc-i440fx-6.2</machine>
Dec 05 12:12:41 user nova-compute[75071]:   <arch>x86_64</arch>
Dec 05 12:12:41 user nova-compute[75071]:   <vcpu max='255'/>
Dec 05 12:12:41 user nova-compute[75071]:   <iothreads supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:   <os supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:     <enum name='firmware'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>efi</value>
Dec 05 12:12:41 user nova-compute[75071]:     </enum>
Dec 05 12:12:41 user nova-compute[75071]:     <loader supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='type'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>rom</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>pflash</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='readonly'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>yes</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>no</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='secure'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>no</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </loader>
Dec 05 12:12:41 user nova-compute[75071]:   </os>
Dec 05 12:12:41 user nova-compute[75071]:   <cpu>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='host-passthrough' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='hostPassthroughMigratable'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>on</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>off</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='maximum' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='maximumMigratable'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>on</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>off</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='host-model' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <vendor>Intel</vendor>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ss'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='vmx'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='pcid'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='hypervisor'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='arat'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='umip'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='md-clear'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='stibp'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ssbd'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='invtsc'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ibpb'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ibrs'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='amd-stibp'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='rsba'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='pschange-mc-no'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='erms'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='custom' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>qemu64</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>qemu32</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>phenom</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium3</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium2</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>n270</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>kvm64</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>kvm32</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>coreduo</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>core2duo</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>athlon</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Westmere-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Westmere</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Snowridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>SandyBridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Penryn</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G5</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G4</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G3</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G2</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Opteron_G1</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Nehalem</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>IvyBridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Icelake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-Rome</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-Milan</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Dhyana</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cooperlake</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Conroe</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>486</model>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:   </cpu>
Dec 05 12:12:41 user nova-compute[75071]:   <memoryBacking supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:     <enum name='sourceType'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>file</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>anonymous</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>memfd</value>
Dec 05 12:12:41 user nova-compute[75071]:     </enum>
Dec 05 12:12:41 user nova-compute[75071]:   </memoryBacking>
Dec 05 12:12:41 user nova-compute[75071]:   <devices>
Dec 05 12:12:41 user nova-compute[75071]:     <disk supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='diskDevice'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>disk</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>cdrom</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>floppy</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>lun</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='bus'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>ide</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>fdc</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>scsi</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>usb</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>sata</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </disk>
Dec 05 12:12:41 user nova-compute[75071]:     <graphics supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='type'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>sdl</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vnc</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>spice</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>egl-headless</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </graphics>
Dec 05 12:12:41 user nova-compute[75071]:     <video supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='modelType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vga</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>cirrus</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vmvga</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>qxl</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>none</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>bochs</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>ramfb</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </video>
Dec 05 12:12:41 user nova-compute[75071]:     <hostdev supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='mode'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>subsystem</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='startupPolicy'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>default</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>mandatory</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>requisite</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>optional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='subsysType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>usb</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>pci</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>scsi</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='capsType'/>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='pciBackend'/>
Dec 05 12:12:41 user nova-compute[75071]:     </hostdev>
Dec 05 12:12:41 user nova-compute[75071]:     <rng supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='backendModel'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>random</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>egd</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>builtin</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </rng>
Dec 05 12:12:41 user nova-compute[75071]:     <filesystem supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='driverType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>path</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>handle</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtiofs</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </filesystem>
Dec 05 12:12:41 user nova-compute[75071]:     <tpm supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>tpm-tis</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>tpm-crb</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='backendModel'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>passthrough</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>emulator</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </tpm>
Dec 05 12:12:41 user nova-compute[75071]:   </devices>
Dec 05 12:12:41 user nova-compute[75071]:   <features>
Dec 05 12:12:41 user nova-compute[75071]:     <gic supported='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     <vmcoreinfo supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <genid supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <backingStoreInput supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <backup supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <sev supported='no'/>
Dec 05 12:12:41 user nova-compute[75071]:   </features>
Dec 05 12:12:41 user nova-compute[75071]: </domainCapabilities>
Dec 05 12:12:41 user nova-compute[75071]:  {{(pid=75071) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Dec 05 12:12:41 user nova-compute[75071]: <domainCapabilities>
Dec 05 12:12:41 user nova-compute[75071]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 05 12:12:41 user nova-compute[75071]:   <domain>kvm</domain>
Dec 05 12:12:41 user nova-compute[75071]:   <machine>pc-i440fx-jammy</machine>
Dec 05 12:12:41 user nova-compute[75071]:   <arch>x86_64</arch>
Dec 05 12:12:41 user nova-compute[75071]:   <vcpu max='255'/>
Dec 05 12:12:41 user nova-compute[75071]:   <iothreads supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:   <os supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:     <enum name='firmware'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>efi</value>
Dec 05 12:12:41 user nova-compute[75071]:     </enum>
Dec 05 12:12:41 user nova-compute[75071]:     <loader supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='type'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>rom</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>pflash</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='readonly'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>yes</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>no</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='secure'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>no</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </loader>
Dec 05 12:12:41 user nova-compute[75071]:   </os>
Dec 05 12:12:41 user nova-compute[75071]:   <cpu>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='host-passthrough' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='hostPassthroughMigratable'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>on</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>off</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='maximum' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='maximumMigratable'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>on</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>off</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='host-model' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <vendor>Intel</vendor>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ss'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='vmx'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='pcid'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='hypervisor'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='arat'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='tsc_adjust'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='umip'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='md-clear'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='stibp'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='arch-capabilities'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ssbd'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='invtsc'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ibpb'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='ibrs'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='amd-stibp'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='amd-ssbd'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='rsba'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='require' name='pschange-mc-no'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='erms'/>
Dec 05 12:12:41 user nova-compute[75071]:       <feature policy='disable' name='xsaveopt'/>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:     <mode name='custom' supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>qemu64</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>qemu32</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>phenom</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium3</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium2</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>pentium</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>n270</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>kvm64</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>kvm32</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>coreduo</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>core2duo</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>athlon</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Westmere-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Westmere</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Snowridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Skylake-Client</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>SandyBridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Penryn</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G5</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G4</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G3</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Opteron_G2</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Opteron_G1</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Nehalem</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>IvyBridge</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Icelake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Haswell</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-Rome</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-Milan</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC-IBPB</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>EPYC</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Dhyana</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cooperlake</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>Conroe</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Cascadelake-Server</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-noTSX</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell-IBRS</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='no'>Broadwell</model>
Dec 05 12:12:41 user nova-compute[75071]:       <model usable='yes'>486</model>
Dec 05 12:12:41 user nova-compute[75071]:     </mode>
Dec 05 12:12:41 user nova-compute[75071]:   </cpu>
Dec 05 12:12:41 user nova-compute[75071]:   <memoryBacking supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:     <enum name='sourceType'>
Dec 05 12:12:41 user nova-compute[75071]:       <value>file</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>anonymous</value>
Dec 05 12:12:41 user nova-compute[75071]:       <value>memfd</value>
Dec 05 12:12:41 user nova-compute[75071]:     </enum>
Dec 05 12:12:41 user nova-compute[75071]:   </memoryBacking>
Dec 05 12:12:41 user nova-compute[75071]:   <devices>
Dec 05 12:12:41 user nova-compute[75071]:     <disk supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='diskDevice'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>disk</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>cdrom</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>floppy</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>lun</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='bus'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>ide</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>fdc</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>scsi</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>usb</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>sata</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </disk>
Dec 05 12:12:41 user nova-compute[75071]:     <graphics supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='type'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>sdl</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vnc</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>spice</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>egl-headless</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </graphics>
Dec 05 12:12:41 user nova-compute[75071]:     <video supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='modelType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vga</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>cirrus</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>vmvga</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>qxl</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>none</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>bochs</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>ramfb</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </video>
Dec 05 12:12:41 user nova-compute[75071]:     <hostdev supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='mode'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>subsystem</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='startupPolicy'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>default</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>mandatory</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>requisite</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>optional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='subsysType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>usb</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>pci</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>scsi</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='capsType'/>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='pciBackend'/>
Dec 05 12:12:41 user nova-compute[75071]:     </hostdev>
Dec 05 12:12:41 user nova-compute[75071]:     <rng supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtio-non-transitional</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='backendModel'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>random</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>egd</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>builtin</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </rng>
Dec 05 12:12:41 user nova-compute[75071]:     <filesystem supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='driverType'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>path</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>handle</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>virtiofs</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </filesystem>
Dec 05 12:12:41 user nova-compute[75071]:     <tpm supported='yes'>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='model'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>tpm-tis</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>tpm-crb</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:       <enum name='backendModel'>
Dec 05 12:12:41 user nova-compute[75071]:         <value>passthrough</value>
Dec 05 12:12:41 user nova-compute[75071]:         <value>emulator</value>
Dec 05 12:12:41 user nova-compute[75071]:       </enum>
Dec 05 12:12:41 user nova-compute[75071]:     </tpm>
Dec 05 12:12:41 user nova-compute[75071]:   </devices>
Dec 05 12:12:41 user nova-compute[75071]:   <features>
Dec 05 12:12:41 user nova-compute[75071]:     <gic supported='no'/>
Dec 05 12:12:41 user nova-compute[75071]:     <vmcoreinfo supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <genid supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <backingStoreInput supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <backup supported='yes'/>
Dec 05 12:12:41 user nova-compute[75071]:     <sev supported='no'/>
Dec 05 12:12:41 user nova-compute[75071]:   </features>
Dec 05 12:12:41 user nova-compute[75071]: </domainCapabilities>
Dec 05 12:12:41 user nova-compute[75071]:  {{(pid=75071) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75071) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75071) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Checking secure boot support for host arch (x86_64) {{(pid=75071) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 05 12:12:41 user nova-compute[75071]: INFO nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Secure Boot support detected
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] cpu compare xml: <cpu match="exact">
Dec 05 12:12:41 user nova-compute[75071]:   <model>Nehalem</model>
Dec 05 12:12:41 user nova-compute[75071]: </cpu>
Dec 05 12:12:41 user nova-compute[75071]:  {{(pid=75071) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10017}}
Dec 05 12:12:41 user nova-compute[75071]: INFO nova.virt.node [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Generated node identity 25beb694-9dd7-475f-9657-74a5f0368417
Dec 05 12:12:41 user nova-compute[75071]: INFO nova.virt.node [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Wrote node identity 25beb694-9dd7-475f-9657-74a5f0368417 to /opt/stack/data/nova/compute_id
Dec 05 12:12:41 user nova-compute[75071]: WARNING nova.compute.manager [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Compute nodes ['25beb694-9dd7-475f-9657-74a5f0368417'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Dec 05 12:12:41 user nova-compute[75071]: INFO nova.compute.manager [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Dec 05 12:12:41 user nova-compute[75071]: WARNING nova.compute.manager [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Dec 05 12:12:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:12:41 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:12:42 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:12:42 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:12:42 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Hypervisor/Node resource view: name=user free_ram=10908MB free_disk=26.094890594482422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:12:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:12:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:12:42 user nova-compute[75071]: WARNING nova.compute.resource_tracker [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] No compute node record for user:25beb694-9dd7-475f-9657-74a5f0368417: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 25beb694-9dd7-475f-9657-74a5f0368417 could not be found.
Dec 05 12:12:42 user nova-compute[75071]: INFO nova.compute.resource_tracker [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Compute node record created for user:user with uuid: 25beb694-9dd7-475f-9657-74a5f0368417
Dec 05 12:12:42 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:12:42 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:12:42 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] [req-8dc17a0e-98c9-4acd-8f25-c0086499a3c9] Created resource provider record via placement API for resource provider with UUID 25beb694-9dd7-475f-9657-74a5f0368417 and name user.
Dec 05 12:12:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75071) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Dec 05 12:12:42 user nova-compute[75071]: INFO nova.virt.libvirt.host [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] kernel doesn't support AMD SEV
Dec 05 12:12:42 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Updating inventory in ProviderTree for provider 25beb694-9dd7-475f-9657-74a5f0368417 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 12:12:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:12:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Libvirt baseline CPU <cpu>
Dec 05 12:12:42 user nova-compute[75071]:   <arch>x86_64</arch>
Dec 05 12:12:42 user nova-compute[75071]:   <model>Nehalem</model>
Dec 05 12:12:42 user nova-compute[75071]:   <vendor>Intel</vendor>
Dec 05 12:12:42 user nova-compute[75071]:   <topology sockets="6" cores="1" threads="1"/>
Dec 05 12:12:42 user nova-compute[75071]: </cpu>
Dec 05 12:12:42 user nova-compute[75071]:  {{(pid=75071) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12515}}
Dec 05 12:12:42 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Updated inventory for provider 25beb694-9dd7-475f-9657-74a5f0368417 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Dec 05 12:12:42 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Updating resource provider 25beb694-9dd7-475f-9657-74a5f0368417 generation from 0 to 1 during operation: update_inventory {{(pid=75071) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Dec 05 12:12:42 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Updating inventory in ProviderTree for provider 25beb694-9dd7-475f-9657-74a5f0368417 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 12:12:42 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Updating resource provider 25beb694-9dd7-475f-9657-74a5f0368417 generation from 1 to 2 during operation: update_traits {{(pid=75071) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Dec 05 12:12:42 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:12:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.702s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:12:42 user nova-compute[75071]: DEBUG nova.service [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Creating RPC server for service compute {{(pid=75071) start /opt/stack/nova/nova/service.py:182}}
Dec 05 12:12:42 user nova-compute[75071]: DEBUG nova.service [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] Join ServiceGroup membership for this service compute {{(pid=75071) start /opt/stack/nova/nova/service.py:199}}
Dec 05 12:12:42 user nova-compute[75071]: DEBUG nova.servicegroup.drivers.db [None req-aecb5279-1019-4f65-a411-cd4e64c180c3 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75071) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Dec 05 12:13:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_power_states {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:13:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:13:33 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:13:33 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:13:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:13:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 12:13:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 12:13:33 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:13:33 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:13:33 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:13:33 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:13:33 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:13:33 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:13:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:13:33 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:13:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:13:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:13:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:13:33 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:13:33 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:13:33 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:13:33 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=10374MB free_disk=25.9986572265625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:13:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:13:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:13:34 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:13:34 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:13:34 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:13:34 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:13:34 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:13:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:14:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:14:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:14:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:14:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:14:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:14:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:14:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:14:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 12:14:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 12:14:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:14:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:14:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:14:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:14:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:14:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:14:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:14:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:14:35 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:14:35 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:14:35 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:14:35 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=10303MB free_disk=26.06313705444336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:14:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:14:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:14:36 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:14:36 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:14:36 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:14:36 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:14:36 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:14:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:15:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:15:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:15:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:15:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:15:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:15:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:15:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:15:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:15:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:15:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:15:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 12:15:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 12:15:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:15:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:15:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:15:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:15:36 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:15:36 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:15:36 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:15:36 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=10321MB free_disk=25.815444946289062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:15:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:15:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:15:37 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:15:37 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:15:37 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:15:37 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:15:37 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:15:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.102s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:16:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:16:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:16:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:16:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:16:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:16:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:16:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:16:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:16:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:16:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:16:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:16:36 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:16:37 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:16:37 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:16:37 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=9629MB free_disk=25.836257934570312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:16:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:16:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:16:37 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:16:37 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:16:37 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:16:37 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:16:37 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:16:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:16:38 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:16:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:16:38 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:16:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:16:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 12:16:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 12:16:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "81333acc-8dc7-42f1-9026-e42a30e52a5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:16:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:16:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:16:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:16:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:16:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:16:51 user nova-compute[75071]: INFO nova.compute.claims [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Claim successful on node user
Dec 05 12:16:51 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:16:51 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:16:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:16:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:16:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:16:51 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:16:51 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:16:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:16:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:16:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:16:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Creating image(s)
Dec 05 12:16:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "/opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:16:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "/opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:16:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "/opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:16:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:16:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:16:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:16:52 user nova-compute[75071]: DEBUG nova.policy [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d78c212de2e426fad0cba51a2e7bf52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c1a038a4eb45508b7f5aa3eb435229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:16:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18.part --force-share --output=json" returned: 0 in 0.200s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:16:52 user nova-compute[75071]: DEBUG nova.virt.images [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] b161e746-a23e-4c74-ab8c-45ef211d5e66 was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 12:16:52 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 12:16:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18.part /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:16:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18.part /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18.converted" returned: 0 in 0.287s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:16:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:16:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:16:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.173s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:16:53 user nova-compute[75071]: INFO oslo.privsep.daemon [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpzt4ceb5s/privsep.sock']
Dec 05 12:16:53 user sudo[84339]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpzt4ceb5s/privsep.sock
Dec 05 12:16:53 user sudo[84339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 05 12:16:54 user sudo[84339]: pam_unix(sudo:session): session closed for user root
Dec 05 12:16:54 user nova-compute[75071]: INFO oslo.privsep.daemon [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Spawned new privsep daemon via rootwrap
Dec 05 12:16:54 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 05 12:16:54 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 05 12:16:54 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Dec 05 12:16:54 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84353
Dec 05 12:16:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:16:54 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Successfully created port: bcda865e-a8e7-4f6a-a633-95c0d037b04e {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:16:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.208s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:16:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:16:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:16:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:16:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:16:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:16:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk 1073741824" returned: 0 in 0.061s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:16:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:16:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:16:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.216s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:16:55 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:16:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:16:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:16:55 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Cannot resize image /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:16:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:16:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Ensure instance console log exists: /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:16:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:16:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:16:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:16:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "e08be776-0fa9-4871-86eb-2093530c00f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:16:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "e08be776-0fa9-4871-86eb-2093530c00f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:16:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:16:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:16:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:16:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:16:56 user nova-compute[75071]: INFO nova.compute.claims [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Claim successful on node user
Dec 05 12:16:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Successfully updated port: bcda865e-a8e7-4f6a-a633-95c0d037b04e {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "refresh_cache-81333acc-8dc7-42f1-9026-e42a30e52a5a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquired lock "refresh_cache-81333acc-8dc7-42f1-9026-e42a30e52a5a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.055s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:16:57 user nova-compute[75071]: INFO nova.compute.claims [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Claim successful on node user
Dec 05 12:16:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:16:57 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:16:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-7fb54e1e-e104-4871-8db8-2628f6a1159a req-e30db47b-98c8-4185-9230-1611cd812e74 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Received event network-changed-bcda865e-a8e7-4f6a-a633-95c0d037b04e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-7fb54e1e-e104-4871-8db8-2628f6a1159a req-e30db47b-98c8-4185-9230-1611cd812e74 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Refreshing instance network info cache due to event network-changed-bcda865e-a8e7-4f6a-a633-95c0d037b04e. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7fb54e1e-e104-4871-8db8-2628f6a1159a req-e30db47b-98c8-4185-9230-1611cd812e74 service nova] Acquiring lock "refresh_cache-81333acc-8dc7-42f1-9026-e42a30e52a5a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG nova.policy [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7e73e24d5b1489c813f06690b12eef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b6bfae34944fcfbd49d2f18b232ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:16:57 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.625s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:16:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Creating image(s)
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "/opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "/opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "/opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:16:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:16:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.208s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:16:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Creating image(s)
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "/opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "/opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk 1073741824" returned: 0 in 0.053s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.155s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:16:58 user nova-compute[75071]: DEBUG nova.policy [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1da411f6b242492ab5f67a8d21766f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4d6230093b414ea5528dc2f9788a78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Updating instance_info_cache with network_info: [{"id": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "address": "fa:16:3e:53:f5:d1", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcda865e-a8", "ovs_interfaceid": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk 1073741824" returned: 0 in 0.361s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.421s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.557s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Cannot resize image /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Ensure instance console log exists: /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Releasing lock "refresh_cache-81333acc-8dc7-42f1-9026-e42a30e52a5a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Instance network_info: |[{"id": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "address": "fa:16:3e:53:f5:d1", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcda865e-a8", "ovs_interfaceid": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7fb54e1e-e104-4871-8db8-2628f6a1159a req-e30db47b-98c8-4185-9230-1611cd812e74 service nova] Acquired lock "refresh_cache-81333acc-8dc7-42f1-9026-e42a30e52a5a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-7fb54e1e-e104-4871-8db8-2628f6a1159a req-e30db47b-98c8-4185-9230-1611cd812e74 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Refreshing network info cache for port bcda865e-a8e7-4f6a-a633-95c0d037b04e {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Start _get_guest_xml network_info=[{"id": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "address": "fa:16:3e:53:f5:d1", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcda865e-a8", "ovs_interfaceid": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:16:59 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:16:59 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1354621952',display_name='tempest-AttachVolumeNegativeTest-server-1354621952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1354621952',id=1,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuZXR1cGsv6IXUCU3yHn0jwELABItzEJlxPUpxrDBqByQSVywlXx5ET9iaHgOwsb/KQz1xcz5lPQZ6kLJttJC4cScZ9m8RxyQCf+l8X9iK8fvojH4Ti+cbkTntTtiZYyg==',key_name='tempest-keypair-830669204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5c1a038a4eb45508b7f5aa3eb435229',ramdisk_id='',reservation_id='r-005uxusz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1152460930',owner_user_name='tempest-AttachVolumeNegativeTest-1152460930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:16:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d78c212de2e426fad0cba51a2e7bf52',uuid=81333acc-8dc7-42f1-9026-e42a30e52a5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "address": "fa:16:3e:53:f5:d1", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcda865e-a8", "ovs_interfaceid": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converting VIF {"id": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "address": "fa:16:3e:53:f5:d1", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcda865e-a8", "ovs_interfaceid": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:f5:d1,bridge_name='br-int',has_traffic_filtering=True,id=bcda865e-a8e7-4f6a-a633-95c0d037b04e,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcda865e-a8') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lazy-loading 'pci_devices' on Instance uuid 81333acc-8dc7-42f1-9026-e42a30e52a5a {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.222s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:16:59 user nova-compute[75071]:   <uuid>81333acc-8dc7-42f1-9026-e42a30e52a5a</uuid>
Dec 05 12:16:59 user nova-compute[75071]:   <name>instance-00000001</name>
Dec 05 12:16:59 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:16:59 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:16:59 user nova-compute[75071]:   <metadata>
Dec 05 12:16:59 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:16:59 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:16:59 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1354621952</nova:name>
Dec 05 12:16:59 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:16:59</nova:creationTime>
Dec 05 12:16:59 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:16:59 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:16:59 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:16:59 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:16:59 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:16:59 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:16:59 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:16:59 user nova-compute[75071]:       <nova:owner>
Dec 05 12:16:59 user nova-compute[75071]:         <nova:user uuid="7d78c212de2e426fad0cba51a2e7bf52">tempest-AttachVolumeNegativeTest-1152460930-project-member</nova:user>
Dec 05 12:16:59 user nova-compute[75071]:         <nova:project uuid="d5c1a038a4eb45508b7f5aa3eb435229">tempest-AttachVolumeNegativeTest-1152460930</nova:project>
Dec 05 12:16:59 user nova-compute[75071]:       </nova:owner>
Dec 05 12:16:59 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:16:59 user nova-compute[75071]:       <nova:ports>
Dec 05 12:16:59 user nova-compute[75071]:         <nova:port uuid="bcda865e-a8e7-4f6a-a633-95c0d037b04e">
Dec 05 12:16:59 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 12:16:59 user nova-compute[75071]:         </nova:port>
Dec 05 12:16:59 user nova-compute[75071]:       </nova:ports>
Dec 05 12:16:59 user nova-compute[75071]:     </nova:instance>
Dec 05 12:16:59 user nova-compute[75071]:   </metadata>
Dec 05 12:16:59 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:16:59 user nova-compute[75071]:     <system>
Dec 05 12:16:59 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:16:59 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:16:59 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:16:59 user nova-compute[75071]:       <entry name="serial">81333acc-8dc7-42f1-9026-e42a30e52a5a</entry>
Dec 05 12:16:59 user nova-compute[75071]:       <entry name="uuid">81333acc-8dc7-42f1-9026-e42a30e52a5a</entry>
Dec 05 12:16:59 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:16:59 user nova-compute[75071]:     </system>
Dec 05 12:16:59 user nova-compute[75071]:   </sysinfo>
Dec 05 12:16:59 user nova-compute[75071]:   <os>
Dec 05 12:16:59 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:16:59 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:16:59 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:16:59 user nova-compute[75071]:   </os>
Dec 05 12:16:59 user nova-compute[75071]:   <features>
Dec 05 12:16:59 user nova-compute[75071]:     <acpi/>
Dec 05 12:16:59 user nova-compute[75071]:     <apic/>
Dec 05 12:16:59 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:16:59 user nova-compute[75071]:   </features>
Dec 05 12:16:59 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:16:59 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:16:59 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:16:59 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:16:59 user nova-compute[75071]:   </clock>
Dec 05 12:16:59 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:16:59 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:16:59 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:16:59 user nova-compute[75071]:   </cpu>
Dec 05 12:16:59 user nova-compute[75071]:   <devices>
Dec 05 12:16:59 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:16:59 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:16:59 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk"/>
Dec 05 12:16:59 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:16:59 user nova-compute[75071]:     </disk>
Dec 05 12:16:59 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:16:59 user nova-compute[75071]:       <mac address="fa:16:3e:53:f5:d1"/>
Dec 05 12:16:59 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:16:59 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:16:59 user nova-compute[75071]:       <target dev="tapbcda865e-a8"/>
Dec 05 12:16:59 user nova-compute[75071]:     </interface>
Dec 05 12:16:59 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:16:59 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/console.log" append="off"/>
Dec 05 12:16:59 user nova-compute[75071]:     </serial>
Dec 05 12:16:59 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:16:59 user nova-compute[75071]:     <video>
Dec 05 12:16:59 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:16:59 user nova-compute[75071]:     </video>
Dec 05 12:16:59 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:16:59 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:16:59 user nova-compute[75071]:     </rng>
Dec 05 12:16:59 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:16:59 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:16:59 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:16:59 user nova-compute[75071]:     </memballoon>
Dec 05 12:16:59 user nova-compute[75071]:   </devices>
Dec 05 12:16:59 user nova-compute[75071]: </domain>
Dec 05 12:16:59 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1354621952',display_name='tempest-AttachVolumeNegativeTest-server-1354621952',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1354621952',id=1,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuZXR1cGsv6IXUCU3yHn0jwELABItzEJlxPUpxrDBqByQSVywlXx5ET9iaHgOwsb/KQz1xcz5lPQZ6kLJttJC4cScZ9m8RxyQCf+l8X9iK8fvojH4Ti+cbkTntTtiZYyg==',key_name='tempest-keypair-830669204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5c1a038a4eb45508b7f5aa3eb435229',ramdisk_id='',reservation_id='r-005uxusz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1152460930',owner_user_name='tempest-AttachVolumeNegativeTest-1152460930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:16:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d78c212de2e426fad0cba51a2e7bf52',uuid=81333acc-8dc7-42f1-9026-e42a30e52a5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "address": "fa:16:3e:53:f5:d1", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcda865e-a8", "ovs_interfaceid": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converting VIF {"id": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "address": "fa:16:3e:53:f5:d1", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcda865e-a8", "ovs_interfaceid": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:f5:d1,bridge_name='br-int',has_traffic_filtering=True,id=bcda865e-a8e7-4f6a-a633-95c0d037b04e,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcda865e-a8') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG os_vif [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:f5:d1,bridge_name='br-int',has_traffic_filtering=True,id=bcda865e-a8e7-4f6a-a633-95c0d037b04e,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcda865e-a8') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Created schema index Interface.name {{(pid=75071) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Created schema index Port.name {{(pid=75071) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Created schema index Bridge.name {{(pid=75071) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [POLLOUT] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Cannot resize image /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Ensure instance console log exists: /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8cec3013-e05c-5a38-81c5-528c0234d3ae', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:16:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:16:59 user nova-compute[75071]: INFO oslo.privsep.daemon [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpb8jss3za/privsep.sock']
Dec 05 12:16:59 user sudo[84416]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpb8jss3za/privsep.sock
Dec 05 12:16:59 user sudo[84416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 05 12:17:01 user sudo[84416]: pam_unix(sudo:session): session closed for user root
Dec 05 12:17:01 user nova-compute[75071]: INFO oslo.privsep.daemon [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Spawned new privsep daemon via rootwrap
Dec 05 12:17:01 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 05 12:17:01 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 05 12:17:01 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Dec 05 12:17:01 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84424
Dec 05 12:17:01 user nova-compute[75071]: DEBUG nova.network.neutron [req-7fb54e1e-e104-4871-8db8-2628f6a1159a req-e30db47b-98c8-4185-9230-1611cd812e74 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Updated VIF entry in instance network info cache for port bcda865e-a8e7-4f6a-a633-95c0d037b04e. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:17:01 user nova-compute[75071]: DEBUG nova.network.neutron [req-7fb54e1e-e104-4871-8db8-2628f6a1159a req-e30db47b-98c8-4185-9230-1611cd812e74 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Updating instance_info_cache with network_info: [{"id": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "address": "fa:16:3e:53:f5:d1", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcda865e-a8", "ovs_interfaceid": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:17:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7fb54e1e-e104-4871-8db8-2628f6a1159a req-e30db47b-98c8-4185-9230-1611cd812e74 service nova] Releasing lock "refresh_cache-81333acc-8dc7-42f1-9026-e42a30e52a5a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:17:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcda865e-a8, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbcda865e-a8, col_values=(('qos', UUID('2396fe65-c614-4c4c-90ce-59c84bf0445c')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbcda865e-a8, col_values=(('external_ids', {'iface-id': 'bcda865e-a8e7-4f6a-a633-95c0d037b04e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:f5:d1', 'vm-uuid': '81333acc-8dc7-42f1-9026-e42a30e52a5a'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:17:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:01 user nova-compute[75071]: INFO os_vif [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:f5:d1,bridge_name='br-int',has_traffic_filtering=True,id=bcda865e-a8e7-4f6a-a633-95c0d037b04e,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcda865e-a8')
Dec 05 12:17:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:17:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] No VIF found with MAC fa:16:3e:53:f5:d1, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:17:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Successfully created port: 8f59600f-fe54-49ac-b95c-fc44bad6b5d7 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:17:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:02 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Successfully created port: 30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:17:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:04 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Successfully updated port: 8f59600f-fe54-49ac-b95c-fc44bad6b5d7 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:17:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:17:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquired lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:17:04 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:17:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-1a439aff-521f-4c87-b2a0-631daed64f52 req-85838fcd-9411-4600-bcbc-8652e495c6bc service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Received event network-changed-8f59600f-fe54-49ac-b95c-fc44bad6b5d7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-1a439aff-521f-4c87-b2a0-631daed64f52 req-85838fcd-9411-4600-bcbc-8652e495c6bc service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Refreshing instance network info cache due to event network-changed-8f59600f-fe54-49ac-b95c-fc44bad6b5d7. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:17:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1a439aff-521f-4c87-b2a0-631daed64f52 req-85838fcd-9411-4600-bcbc-8652e495c6bc service nova] Acquiring lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:17:04 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:17:05 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Instance spawned successfully.
Dec 05 12:17:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:05 user nova-compute[75071]: INFO nova.compute.manager [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Took 13.18 seconds to spawn the instance on the hypervisor.
Dec 05 12:17:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Successfully updated port: 30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquired lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:17:05 user nova-compute[75071]: INFO nova.compute.manager [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Took 14.27 seconds to build instance.
Dec 05 12:17:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6a93bbd4-62e2-428f-aee6-5fccb77f2737 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.767s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "854ee980-5c0b-4c4f-b9fd-609720e693be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Updating instance_info_cache with network_info: [{"id": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "address": "fa:16:3e:32:a2:62", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f59600f-fe", "ovs_interfaceid": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Releasing lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Instance network_info: |[{"id": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "address": "fa:16:3e:32:a2:62", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f59600f-fe", "ovs_interfaceid": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1a439aff-521f-4c87-b2a0-631daed64f52 req-85838fcd-9411-4600-bcbc-8652e495c6bc service nova] Acquired lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG nova.network.neutron [req-1a439aff-521f-4c87-b2a0-631daed64f52 req-85838fcd-9411-4600-bcbc-8652e495c6bc service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Refreshing network info cache for port 8f59600f-fe54-49ac-b95c-fc44bad6b5d7 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Start _get_guest_xml network_info=[{"id": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "address": "fa:16:3e:32:a2:62", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f59600f-fe", "ovs_interfaceid": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:05 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:17:06 user nova-compute[75071]: INFO nova.compute.claims [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Claim successful on node user
Dec 05 12:17:06 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:17:06 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:16:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-906544306',display_name='tempest-ServerActionsTestOtherA-server-906544306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-906544306',id=2,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr4CxHIGILJKylwCAW1k5g9hHm3DpT3NJj15aFaT5zmT7LmQxPRChXNHnUJDBNGMOIF2KjOMuY9sG7Diwqrmevv8WAXt0F+z6Y+uzBIRaBoBEcSXjeLaXdD3Dv6NXOVGQ==',key_name='tempest-keypair-237629817',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59b6bfae34944fcfbd49d2f18b232ec8',ramdisk_id='',reservation_id='r-wh3v0ipn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1523780015',owner_user_name='tempest-ServerActionsTestOtherA-1523780015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e73e24d5b1489c813f06690b12eef4',uuid=e08be776-0fa9-4871-86eb-2093530c00f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "address": "fa:16:3e:32:a2:62", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f59600f-fe", "ovs_interfaceid": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converting VIF {"id": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "address": "fa:16:3e:32:a2:62", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f59600f-fe", "ovs_interfaceid": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:a2:62,bridge_name='br-int',has_traffic_filtering=True,id=8f59600f-fe54-49ac-b95c-fc44bad6b5d7,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f59600f-fe') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lazy-loading 'pci_devices' on Instance uuid e08be776-0fa9-4871-86eb-2093530c00f3 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:17:06 user nova-compute[75071]:   <uuid>e08be776-0fa9-4871-86eb-2093530c00f3</uuid>
Dec 05 12:17:06 user nova-compute[75071]:   <name>instance-00000002</name>
Dec 05 12:17:06 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:17:06 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:17:06 user nova-compute[75071]:   <metadata>
Dec 05 12:17:06 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:17:06 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:17:06 user nova-compute[75071]:       <nova:name>tempest-ServerActionsTestOtherA-server-906544306</nova:name>
Dec 05 12:17:06 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:17:06</nova:creationTime>
Dec 05 12:17:06 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:17:06 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:17:06 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:17:06 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:17:06 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:17:06 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:17:06 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:17:06 user nova-compute[75071]:       <nova:owner>
Dec 05 12:17:06 user nova-compute[75071]:         <nova:user uuid="d7e73e24d5b1489c813f06690b12eef4">tempest-ServerActionsTestOtherA-1523780015-project-member</nova:user>
Dec 05 12:17:06 user nova-compute[75071]:         <nova:project uuid="59b6bfae34944fcfbd49d2f18b232ec8">tempest-ServerActionsTestOtherA-1523780015</nova:project>
Dec 05 12:17:06 user nova-compute[75071]:       </nova:owner>
Dec 05 12:17:06 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:17:06 user nova-compute[75071]:       <nova:ports>
Dec 05 12:17:06 user nova-compute[75071]:         <nova:port uuid="8f59600f-fe54-49ac-b95c-fc44bad6b5d7">
Dec 05 12:17:06 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 05 12:17:06 user nova-compute[75071]:         </nova:port>
Dec 05 12:17:06 user nova-compute[75071]:       </nova:ports>
Dec 05 12:17:06 user nova-compute[75071]:     </nova:instance>
Dec 05 12:17:06 user nova-compute[75071]:   </metadata>
Dec 05 12:17:06 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:17:06 user nova-compute[75071]:     <system>
Dec 05 12:17:06 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:17:06 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:17:06 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:17:06 user nova-compute[75071]:       <entry name="serial">e08be776-0fa9-4871-86eb-2093530c00f3</entry>
Dec 05 12:17:06 user nova-compute[75071]:       <entry name="uuid">e08be776-0fa9-4871-86eb-2093530c00f3</entry>
Dec 05 12:17:06 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:17:06 user nova-compute[75071]:     </system>
Dec 05 12:17:06 user nova-compute[75071]:   </sysinfo>
Dec 05 12:17:06 user nova-compute[75071]:   <os>
Dec 05 12:17:06 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:17:06 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:17:06 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:17:06 user nova-compute[75071]:   </os>
Dec 05 12:17:06 user nova-compute[75071]:   <features>
Dec 05 12:17:06 user nova-compute[75071]:     <acpi/>
Dec 05 12:17:06 user nova-compute[75071]:     <apic/>
Dec 05 12:17:06 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:17:06 user nova-compute[75071]:   </features>
Dec 05 12:17:06 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:17:06 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:17:06 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:17:06 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:17:06 user nova-compute[75071]:   </clock>
Dec 05 12:17:06 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:17:06 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:17:06 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:17:06 user nova-compute[75071]:   </cpu>
Dec 05 12:17:06 user nova-compute[75071]:   <devices>
Dec 05 12:17:06 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:17:06 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:17:06 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk"/>
Dec 05 12:17:06 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:17:06 user nova-compute[75071]:     </disk>
Dec 05 12:17:06 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:17:06 user nova-compute[75071]:       <mac address="fa:16:3e:32:a2:62"/>
Dec 05 12:17:06 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:17:06 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:17:06 user nova-compute[75071]:       <target dev="tap8f59600f-fe"/>
Dec 05 12:17:06 user nova-compute[75071]:     </interface>
Dec 05 12:17:06 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:17:06 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/console.log" append="off"/>
Dec 05 12:17:06 user nova-compute[75071]:     </serial>
Dec 05 12:17:06 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:17:06 user nova-compute[75071]:     <video>
Dec 05 12:17:06 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:17:06 user nova-compute[75071]:     </video>
Dec 05 12:17:06 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:17:06 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:17:06 user nova-compute[75071]:     </rng>
Dec 05 12:17:06 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:17:06 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:17:06 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:17:06 user nova-compute[75071]:     </memballoon>
Dec 05 12:17:06 user nova-compute[75071]:   </devices>
Dec 05 12:17:06 user nova-compute[75071]: </domain>
Dec 05 12:17:06 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:16:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-906544306',display_name='tempest-ServerActionsTestOtherA-server-906544306',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-906544306',id=2,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr4CxHIGILJKylwCAW1k5g9hHm3DpT3NJj15aFaT5zmT7LmQxPRChXNHnUJDBNGMOIF2KjOMuY9sG7Diwqrmevv8WAXt0F+z6Y+uzBIRaBoBEcSXjeLaXdD3Dv6NXOVGQ==',key_name='tempest-keypair-237629817',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59b6bfae34944fcfbd49d2f18b232ec8',ramdisk_id='',reservation_id='r-wh3v0ipn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1523780015',owner_user_name='tempest-ServerActionsTestOtherA-1523780015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e73e24d5b1489c813f06690b12eef4',uuid=e08be776-0fa9-4871-86eb-2093530c00f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "address": "fa:16:3e:32:a2:62", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f59600f-fe", "ovs_interfaceid": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converting VIF {"id": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "address": "fa:16:3e:32:a2:62", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f59600f-fe", "ovs_interfaceid": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:a2:62,bridge_name='br-int',has_traffic_filtering=True,id=8f59600f-fe54-49ac-b95c-fc44bad6b5d7,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f59600f-fe') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG os_vif [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:a2:62,bridge_name='br-int',has_traffic_filtering=True,id=8f59600f-fe54-49ac-b95c-fc44bad6b5d7,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f59600f-fe') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8810da97-05a1-5fbd-b0e0-5d4263feb37c', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f59600f-fe, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f59600f-fe, col_values=(('qos', UUID('23fa6f90-f2ad-48dc-82f1-2af5d379b9c4')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f59600f-fe, col_values=(('external_ids', {'iface-id': '8f59600f-fe54-49ac-b95c-fc44bad6b5d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:a2:62', 'vm-uuid': 'e08be776-0fa9-4871-86eb-2093530c00f3'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:06 user nova-compute[75071]: INFO os_vif [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:a2:62,bridge_name='br-int',has_traffic_filtering=True,id=8f59600f-fe54-49ac-b95c-fc44bad6b5d7,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f59600f-fe')
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updating instance_info_cache with network_info: [{"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] No VIF found with MAC fa:16:3e:32:a2:62, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Releasing lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Instance network_info: |[{"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Start _get_guest_xml network_info=[{"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:17:06 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:17:06 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:16:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-614681634',display_name='tempest-ServerStableDeviceRescueTest-server-614681634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-614681634',id=3,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBND8W1Zybd+g0C1dD78+dtozfG5vmhl919CuxP9SZzLTJGFsxhQvcxXPbGJgPQvvH3zGP+Wa5JPpC8q2E+mX0mftBd0gOdevPIVnDM93JeHOz80YSlDkAH90qcFoDmdGHg==',key_name='tempest-keypair-1105909075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e4d6230093b414ea5528dc2f9788a78',ramdisk_id='',reservation_id='r-jnssfdf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-639129617',owner_user_name='tempest-ServerStableDeviceRescueTest-639129617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1da411f6b242492ab5f67a8d21766f6d',uuid=e0c82eba-8448-4780-b92d-62d7c60ec7ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Converting VIF {"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:08:02,bridge_name='br-int',has_traffic_filtering=True,id=30895720-729f-445d-b49a-d843f1cb23a8,network=Network(44eba32b-49a9-4087-b09b-fb9ebfe41506),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30895720-72') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lazy-loading 'pci_devices' on Instance uuid e0c82eba-8448-4780-b92d-62d7c60ec7ef {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:17:06 user nova-compute[75071]:   <uuid>e0c82eba-8448-4780-b92d-62d7c60ec7ef</uuid>
Dec 05 12:17:06 user nova-compute[75071]:   <name>instance-00000003</name>
Dec 05 12:17:06 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:17:06 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:17:06 user nova-compute[75071]:   <metadata>
Dec 05 12:17:06 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:17:06 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:17:06 user nova-compute[75071]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-614681634</nova:name>
Dec 05 12:17:06 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:17:06</nova:creationTime>
Dec 05 12:17:06 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:17:06 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:17:06 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:17:06 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:17:06 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:17:06 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:17:06 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:17:06 user nova-compute[75071]:       <nova:owner>
Dec 05 12:17:06 user nova-compute[75071]:         <nova:user uuid="1da411f6b242492ab5f67a8d21766f6d">tempest-ServerStableDeviceRescueTest-639129617-project-member</nova:user>
Dec 05 12:17:06 user nova-compute[75071]:         <nova:project uuid="9e4d6230093b414ea5528dc2f9788a78">tempest-ServerStableDeviceRescueTest-639129617</nova:project>
Dec 05 12:17:06 user nova-compute[75071]:       </nova:owner>
Dec 05 12:17:06 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:17:06 user nova-compute[75071]:       <nova:ports>
Dec 05 12:17:06 user nova-compute[75071]:         <nova:port uuid="30895720-729f-445d-b49a-d843f1cb23a8">
Dec 05 12:17:06 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 05 12:17:06 user nova-compute[75071]:         </nova:port>
Dec 05 12:17:06 user nova-compute[75071]:       </nova:ports>
Dec 05 12:17:06 user nova-compute[75071]:     </nova:instance>
Dec 05 12:17:06 user nova-compute[75071]:   </metadata>
Dec 05 12:17:06 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:17:06 user nova-compute[75071]:     <system>
Dec 05 12:17:06 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:17:06 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:17:06 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:17:06 user nova-compute[75071]:       <entry name="serial">e0c82eba-8448-4780-b92d-62d7c60ec7ef</entry>
Dec 05 12:17:06 user nova-compute[75071]:       <entry name="uuid">e0c82eba-8448-4780-b92d-62d7c60ec7ef</entry>
Dec 05 12:17:06 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:17:06 user nova-compute[75071]:     </system>
Dec 05 12:17:06 user nova-compute[75071]:   </sysinfo>
Dec 05 12:17:06 user nova-compute[75071]:   <os>
Dec 05 12:17:06 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:17:06 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:17:06 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:17:06 user nova-compute[75071]:   </os>
Dec 05 12:17:06 user nova-compute[75071]:   <features>
Dec 05 12:17:06 user nova-compute[75071]:     <acpi/>
Dec 05 12:17:06 user nova-compute[75071]:     <apic/>
Dec 05 12:17:06 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:17:06 user nova-compute[75071]:   </features>
Dec 05 12:17:06 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:17:06 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:17:06 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:17:06 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:17:06 user nova-compute[75071]:   </clock>
Dec 05 12:17:06 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:17:06 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:17:06 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:17:06 user nova-compute[75071]:   </cpu>
Dec 05 12:17:06 user nova-compute[75071]:   <devices>
Dec 05 12:17:06 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:17:06 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:17:06 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk"/>
Dec 05 12:17:06 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:17:06 user nova-compute[75071]:     </disk>
Dec 05 12:17:06 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:17:06 user nova-compute[75071]:       <mac address="fa:16:3e:65:08:02"/>
Dec 05 12:17:06 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:17:06 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:17:06 user nova-compute[75071]:       <target dev="tap30895720-72"/>
Dec 05 12:17:06 user nova-compute[75071]:     </interface>
Dec 05 12:17:06 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:17:06 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/console.log" append="off"/>
Dec 05 12:17:06 user nova-compute[75071]:     </serial>
Dec 05 12:17:06 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:17:06 user nova-compute[75071]:     <video>
Dec 05 12:17:06 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:17:06 user nova-compute[75071]:     </video>
Dec 05 12:17:06 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:17:06 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:17:06 user nova-compute[75071]:     </rng>
Dec 05 12:17:06 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:17:06 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:17:06 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:17:06 user nova-compute[75071]:     </memballoon>
Dec 05 12:17:06 user nova-compute[75071]:   </devices>
Dec 05 12:17:06 user nova-compute[75071]: </domain>
Dec 05 12:17:06 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:16:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-614681634',display_name='tempest-ServerStableDeviceRescueTest-server-614681634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-614681634',id=3,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBND8W1Zybd+g0C1dD78+dtozfG5vmhl919CuxP9SZzLTJGFsxhQvcxXPbGJgPQvvH3zGP+Wa5JPpC8q2E+mX0mftBd0gOdevPIVnDM93JeHOz80YSlDkAH90qcFoDmdGHg==',key_name='tempest-keypair-1105909075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9e4d6230093b414ea5528dc2f9788a78',ramdisk_id='',reservation_id='r-jnssfdf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-639129617',owner_user_name='tempest-ServerStableDeviceRescueTest-639129617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1da411f6b242492ab5f67a8d21766f6d',uuid=e0c82eba-8448-4780-b92d-62d7c60ec7ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Converting VIF {"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:08:02,bridge_name='br-int',has_traffic_filtering=True,id=30895720-729f-445d-b49a-d843f1cb23a8,network=Network(44eba32b-49a9-4087-b09b-fb9ebfe41506),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30895720-72') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG os_vif [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:08:02,bridge_name='br-int',has_traffic_filtering=True,id=30895720-729f-445d-b49a-d843f1cb23a8,network=Network(44eba32b-49a9-4087-b09b-fb9ebfe41506),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30895720-72') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d5da911-4fd3-54d4-9668-45465c712ce5', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30895720-72, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30895720-72, col_values=(('qos', UUID('1b2496b2-b06d-448b-8c27-197a9ac9a5da')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30895720-72, col_values=(('external_ids', {'iface-id': '30895720-729f-445d-b49a-d843f1cb23a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:08:02', 'vm-uuid': 'e0c82eba-8448-4780-b92d-62d7c60ec7ef'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:06 user nova-compute[75071]: INFO os_vif [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:08:02,bridge_name='br-int',has_traffic_filtering=True,id=30895720-729f-445d-b49a-d843f1cb23a8,network=Network(44eba32b-49a9-4087-b09b-fb9ebfe41506),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30895720-72')
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-1a439aff-521f-4c87-b2a0-631daed64f52 req-85838fcd-9411-4600-bcbc-8652e495c6bc service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Updated VIF entry in instance network info cache for port 8f59600f-fe54-49ac-b95c-fc44bad6b5d7. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-1a439aff-521f-4c87-b2a0-631daed64f52 req-85838fcd-9411-4600-bcbc-8652e495c6bc service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Updating instance_info_cache with network_info: [{"id": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "address": "fa:16:3e:32:a2:62", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f59600f-fe", "ovs_interfaceid": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.748s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1a439aff-521f-4c87-b2a0-631daed64f52 req-85838fcd-9411-4600-bcbc-8652e495c6bc service nova] Releasing lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] No VIF found with MAC fa:16:3e:65:08:02, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:17:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:17:06 user nova-compute[75071]: DEBUG nova.policy [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5aa0fe91fac4908b24204673a6c3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bbd8689228459cb4bf4e93caebbf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:17:07 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Creating image(s)
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "/opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "/opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "/opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-38122db7-1de8-4246-bc27-e5f57e0766c8 req-50240cb8-0af9-4d3e-98ad-a3d571a9561c service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received event network-changed-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-38122db7-1de8-4246-bc27-e5f57e0766c8 req-50240cb8-0af9-4d3e-98ad-a3d571a9561c service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Refreshing instance network info cache due to event network-changed-30895720-729f-445d-b49a-d843f1cb23a8. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-38122db7-1de8-4246-bc27-e5f57e0766c8 req-50240cb8-0af9-4d3e-98ad-a3d571a9561c service nova] Acquiring lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-38122db7-1de8-4246-bc27-e5f57e0766c8 req-50240cb8-0af9-4d3e-98ad-a3d571a9561c service nova] Acquired lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-38122db7-1de8-4246-bc27-e5f57e0766c8 req-50240cb8-0af9-4d3e-98ad-a3d571a9561c service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Refreshing network info cache for port 30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Acquiring lock "0d640cf7-170a-4d3e-8983-6165aab46bae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.243s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:17:07 user nova-compute[75071]: INFO nova.compute.claims [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Claim successful on node user
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.210s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk 1073741824" returned: 0 in 0.057s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.295s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Checking if we can resize image /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.649s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:17:08 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Dec 05 12:17:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Cannot resize image /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Ensure instance console log exists: /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-38122db7-1de8-4246-bc27-e5f57e0766c8 req-50240cb8-0af9-4d3e-98ad-a3d571a9561c service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updated VIF entry in instance network info cache for port 30895720-729f-445d-b49a-d843f1cb23a8. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-38122db7-1de8-4246-bc27-e5f57e0766c8 req-50240cb8-0af9-4d3e-98ad-a3d571a9561c service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updating instance_info_cache with network_info: [{"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG nova.policy [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb4947c03acf45d5955d036352af6291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d309487087b4b089a63e314fd8813e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-38122db7-1de8-4246-bc27-e5f57e0766c8 req-50240cb8-0af9-4d3e-98ad-a3d571a9561c service nova] Releasing lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:17:08 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Creating image(s)
Dec 05 12:17:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "/opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "/opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Acquiring lock "dacafeaeb8cb00764d7099b6b93c26d7e94e5655" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "dacafeaeb8cb00764d7099b6b93c26d7e94e5655" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dacafeaeb8cb00764d7099b6b93c26d7e94e5655.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Successfully created port: cbc3d793-a281-45c9-a3fa-4d1fb88a3d45 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dacafeaeb8cb00764d7099b6b93c26d7e94e5655.part --force-share --output=json" returned: 0 in 0.417s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG nova.virt.images [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] 7b9ca46b-c5ba-47ec-9522-be2ee6a0e0af was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dacafeaeb8cb00764d7099b6b93c26d7e94e5655.part /opt/stack/data/nova/instances/_base/dacafeaeb8cb00764d7099b6b93c26d7e94e5655.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/dacafeaeb8cb00764d7099b6b93c26d7e94e5655.part /opt/stack/data/nova/instances/_base/dacafeaeb8cb00764d7099b6b93c26d7e94e5655.converted" returned: 0 in 0.364s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dacafeaeb8cb00764d7099b6b93c26d7e94e5655.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Acquiring lock "2625dd24-5c50-4911-9515-57c9483bafa1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "2625dd24-5c50-4911-9515-57c9483bafa1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dacafeaeb8cb00764d7099b6b93c26d7e94e5655.converted --force-share --output=json" returned: 0 in 0.222s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "dacafeaeb8cb00764d7099b6b93c26d7e94e5655" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.611s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dacafeaeb8cb00764d7099b6b93c26d7e94e5655 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:17:10 user nova-compute[75071]: INFO nova.compute.claims [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Claim successful on node user
Dec 05 12:17:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dacafeaeb8cb00764d7099b6b93c26d7e94e5655 --force-share --output=json" returned: 0 in 0.270s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Acquiring lock "dacafeaeb8cb00764d7099b6b93c26d7e94e5655" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "dacafeaeb8cb00764d7099b6b93c26d7e94e5655" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dacafeaeb8cb00764d7099b6b93c26d7e94e5655 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dacafeaeb8cb00764d7099b6b93c26d7e94e5655 --force-share --output=json" returned: 0 in 0.265s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dacafeaeb8cb00764d7099b6b93c26d7e94e5655,backing_fmt=raw /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/dacafeaeb8cb00764d7099b6b93c26d7e94e5655,backing_fmt=raw /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk 1073741824" returned: 0 in 0.088s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "dacafeaeb8cb00764d7099b6b93c26d7e94e5655" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.361s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dacafeaeb8cb00764d7099b6b93c26d7e94e5655 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Successfully created port: e56ba39e-d25b-410b-ad40-c5c31f2f7ba4 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Successfully updated port: cbc3d793-a281-45c9-a3fa-4d1fb88a3d45 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "refresh_cache-854ee980-5c0b-4c4f-b9fd-609720e693be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquired lock "refresh_cache-854ee980-5c0b-4c4f-b9fd-609720e693be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-865e6068-5687-423d-a0fb-5b445c6e4768 req-232b0bb8-995b-43a6-a609-70017eeb8cbd service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Received event network-changed-cbc3d793-a281-45c9-a3fa-4d1fb88a3d45 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-865e6068-5687-423d-a0fb-5b445c6e4768 req-232b0bb8-995b-43a6-a609-70017eeb8cbd service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Refreshing instance network info cache due to event network-changed-cbc3d793-a281-45c9-a3fa-4d1fb88a3d45. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-865e6068-5687-423d-a0fb-5b445c6e4768 req-232b0bb8-995b-43a6-a609-70017eeb8cbd service nova] Acquiring lock "refresh_cache-854ee980-5c0b-4c4f-b9fd-609720e693be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/dacafeaeb8cb00764d7099b6b93c26d7e94e5655 --force-share --output=json" returned: 0 in 0.220s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:17:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Cannot resize image /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Ensure instance console log exists: /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.099s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.network.neutron [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:17:11 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.policy [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7532107e512b448e919f08713d60f84f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '522698b61d514357b9ea490cbfa828ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Updating instance_info_cache with network_info: [{"id": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "address": "fa:16:3e:85:5c:09", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc3d793-a2", "ovs_interfaceid": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Releasing lock "refresh_cache-854ee980-5c0b-4c4f-b9fd-609720e693be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Instance network_info: |[{"id": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "address": "fa:16:3e:85:5c:09", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc3d793-a2", "ovs_interfaceid": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-865e6068-5687-423d-a0fb-5b445c6e4768 req-232b0bb8-995b-43a6-a609-70017eeb8cbd service nova] Acquired lock "refresh_cache-854ee980-5c0b-4c4f-b9fd-609720e693be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-865e6068-5687-423d-a0fb-5b445c6e4768 req-232b0bb8-995b-43a6-a609-70017eeb8cbd service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Refreshing network info cache for port cbc3d793-a281-45c9-a3fa-4d1fb88a3d45 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Start _get_guest_xml network_info=[{"id": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "address": "fa:16:3e:85:5c:09", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc3d793-a2", "ovs_interfaceid": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:17:11 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:17:11 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:17:11 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Creating image(s)
Dec 05 12:17:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Acquiring lock "/opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "/opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "/opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1355481569',display_name='tempest-VolumesAdminNegativeTest-server-1355481569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1355481569',id=4,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHFTB8HtgrqlNwPyex8IYW2vacfK6EMhzbU2JJdY4CzU23aR6X4QA+ipUCcyuWI8/YpvhZXi5b0UFWPhZSw2v/wLJTbmVzYBW+oXwyQRbJnDKovYkkmvcXwa+oWeY/I+w==',key_name='tempest-keypair-623525767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80bbd8689228459cb4bf4e93caebbf39',ramdisk_id='',reservation_id='r-tzbzipak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1655468341',owner_user_name='tempest-VolumesAdminNegativeTest-1655468341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5aa0fe91fac4908b24204673a6c3af1',uuid=854ee980-5c0b-4c4f-b9fd-609720e693be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "address": "fa:16:3e:85:5c:09", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc3d793-a2", "ovs_interfaceid": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Converting VIF {"id": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "address": "fa:16:3e:85:5c:09", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc3d793-a2", "ovs_interfaceid": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:5c:09,bridge_name='br-int',has_traffic_filtering=True,id=cbc3d793-a281-45c9-a3fa-4d1fb88a3d45,network=Network(30520b35-382e-42c5-8395-8dddfacb2b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc3d793-a2') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lazy-loading 'pci_devices' on Instance uuid 854ee980-5c0b-4c4f-b9fd-609720e693be {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:17:11 user nova-compute[75071]:   <uuid>854ee980-5c0b-4c4f-b9fd-609720e693be</uuid>
Dec 05 12:17:11 user nova-compute[75071]:   <name>instance-00000004</name>
Dec 05 12:17:11 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:17:11 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:17:11 user nova-compute[75071]:   <metadata>
Dec 05 12:17:11 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:17:11 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:17:11 user nova-compute[75071]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1355481569</nova:name>
Dec 05 12:17:11 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:17:11</nova:creationTime>
Dec 05 12:17:11 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:17:11 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:17:11 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:17:11 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:17:11 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:17:11 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:17:11 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:17:11 user nova-compute[75071]:       <nova:owner>
Dec 05 12:17:11 user nova-compute[75071]:         <nova:user uuid="d5aa0fe91fac4908b24204673a6c3af1">tempest-VolumesAdminNegativeTest-1655468341-project-member</nova:user>
Dec 05 12:17:11 user nova-compute[75071]:         <nova:project uuid="80bbd8689228459cb4bf4e93caebbf39">tempest-VolumesAdminNegativeTest-1655468341</nova:project>
Dec 05 12:17:11 user nova-compute[75071]:       </nova:owner>
Dec 05 12:17:11 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:17:11 user nova-compute[75071]:       <nova:ports>
Dec 05 12:17:11 user nova-compute[75071]:         <nova:port uuid="cbc3d793-a281-45c9-a3fa-4d1fb88a3d45">
Dec 05 12:17:11 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 12:17:11 user nova-compute[75071]:         </nova:port>
Dec 05 12:17:11 user nova-compute[75071]:       </nova:ports>
Dec 05 12:17:11 user nova-compute[75071]:     </nova:instance>
Dec 05 12:17:11 user nova-compute[75071]:   </metadata>
Dec 05 12:17:11 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:17:11 user nova-compute[75071]:     <system>
Dec 05 12:17:11 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:17:11 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:17:11 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:17:11 user nova-compute[75071]:       <entry name="serial">854ee980-5c0b-4c4f-b9fd-609720e693be</entry>
Dec 05 12:17:11 user nova-compute[75071]:       <entry name="uuid">854ee980-5c0b-4c4f-b9fd-609720e693be</entry>
Dec 05 12:17:11 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:17:11 user nova-compute[75071]:     </system>
Dec 05 12:17:11 user nova-compute[75071]:   </sysinfo>
Dec 05 12:17:11 user nova-compute[75071]:   <os>
Dec 05 12:17:11 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:17:11 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:17:11 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:17:11 user nova-compute[75071]:   </os>
Dec 05 12:17:11 user nova-compute[75071]:   <features>
Dec 05 12:17:11 user nova-compute[75071]:     <acpi/>
Dec 05 12:17:11 user nova-compute[75071]:     <apic/>
Dec 05 12:17:11 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:17:11 user nova-compute[75071]:   </features>
Dec 05 12:17:11 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:17:11 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:17:11 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:17:11 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:17:11 user nova-compute[75071]:   </clock>
Dec 05 12:17:11 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:17:11 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:17:11 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:17:11 user nova-compute[75071]:   </cpu>
Dec 05 12:17:11 user nova-compute[75071]:   <devices>
Dec 05 12:17:11 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:17:11 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:17:11 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk"/>
Dec 05 12:17:11 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:17:11 user nova-compute[75071]:     </disk>
Dec 05 12:17:11 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:17:11 user nova-compute[75071]:       <mac address="fa:16:3e:85:5c:09"/>
Dec 05 12:17:11 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:17:11 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:17:11 user nova-compute[75071]:       <target dev="tapcbc3d793-a2"/>
Dec 05 12:17:11 user nova-compute[75071]:     </interface>
Dec 05 12:17:11 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:17:11 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/console.log" append="off"/>
Dec 05 12:17:11 user nova-compute[75071]:     </serial>
Dec 05 12:17:11 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:17:11 user nova-compute[75071]:     <video>
Dec 05 12:17:11 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:17:11 user nova-compute[75071]:     </video>
Dec 05 12:17:11 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:17:11 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:17:11 user nova-compute[75071]:     </rng>
Dec 05 12:17:11 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:17:11 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:17:11 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:17:11 user nova-compute[75071]:     </memballoon>
Dec 05 12:17:11 user nova-compute[75071]:   </devices>
Dec 05 12:17:11 user nova-compute[75071]: </domain>
Dec 05 12:17:11 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1355481569',display_name='tempest-VolumesAdminNegativeTest-server-1355481569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1355481569',id=4,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHFTB8HtgrqlNwPyex8IYW2vacfK6EMhzbU2JJdY4CzU23aR6X4QA+ipUCcyuWI8/YpvhZXi5b0UFWPhZSw2v/wLJTbmVzYBW+oXwyQRbJnDKovYkkmvcXwa+oWeY/I+w==',key_name='tempest-keypair-623525767',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80bbd8689228459cb4bf4e93caebbf39',ramdisk_id='',reservation_id='r-tzbzipak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1655468341',owner_user_name='tempest-VolumesAdminNegativeTest-1655468341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5aa0fe91fac4908b24204673a6c3af1',uuid=854ee980-5c0b-4c4f-b9fd-609720e693be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "address": "fa:16:3e:85:5c:09", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc3d793-a2", "ovs_interfaceid": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Converting VIF {"id": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "address": "fa:16:3e:85:5c:09", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc3d793-a2", "ovs_interfaceid": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:5c:09,bridge_name='br-int',has_traffic_filtering=True,id=cbc3d793-a281-45c9-a3fa-4d1fb88a3d45,network=Network(30520b35-382e-42c5-8395-8dddfacb2b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc3d793-a2') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG os_vif [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:5c:09,bridge_name='br-int',has_traffic_filtering=True,id=cbc3d793-a281-45c9-a3fa-4d1fb88a3d45,network=Network(30520b35-382e-42c5-8395-8dddfacb2b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc3d793-a2') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf74be59-2991-50bd-8190-194fe4f8567e', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbc3d793-a2, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcbc3d793-a2, col_values=(('qos', UUID('29f5b4e1-534c-4daa-8e9a-3fb5b5d8b2db')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcbc3d793-a2, col_values=(('external_ids', {'iface-id': 'cbc3d793-a281-45c9-a3fa-4d1fb88a3d45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:5c:09', 'vm-uuid': '854ee980-5c0b-4c4f-b9fd-609720e693be'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.255s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:12 user nova-compute[75071]: INFO os_vif [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:5c:09,bridge_name='br-int',has_traffic_filtering=True,id=cbc3d793-a281-45c9-a3fa-4d1fb88a3d45,network=Network(30520b35-382e-42c5-8395-8dddfacb2b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc3d793-a2')
Dec 05 12:17:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.245s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk 1073741824" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.438s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Successfully updated port: e56ba39e-d25b-410b-ad40-c5c31f2f7ba4 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] No VIF found with MAC fa:16:3e:85:5c:09, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Acquiring lock "refresh_cache-0d640cf7-170a-4d3e-8983-6165aab46bae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Acquired lock "refresh_cache-0d640cf7-170a-4d3e-8983-6165aab46bae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.233s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Cannot resize image /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Ensure instance console log exists: /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:12 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Instance spawned successfully.
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-bb54f6a1-750a-414d-9eb3-fcccd9248c0a req-2ffe8fe3-b388-44a9-bef4-536af72328ab service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Received event network-changed-e56ba39e-d25b-410b-ad40-c5c31f2f7ba4 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-bb54f6a1-750a-414d-9eb3-fcccd9248c0a req-2ffe8fe3-b388-44a9-bef4-536af72328ab service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Refreshing instance network info cache due to event network-changed-e56ba39e-d25b-410b-ad40-c5c31f2f7ba4. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bb54f6a1-750a-414d-9eb3-fcccd9248c0a req-2ffe8fe3-b388-44a9-bef4-536af72328ab service nova] Acquiring lock "refresh_cache-0d640cf7-170a-4d3e-8983-6165aab46bae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:17:12 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Instance spawned successfully.
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:13 user nova-compute[75071]: INFO nova.compute.manager [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Took 14.70 seconds to spawn the instance on the hypervisor.
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.network.neutron [req-865e6068-5687-423d-a0fb-5b445c6e4768 req-232b0bb8-995b-43a6-a609-70017eeb8cbd service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Updated VIF entry in instance network info cache for port cbc3d793-a281-45c9-a3fa-4d1fb88a3d45. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.network.neutron [req-865e6068-5687-423d-a0fb-5b445c6e4768 req-232b0bb8-995b-43a6-a609-70017eeb8cbd service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Updating instance_info_cache with network_info: [{"id": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "address": "fa:16:3e:85:5c:09", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc3d793-a2", "ovs_interfaceid": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:17:13 user nova-compute[75071]: INFO nova.compute.manager [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Took 15.13 seconds to spawn the instance on the hypervisor.
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-865e6068-5687-423d-a0fb-5b445c6e4768 req-232b0bb8-995b-43a6-a609-70017eeb8cbd service nova] Releasing lock "refresh_cache-854ee980-5c0b-4c4f-b9fd-609720e693be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:17:13 user nova-compute[75071]: INFO nova.compute.manager [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Took 16.11 seconds to build instance.
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Updating instance_info_cache with network_info: [{"id": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "address": "fa:16:3e:5a:b3:91", "network": {"id": "0aeb2212-537b-4b5a-bf1c-7db98afb29dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-443578788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d309487087b4b089a63e314fd8813e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape56ba39e-d2", "ovs_interfaceid": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0dce987-010b-40e3-98c9-746a44eb9330 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.287s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Releasing lock "refresh_cache-0d640cf7-170a-4d3e-8983-6165aab46bae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Instance network_info: |[{"id": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "address": "fa:16:3e:5a:b3:91", "network": {"id": "0aeb2212-537b-4b5a-bf1c-7db98afb29dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-443578788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d309487087b4b089a63e314fd8813e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape56ba39e-d2", "ovs_interfaceid": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bb54f6a1-750a-414d-9eb3-fcccd9248c0a req-2ffe8fe3-b388-44a9-bef4-536af72328ab service nova] Acquired lock "refresh_cache-0d640cf7-170a-4d3e-8983-6165aab46bae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.network.neutron [req-bb54f6a1-750a-414d-9eb3-fcccd9248c0a req-2ffe8fe3-b388-44a9-bef4-536af72328ab service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Refreshing network info cache for port e56ba39e-d25b-410b-ad40-c5c31f2f7ba4 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Start _get_guest_xml network_info=[{"id": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "address": "fa:16:3e:5a:b3:91", "network": {"id": "0aeb2212-537b-4b5a-bf1c-7db98afb29dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-443578788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d309487087b4b089a63e314fd8813e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape56ba39e-d2", "ovs_interfaceid": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:17:00Z,direct_url=<?>,disk_format='qcow2',id=7b9ca46b-c5ba-47ec-9522-be2ee6a0e0af,min_disk=0,min_ram=0,name='',owner='5ea5b71f8e4d4d85ab0a0fdf64de20b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:17:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': '7b9ca46b-c5ba-47ec-9522-be2ee6a0e0af'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:17:13 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:17:13 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:17:13 user nova-compute[75071]: INFO nova.compute.manager [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Took 16.58 seconds to build instance.
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6972885d-d1bf-413a-b4c6-2354e960fa4b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "e08be776-0fa9-4871-86eb-2093530c00f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.726s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:17:00Z,direct_url=<?>,disk_format='qcow2',id=7b9ca46b-c5ba-47ec-9522-be2ee6a0e0af,min_disk=0,min_ram=0,name='',owner='5ea5b71f8e4d4d85ab0a0fdf64de20b1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:17:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1945549184',display_name='tempest-AttachSCSIVolumeTestJSON-server-1945549184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1945549184',id=5,image_ref='7b9ca46b-c5ba-47ec-9522-be2ee6a0e0af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSjZ4yFFozaSdmyCAbBcxH9me3XDU2okjU4UeFS80MM3gBSgUdSitVqby6sxDesU9iL7tK1MNpzciqe1UF28leGl3zx2AuCozMNt9Ox9xi1ellSkt7E/qINhXZmRuqMwg==',key_name='tempest-keypair-291642649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d309487087b4b089a63e314fd8813e6',ramdisk_id='',reservation_id='r-6n686a1q',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b9ca46b-c5ba-47ec-9522-be2ee6a0e0af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1502106878',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1502106878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4947c03acf45d5955d036352af6291',uuid=0d640cf7-170a-4d3e-8983-6165aab46bae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "address": "fa:16:3e:5a:b3:91", "network": {"id": "0aeb2212-537b-4b5a-bf1c-7db98afb29dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-443578788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d309487087b4b089a63e314fd8813e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape56ba39e-d2", "ovs_interfaceid": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Converting VIF {"id": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "address": "fa:16:3e:5a:b3:91", "network": {"id": "0aeb2212-537b-4b5a-bf1c-7db98afb29dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-443578788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d309487087b4b089a63e314fd8813e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape56ba39e-d2", "ovs_interfaceid": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:b3:91,bridge_name='br-int',has_traffic_filtering=True,id=e56ba39e-d25b-410b-ad40-c5c31f2f7ba4,network=Network(0aeb2212-537b-4b5a-bf1c-7db98afb29dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape56ba39e-d2') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.objects.instance [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d640cf7-170a-4d3e-8983-6165aab46bae {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:17:13 user nova-compute[75071]:   <uuid>0d640cf7-170a-4d3e-8983-6165aab46bae</uuid>
Dec 05 12:17:13 user nova-compute[75071]:   <name>instance-00000005</name>
Dec 05 12:17:13 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:17:13 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:17:13 user nova-compute[75071]:   <metadata>
Dec 05 12:17:13 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:17:13 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:17:13 user nova-compute[75071]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1945549184</nova:name>
Dec 05 12:17:13 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:17:13</nova:creationTime>
Dec 05 12:17:13 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:17:13 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:17:13 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:17:13 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:17:13 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:17:13 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:17:13 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:17:13 user nova-compute[75071]:       <nova:owner>
Dec 05 12:17:13 user nova-compute[75071]:         <nova:user uuid="fb4947c03acf45d5955d036352af6291">tempest-AttachSCSIVolumeTestJSON-1502106878-project-member</nova:user>
Dec 05 12:17:13 user nova-compute[75071]:         <nova:project uuid="4d309487087b4b089a63e314fd8813e6">tempest-AttachSCSIVolumeTestJSON-1502106878</nova:project>
Dec 05 12:17:13 user nova-compute[75071]:       </nova:owner>
Dec 05 12:17:13 user nova-compute[75071]:       <nova:root type="image" uuid="7b9ca46b-c5ba-47ec-9522-be2ee6a0e0af"/>
Dec 05 12:17:13 user nova-compute[75071]:       <nova:ports>
Dec 05 12:17:13 user nova-compute[75071]:         <nova:port uuid="e56ba39e-d25b-410b-ad40-c5c31f2f7ba4">
Dec 05 12:17:13 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 05 12:17:13 user nova-compute[75071]:         </nova:port>
Dec 05 12:17:13 user nova-compute[75071]:       </nova:ports>
Dec 05 12:17:13 user nova-compute[75071]:     </nova:instance>
Dec 05 12:17:13 user nova-compute[75071]:   </metadata>
Dec 05 12:17:13 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:17:13 user nova-compute[75071]:     <system>
Dec 05 12:17:13 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:17:13 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:17:13 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:17:13 user nova-compute[75071]:       <entry name="serial">0d640cf7-170a-4d3e-8983-6165aab46bae</entry>
Dec 05 12:17:13 user nova-compute[75071]:       <entry name="uuid">0d640cf7-170a-4d3e-8983-6165aab46bae</entry>
Dec 05 12:17:13 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:17:13 user nova-compute[75071]:     </system>
Dec 05 12:17:13 user nova-compute[75071]:   </sysinfo>
Dec 05 12:17:13 user nova-compute[75071]:   <os>
Dec 05 12:17:13 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:17:13 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:17:13 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:17:13 user nova-compute[75071]:   </os>
Dec 05 12:17:13 user nova-compute[75071]:   <features>
Dec 05 12:17:13 user nova-compute[75071]:     <acpi/>
Dec 05 12:17:13 user nova-compute[75071]:     <apic/>
Dec 05 12:17:13 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:17:13 user nova-compute[75071]:   </features>
Dec 05 12:17:13 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:17:13 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:17:13 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:17:13 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:17:13 user nova-compute[75071]:   </clock>
Dec 05 12:17:13 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:17:13 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:17:13 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:17:13 user nova-compute[75071]:   </cpu>
Dec 05 12:17:13 user nova-compute[75071]:   <devices>
Dec 05 12:17:13 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:17:13 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:17:13 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk"/>
Dec 05 12:17:13 user nova-compute[75071]:       <target dev="sda" bus="scsi"/>
Dec 05 12:17:13 user nova-compute[75071]:       <address type="drive" controller="0" unit="0"/>
Dec 05 12:17:13 user nova-compute[75071]:     </disk>
Dec 05 12:17:13 user nova-compute[75071]:     <disk type="file" device="cdrom">
Dec 05 12:17:13 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none"/>
Dec 05 12:17:13 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk.config"/>
Dec 05 12:17:13 user nova-compute[75071]:       <target dev="sdb" bus="scsi"/>
Dec 05 12:17:13 user nova-compute[75071]:       <address type="drive" controller="0" unit="1"/>
Dec 05 12:17:13 user nova-compute[75071]:     </disk>
Dec 05 12:17:13 user nova-compute[75071]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Dec 05 12:17:13 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:17:13 user nova-compute[75071]:       <mac address="fa:16:3e:5a:b3:91"/>
Dec 05 12:17:13 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:17:13 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:17:13 user nova-compute[75071]:       <target dev="tape56ba39e-d2"/>
Dec 05 12:17:13 user nova-compute[75071]:     </interface>
Dec 05 12:17:13 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:17:13 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/console.log" append="off"/>
Dec 05 12:17:13 user nova-compute[75071]:     </serial>
Dec 05 12:17:13 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:17:13 user nova-compute[75071]:     <video>
Dec 05 12:17:13 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:17:13 user nova-compute[75071]:     </video>
Dec 05 12:17:13 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:17:13 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:17:13 user nova-compute[75071]:     </rng>
Dec 05 12:17:13 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:17:13 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:17:13 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:17:13 user nova-compute[75071]:     </memballoon>
Dec 05 12:17:13 user nova-compute[75071]:   </devices>
Dec 05 12:17:13 user nova-compute[75071]: </domain>
Dec 05 12:17:13 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1945549184',display_name='tempest-AttachSCSIVolumeTestJSON-server-1945549184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1945549184',id=5,image_ref='7b9ca46b-c5ba-47ec-9522-be2ee6a0e0af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSjZ4yFFozaSdmyCAbBcxH9me3XDU2okjU4UeFS80MM3gBSgUdSitVqby6sxDesU9iL7tK1MNpzciqe1UF28leGl3zx2AuCozMNt9Ox9xi1ellSkt7E/qINhXZmRuqMwg==',key_name='tempest-keypair-291642649',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d309487087b4b089a63e314fd8813e6',ramdisk_id='',reservation_id='r-6n686a1q',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b9ca46b-c5ba-47ec-9522-be2ee6a0e0af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1502106878',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1502106878-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4947c03acf45d5955d036352af6291',uuid=0d640cf7-170a-4d3e-8983-6165aab46bae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "address": "fa:16:3e:5a:b3:91", "network": {"id": "0aeb2212-537b-4b5a-bf1c-7db98afb29dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-443578788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d309487087b4b089a63e314fd8813e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape56ba39e-d2", "ovs_interfaceid": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Converting VIF {"id": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "address": "fa:16:3e:5a:b3:91", "network": {"id": "0aeb2212-537b-4b5a-bf1c-7db98afb29dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-443578788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d309487087b4b089a63e314fd8813e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape56ba39e-d2", "ovs_interfaceid": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:b3:91,bridge_name='br-int',has_traffic_filtering=True,id=e56ba39e-d25b-410b-ad40-c5c31f2f7ba4,network=Network(0aeb2212-537b-4b5a-bf1c-7db98afb29dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape56ba39e-d2') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG os_vif [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:b3:91,bridge_name='br-int',has_traffic_filtering=True,id=e56ba39e-d25b-410b-ad40-c5c31f2f7ba4,network=Network(0aeb2212-537b-4b5a-bf1c-7db98afb29dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape56ba39e-d2') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae291951-81ca-5f71-8e2e-d874879f6e5c', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape56ba39e-d2, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape56ba39e-d2, col_values=(('qos', UUID('fbfe2f1c-6d7a-4c6c-9acd-95b051f3d6b2')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape56ba39e-d2, col_values=(('external_ids', {'iface-id': 'e56ba39e-d25b-410b-ad40-c5c31f2f7ba4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:b3:91', 'vm-uuid': '0d640cf7-170a-4d3e-8983-6165aab46bae'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:13 user nova-compute[75071]: INFO os_vif [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:b3:91,bridge_name='br-int',has_traffic_filtering=True,id=e56ba39e-d25b-410b-ad40-c5c31f2f7ba4,network=Network(0aeb2212-537b-4b5a-bf1c-7db98afb29dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape56ba39e-d2')
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] No BDM found with device name sda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] No VIF found with MAC fa:16:3e:5a:b3:91, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:17:13 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Using config drive
Dec 05 12:17:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:14 user nova-compute[75071]: DEBUG nova.network.neutron [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Successfully created port: eb24fe21-798a-4e87-97e8-5e355a77257f {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:17:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:15 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Creating config drive at /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk.config
Dec 05 12:17:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9vux93nn {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:15 user nova-compute[75071]: DEBUG nova.network.neutron [req-bb54f6a1-750a-414d-9eb3-fcccd9248c0a req-2ffe8fe3-b388-44a9-bef4-536af72328ab service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Updated VIF entry in instance network info cache for port e56ba39e-d25b-410b-ad40-c5c31f2f7ba4. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:17:15 user nova-compute[75071]: DEBUG nova.network.neutron [req-bb54f6a1-750a-414d-9eb3-fcccd9248c0a req-2ffe8fe3-b388-44a9-bef4-536af72328ab service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Updating instance_info_cache with network_info: [{"id": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "address": "fa:16:3e:5a:b3:91", "network": {"id": "0aeb2212-537b-4b5a-bf1c-7db98afb29dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-443578788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d309487087b4b089a63e314fd8813e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape56ba39e-d2", "ovs_interfaceid": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:17:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9vux93nn" returned: 0 in 0.069s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bb54f6a1-750a-414d-9eb3-fcccd9248c0a req-2ffe8fe3-b388-44a9-bef4-536af72328ab service nova] Releasing lock "refresh_cache-0d640cf7-170a-4d3e-8983-6165aab46bae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:17:16 user nova-compute[75071]: DEBUG nova.network.neutron [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Successfully updated port: eb24fe21-798a-4e87-97e8-5e355a77257f {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:17:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Acquiring lock "refresh_cache-2625dd24-5c50-4911-9515-57c9483bafa1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:17:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Acquired lock "refresh_cache-2625dd24-5c50-4911-9515-57c9483bafa1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:17:16 user nova-compute[75071]: DEBUG nova.network.neutron [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:17:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-e2f5f08b-8386-48f2-9bbd-45a09530b66d req-1cc6a0d5-5eef-41ba-8179-599b655f8b1a service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Received event network-changed-eb24fe21-798a-4e87-97e8-5e355a77257f {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-e2f5f08b-8386-48f2-9bbd-45a09530b66d req-1cc6a0d5-5eef-41ba-8179-599b655f8b1a service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Refreshing instance network info cache due to event network-changed-eb24fe21-798a-4e87-97e8-5e355a77257f. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:17:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e2f5f08b-8386-48f2-9bbd-45a09530b66d req-1cc6a0d5-5eef-41ba-8179-599b655f8b1a service nova] Acquiring lock "refresh_cache-2625dd24-5c50-4911-9515-57c9483bafa1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:17:16 user nova-compute[75071]: DEBUG nova.network.neutron [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Updating instance_info_cache with network_info: [{"id": "eb24fe21-798a-4e87-97e8-5e355a77257f", "address": "fa:16:3e:fd:56:66", "network": {"id": "466db5e3-5c09-4319-9cee-3b0c44e1c718", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1639720127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "522698b61d514357b9ea490cbfa828ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb24fe21-79", "ovs_interfaceid": "eb24fe21-798a-4e87-97e8-5e355a77257f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Releasing lock "refresh_cache-2625dd24-5c50-4911-9515-57c9483bafa1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Instance network_info: |[{"id": "eb24fe21-798a-4e87-97e8-5e355a77257f", "address": "fa:16:3e:fd:56:66", "network": {"id": "466db5e3-5c09-4319-9cee-3b0c44e1c718", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1639720127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "522698b61d514357b9ea490cbfa828ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb24fe21-79", "ovs_interfaceid": "eb24fe21-798a-4e87-97e8-5e355a77257f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e2f5f08b-8386-48f2-9bbd-45a09530b66d req-1cc6a0d5-5eef-41ba-8179-599b655f8b1a service nova] Acquired lock "refresh_cache-2625dd24-5c50-4911-9515-57c9483bafa1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.network.neutron [req-e2f5f08b-8386-48f2-9bbd-45a09530b66d req-1cc6a0d5-5eef-41ba-8179-599b655f8b1a service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Refreshing network info cache for port eb24fe21-798a-4e87-97e8-5e355a77257f {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Start _get_guest_xml network_info=[{"id": "eb24fe21-798a-4e87-97e8-5e355a77257f", "address": "fa:16:3e:fd:56:66", "network": {"id": "466db5e3-5c09-4319-9cee-3b0c44e1c718", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1639720127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "522698b61d514357b9ea490cbfa828ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb24fe21-79", "ovs_interfaceid": "eb24fe21-798a-4e87-97e8-5e355a77257f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:17:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:17:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1988255748',display_name='tempest-TestVolumeSwap-server-1988255748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1988255748',id=6,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtOA9OUhUuqttZPGvfQDytd9iTTbijprV8hnKNlNGmLZ30Exux+N8/w/h/zwzC0tq40rF0VQxCTGLUGEUfISJHD0owINVPsy9mUGuaoIDiavYhpFQF8xVgbrGAC1EuhdQ==',key_name='tempest-keypair-391523231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='522698b61d514357b9ea490cbfa828ad',ramdisk_id='',reservation_id='r-vgdjic1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-583774926',owner_user_name='tempest-TestVolumeSwap-583774926-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7532107e512b448e919f08713d60f84f',uuid=2625dd24-5c50-4911-9515-57c9483bafa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb24fe21-798a-4e87-97e8-5e355a77257f", "address": "fa:16:3e:fd:56:66", "network": {"id": "466db5e3-5c09-4319-9cee-3b0c44e1c718", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1639720127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "522698b61d514357b9ea490cbfa828ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb24fe21-79", "ovs_interfaceid": "eb24fe21-798a-4e87-97e8-5e355a77257f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Converting VIF {"id": "eb24fe21-798a-4e87-97e8-5e355a77257f", "address": "fa:16:3e:fd:56:66", "network": {"id": "466db5e3-5c09-4319-9cee-3b0c44e1c718", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1639720127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "522698b61d514357b9ea490cbfa828ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb24fe21-79", "ovs_interfaceid": "eb24fe21-798a-4e87-97e8-5e355a77257f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:56:66,bridge_name='br-int',has_traffic_filtering=True,id=eb24fe21-798a-4e87-97e8-5e355a77257f,network=Network(466db5e3-5c09-4319-9cee-3b0c44e1c718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb24fe21-79') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.objects.instance [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lazy-loading 'pci_devices' on Instance uuid 2625dd24-5c50-4911-9515-57c9483bafa1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:17:17 user nova-compute[75071]:   <uuid>2625dd24-5c50-4911-9515-57c9483bafa1</uuid>
Dec 05 12:17:17 user nova-compute[75071]:   <name>instance-00000006</name>
Dec 05 12:17:17 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:17:17 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:17:17 user nova-compute[75071]:   <metadata>
Dec 05 12:17:17 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:17:17 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:17:17 user nova-compute[75071]:       <nova:name>tempest-TestVolumeSwap-server-1988255748</nova:name>
Dec 05 12:17:17 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:17:17</nova:creationTime>
Dec 05 12:17:17 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:17:17 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:17:17 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:17:17 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:17:17 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:17:17 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:17:17 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:17:17 user nova-compute[75071]:       <nova:owner>
Dec 05 12:17:17 user nova-compute[75071]:         <nova:user uuid="7532107e512b448e919f08713d60f84f">tempest-TestVolumeSwap-583774926-project-member</nova:user>
Dec 05 12:17:17 user nova-compute[75071]:         <nova:project uuid="522698b61d514357b9ea490cbfa828ad">tempest-TestVolumeSwap-583774926</nova:project>
Dec 05 12:17:17 user nova-compute[75071]:       </nova:owner>
Dec 05 12:17:17 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:17:17 user nova-compute[75071]:       <nova:ports>
Dec 05 12:17:17 user nova-compute[75071]:         <nova:port uuid="eb24fe21-798a-4e87-97e8-5e355a77257f">
Dec 05 12:17:17 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 05 12:17:17 user nova-compute[75071]:         </nova:port>
Dec 05 12:17:17 user nova-compute[75071]:       </nova:ports>
Dec 05 12:17:17 user nova-compute[75071]:     </nova:instance>
Dec 05 12:17:17 user nova-compute[75071]:   </metadata>
Dec 05 12:17:17 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:17:17 user nova-compute[75071]:     <system>
Dec 05 12:17:17 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:17:17 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:17:17 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:17:17 user nova-compute[75071]:       <entry name="serial">2625dd24-5c50-4911-9515-57c9483bafa1</entry>
Dec 05 12:17:17 user nova-compute[75071]:       <entry name="uuid">2625dd24-5c50-4911-9515-57c9483bafa1</entry>
Dec 05 12:17:17 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:17:17 user nova-compute[75071]:     </system>
Dec 05 12:17:17 user nova-compute[75071]:   </sysinfo>
Dec 05 12:17:17 user nova-compute[75071]:   <os>
Dec 05 12:17:17 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:17:17 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:17:17 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:17:17 user nova-compute[75071]:   </os>
Dec 05 12:17:17 user nova-compute[75071]:   <features>
Dec 05 12:17:17 user nova-compute[75071]:     <acpi/>
Dec 05 12:17:17 user nova-compute[75071]:     <apic/>
Dec 05 12:17:17 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:17:17 user nova-compute[75071]:   </features>
Dec 05 12:17:17 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:17:17 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:17:17 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:17:17 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:17:17 user nova-compute[75071]:   </clock>
Dec 05 12:17:17 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:17:17 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:17:17 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:17:17 user nova-compute[75071]:   </cpu>
Dec 05 12:17:17 user nova-compute[75071]:   <devices>
Dec 05 12:17:17 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:17:17 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:17:17 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk"/>
Dec 05 12:17:17 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:17:17 user nova-compute[75071]:     </disk>
Dec 05 12:17:17 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:17:17 user nova-compute[75071]:       <mac address="fa:16:3e:fd:56:66"/>
Dec 05 12:17:17 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:17:17 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:17:17 user nova-compute[75071]:       <target dev="tapeb24fe21-79"/>
Dec 05 12:17:17 user nova-compute[75071]:     </interface>
Dec 05 12:17:17 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:17:17 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/console.log" append="off"/>
Dec 05 12:17:17 user nova-compute[75071]:     </serial>
Dec 05 12:17:17 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:17:17 user nova-compute[75071]:     <video>
Dec 05 12:17:17 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:17:17 user nova-compute[75071]:     </video>
Dec 05 12:17:17 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:17:17 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:17:17 user nova-compute[75071]:     </rng>
Dec 05 12:17:17 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:17:17 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:17:17 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:17:17 user nova-compute[75071]:     </memballoon>
Dec 05 12:17:17 user nova-compute[75071]:   </devices>
Dec 05 12:17:17 user nova-compute[75071]: </domain>
Dec 05 12:17:17 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1988255748',display_name='tempest-TestVolumeSwap-server-1988255748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1988255748',id=6,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtOA9OUhUuqttZPGvfQDytd9iTTbijprV8hnKNlNGmLZ30Exux+N8/w/h/zwzC0tq40rF0VQxCTGLUGEUfISJHD0owINVPsy9mUGuaoIDiavYhpFQF8xVgbrGAC1EuhdQ==',key_name='tempest-keypair-391523231',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='522698b61d514357b9ea490cbfa828ad',ramdisk_id='',reservation_id='r-vgdjic1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-583774926',owner_user_name='tempest-TestVolumeSwap-583774926-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7532107e512b448e919f08713d60f84f',uuid=2625dd24-5c50-4911-9515-57c9483bafa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb24fe21-798a-4e87-97e8-5e355a77257f", "address": "fa:16:3e:fd:56:66", "network": {"id": "466db5e3-5c09-4319-9cee-3b0c44e1c718", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1639720127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "522698b61d514357b9ea490cbfa828ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb24fe21-79", "ovs_interfaceid": "eb24fe21-798a-4e87-97e8-5e355a77257f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Converting VIF {"id": "eb24fe21-798a-4e87-97e8-5e355a77257f", "address": "fa:16:3e:fd:56:66", "network": {"id": "466db5e3-5c09-4319-9cee-3b0c44e1c718", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1639720127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "522698b61d514357b9ea490cbfa828ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb24fe21-79", "ovs_interfaceid": "eb24fe21-798a-4e87-97e8-5e355a77257f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:56:66,bridge_name='br-int',has_traffic_filtering=True,id=eb24fe21-798a-4e87-97e8-5e355a77257f,network=Network(466db5e3-5c09-4319-9cee-3b0c44e1c718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb24fe21-79') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG os_vif [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:56:66,bridge_name='br-int',has_traffic_filtering=True,id=eb24fe21-798a-4e87-97e8-5e355a77257f,network=Network(466db5e3-5c09-4319-9cee-3b0c44e1c718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb24fe21-79') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc10295b-fd89-56c7-9d8a-1eb6fd42b2d7', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb24fe21-79, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeb24fe21-79, col_values=(('qos', UUID('5f2b1b2c-8dad-4602-81f4-54100815abf5')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeb24fe21-79, col_values=(('external_ids', {'iface-id': 'eb24fe21-798a-4e87-97e8-5e355a77257f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:56:66', 'vm-uuid': '2625dd24-5c50-4911-9515-57c9483bafa1'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:17 user nova-compute[75071]: INFO os_vif [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:56:66,bridge_name='br-int',has_traffic_filtering=True,id=eb24fe21-798a-4e87-97e8-5e355a77257f,network=Network(466db5e3-5c09-4319-9cee-3b0c44e1c718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb24fe21-79')
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:17:17 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Instance spawned successfully.
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] No VIF found with MAC fa:16:3e:fd:56:66, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:17:17 user nova-compute[75071]: INFO nova.compute.manager [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Took 10.52 seconds to spawn the instance on the hypervisor.
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:17:17 user nova-compute[75071]: INFO nova.compute.manager [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Took 11.80 seconds to build instance.
Dec 05 12:17:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b80237d9-62c6-41a8-a016-9dc7748cd0fa tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.953s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.network.neutron [req-e2f5f08b-8386-48f2-9bbd-45a09530b66d req-1cc6a0d5-5eef-41ba-8179-599b655f8b1a service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Updated VIF entry in instance network info cache for port eb24fe21-798a-4e87-97e8-5e355a77257f. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG nova.network.neutron [req-e2f5f08b-8386-48f2-9bbd-45a09530b66d req-1cc6a0d5-5eef-41ba-8179-599b655f8b1a service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Updating instance_info_cache with network_info: [{"id": "eb24fe21-798a-4e87-97e8-5e355a77257f", "address": "fa:16:3e:fd:56:66", "network": {"id": "466db5e3-5c09-4319-9cee-3b0c44e1c718", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1639720127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "522698b61d514357b9ea490cbfa828ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb24fe21-79", "ovs_interfaceid": "eb24fe21-798a-4e87-97e8-5e355a77257f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:17:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e2f5f08b-8386-48f2-9bbd-45a09530b66d req-1cc6a0d5-5eef-41ba-8179-599b655f8b1a service nova] Releasing lock "refresh_cache-2625dd24-5c50-4911-9515-57c9483bafa1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:17:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:17:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:17:21 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Instance spawned successfully.
Dec 05 12:17:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:17:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:21 user nova-compute[75071]: INFO nova.compute.manager [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Took 13.18 seconds to spawn the instance on the hypervisor.
Dec 05 12:17:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:17:21 user nova-compute[75071]: INFO nova.compute.manager [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Took 14.48 seconds to build instance.
Dec 05 12:17:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ce709ba9-0cd4-4a11-bc03-01cdeb746775 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.618s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-fe5867e5-8cb2-454a-95aa-df2933f19de0 req-395cd6ef-8a06-44d7-8d7d-02147a95a06d service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Received event network-vif-plugged-cbc3d793-a281-45c9-a3fa-4d1fb88a3d45 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fe5867e5-8cb2-454a-95aa-df2933f19de0 req-395cd6ef-8a06-44d7-8d7d-02147a95a06d service nova] Acquiring lock "854ee980-5c0b-4c4f-b9fd-609720e693be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fe5867e5-8cb2-454a-95aa-df2933f19de0 req-395cd6ef-8a06-44d7-8d7d-02147a95a06d service nova] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fe5867e5-8cb2-454a-95aa-df2933f19de0 req-395cd6ef-8a06-44d7-8d7d-02147a95a06d service nova] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-fe5867e5-8cb2-454a-95aa-df2933f19de0 req-395cd6ef-8a06-44d7-8d7d-02147a95a06d service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] No waiting events found dispatching network-vif-plugged-cbc3d793-a281-45c9-a3fa-4d1fb88a3d45 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:17:22 user nova-compute[75071]: WARNING nova.compute.manager [req-fe5867e5-8cb2-454a-95aa-df2933f19de0 req-395cd6ef-8a06-44d7-8d7d-02147a95a06d service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Received unexpected event network-vif-plugged-cbc3d793-a281-45c9-a3fa-4d1fb88a3d45 for instance with vm_state active and task_state None.
Dec 05 12:17:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:17:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:17:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Instance spawned successfully.
Dec 05 12:17:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:17:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-8cb6906a-601d-4e71-a36c-a2fd142a5078 req-69051689-0518-43f7-9347-e5ff6e97a9d6 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Received event network-vif-plugged-bcda865e-a8e7-4f6a-a633-95c0d037b04e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8cb6906a-601d-4e71-a36c-a2fd142a5078 req-69051689-0518-43f7-9347-e5ff6e97a9d6 service nova] Acquiring lock "81333acc-8dc7-42f1-9026-e42a30e52a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8cb6906a-601d-4e71-a36c-a2fd142a5078 req-69051689-0518-43f7-9347-e5ff6e97a9d6 service nova] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8cb6906a-601d-4e71-a36c-a2fd142a5078 req-69051689-0518-43f7-9347-e5ff6e97a9d6 service nova] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-8cb6906a-601d-4e71-a36c-a2fd142a5078 req-69051689-0518-43f7-9347-e5ff6e97a9d6 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] No waiting events found dispatching network-vif-plugged-bcda865e-a8e7-4f6a-a633-95c0d037b04e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:17:22 user nova-compute[75071]: WARNING nova.compute.manager [req-8cb6906a-601d-4e71-a36c-a2fd142a5078 req-69051689-0518-43f7-9347-e5ff6e97a9d6 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Received unexpected event network-vif-plugged-bcda865e-a8e7-4f6a-a633-95c0d037b04e for instance with vm_state active and task_state None.
Dec 05 12:17:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:22 user nova-compute[75071]: INFO nova.compute.manager [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Took 11.19 seconds to spawn the instance on the hypervisor.
Dec 05 12:17:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:17:23 user nova-compute[75071]: INFO nova.compute.manager [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Took 13.16 seconds to build instance.
Dec 05 12:17:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32b3ab0f-72e4-4bbc-93b0-c88d1a23e456 tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "2625dd24-5c50-4911-9515-57c9483bafa1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.324s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Acquiring lock "332f0212-d8e4-4a99-9688-01a26ba66916" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Lock "332f0212-d8e4-4a99-9688-01a26ba66916" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:17:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:17:23 user nova-compute[75071]: INFO nova.compute.claims [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Claim successful on node user
Dec 05 12:17:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-1906a7f2-612e-409e-bf2b-ae40713119bc req-b26b93bc-953d-4325-8265-89c65319cf74 service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Received event network-vif-plugged-cbc3d793-a281-45c9-a3fa-4d1fb88a3d45 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1906a7f2-612e-409e-bf2b-ae40713119bc req-b26b93bc-953d-4325-8265-89c65319cf74 service nova] Acquiring lock "854ee980-5c0b-4c4f-b9fd-609720e693be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1906a7f2-612e-409e-bf2b-ae40713119bc req-b26b93bc-953d-4325-8265-89c65319cf74 service nova] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1906a7f2-612e-409e-bf2b-ae40713119bc req-b26b93bc-953d-4325-8265-89c65319cf74 service nova] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-1906a7f2-612e-409e-bf2b-ae40713119bc req-b26b93bc-953d-4325-8265-89c65319cf74 service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] No waiting events found dispatching network-vif-plugged-cbc3d793-a281-45c9-a3fa-4d1fb88a3d45 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:17:24 user nova-compute[75071]: WARNING nova.compute.manager [req-1906a7f2-612e-409e-bf2b-ae40713119bc req-b26b93bc-953d-4325-8265-89c65319cf74 service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Received unexpected event network-vif-plugged-cbc3d793-a281-45c9-a3fa-4d1fb88a3d45 for instance with vm_state active and task_state None.
Dec 05 12:17:24 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.883s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG nova.compute.manager [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-3e5bad0e-c830-4c32-ba63-73957f533caa req-8ef8f33a-ff57-48f6-be25-20839b0f0497 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Received event network-vif-plugged-bcda865e-a8e7-4f6a-a633-95c0d037b04e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e5bad0e-c830-4c32-ba63-73957f533caa req-8ef8f33a-ff57-48f6-be25-20839b0f0497 service nova] Acquiring lock "81333acc-8dc7-42f1-9026-e42a30e52a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e5bad0e-c830-4c32-ba63-73957f533caa req-8ef8f33a-ff57-48f6-be25-20839b0f0497 service nova] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e5bad0e-c830-4c32-ba63-73957f533caa req-8ef8f33a-ff57-48f6-be25-20839b0f0497 service nova] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-3e5bad0e-c830-4c32-ba63-73957f533caa req-8ef8f33a-ff57-48f6-be25-20839b0f0497 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] No waiting events found dispatching network-vif-plugged-bcda865e-a8e7-4f6a-a633-95c0d037b04e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:17:24 user nova-compute[75071]: WARNING nova.compute.manager [req-3e5bad0e-c830-4c32-ba63-73957f533caa req-8ef8f33a-ff57-48f6-be25-20839b0f0497 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Received unexpected event network-vif-plugged-bcda865e-a8e7-4f6a-a633-95c0d037b04e for instance with vm_state active and task_state None.
Dec 05 12:17:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-3e5bad0e-c830-4c32-ba63-73957f533caa req-8ef8f33a-ff57-48f6-be25-20839b0f0497 service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received event network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e5bad0e-c830-4c32-ba63-73957f533caa req-8ef8f33a-ff57-48f6-be25-20839b0f0497 service nova] Acquiring lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e5bad0e-c830-4c32-ba63-73957f533caa req-8ef8f33a-ff57-48f6-be25-20839b0f0497 service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e5bad0e-c830-4c32-ba63-73957f533caa req-8ef8f33a-ff57-48f6-be25-20839b0f0497 service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-3e5bad0e-c830-4c32-ba63-73957f533caa req-8ef8f33a-ff57-48f6-be25-20839b0f0497 service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] No waiting events found dispatching network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:17:24 user nova-compute[75071]: WARNING nova.compute.manager [req-3e5bad0e-c830-4c32-ba63-73957f533caa req-8ef8f33a-ff57-48f6-be25-20839b0f0497 service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received unexpected event network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 for instance with vm_state active and task_state None.
Dec 05 12:17:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-3e5bad0e-c830-4c32-ba63-73957f533caa req-8ef8f33a-ff57-48f6-be25-20839b0f0497 service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received event network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e5bad0e-c830-4c32-ba63-73957f533caa req-8ef8f33a-ff57-48f6-be25-20839b0f0497 service nova] Acquiring lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e5bad0e-c830-4c32-ba63-73957f533caa req-8ef8f33a-ff57-48f6-be25-20839b0f0497 service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e5bad0e-c830-4c32-ba63-73957f533caa req-8ef8f33a-ff57-48f6-be25-20839b0f0497 service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-3e5bad0e-c830-4c32-ba63-73957f533caa req-8ef8f33a-ff57-48f6-be25-20839b0f0497 service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] No waiting events found dispatching network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:17:24 user nova-compute[75071]: WARNING nova.compute.manager [req-3e5bad0e-c830-4c32-ba63-73957f533caa req-8ef8f33a-ff57-48f6-be25-20839b0f0497 service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received unexpected event network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 for instance with vm_state active and task_state None.
Dec 05 12:17:24 user nova-compute[75071]: DEBUG nova.compute.manager [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG nova.network.neutron [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:17:24 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:17:24 user nova-compute[75071]: DEBUG nova.compute.manager [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:17:24 user nova-compute[75071]: DEBUG nova.policy [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8556acf84cee485bb42c245386a537b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee1f941e7214607a1997d44cb9c93a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:17:25 user nova-compute[75071]: DEBUG nova.compute.manager [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:17:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:17:25 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Creating image(s)
Dec 05 12:17:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Acquiring lock "/opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Lock "/opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Lock "/opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.248s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.259s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk 1073741824" returned: 0 in 0.088s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.210s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:25 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Checking if we can resize image /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:17:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:25 user nova-compute[75071]: DEBUG nova.network.neutron [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Successfully created port: cbe4b036-1cc2-4514-8a71-4709d97cc4a7 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:17:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:26 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Cannot resize image /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:17:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:17:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Ensure instance console log exists: /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:17:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:27 user nova-compute[75071]: DEBUG nova.network.neutron [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Successfully updated port: cbe4b036-1cc2-4514-8a71-4709d97cc4a7 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:17:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Acquiring lock "refresh_cache-332f0212-d8e4-4a99-9688-01a26ba66916" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:17:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Acquired lock "refresh_cache-332f0212-d8e4-4a99-9688-01a26ba66916" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:17:27 user nova-compute[75071]: DEBUG nova.network.neutron [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:17:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-1b735763-45a3-43a3-9c79-461af409617b req-05873c34-4dd5-472a-a734-012cdbc4e0bc service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Received event network-changed-cbe4b036-1cc2-4514-8a71-4709d97cc4a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-1b735763-45a3-43a3-9c79-461af409617b req-05873c34-4dd5-472a-a734-012cdbc4e0bc service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Refreshing instance network info cache due to event network-changed-cbe4b036-1cc2-4514-8a71-4709d97cc4a7. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:17:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1b735763-45a3-43a3-9c79-461af409617b req-05873c34-4dd5-472a-a734-012cdbc4e0bc service nova] Acquiring lock "refresh_cache-332f0212-d8e4-4a99-9688-01a26ba66916" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:17:27 user nova-compute[75071]: DEBUG nova.network.neutron [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:17:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:27 user nova-compute[75071]: DEBUG nova.network.neutron [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Updating instance_info_cache with network_info: [{"id": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "address": "fa:16:3e:79:0d:f2", "network": {"id": "4c4be769-0b96-4b02-b391-b523b458e179", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460819884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ee1f941e7214607a1997d44cb9c93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe4b036-1c", "ovs_interfaceid": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:17:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Releasing lock "refresh_cache-332f0212-d8e4-4a99-9688-01a26ba66916" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:17:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Instance network_info: |[{"id": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "address": "fa:16:3e:79:0d:f2", "network": {"id": "4c4be769-0b96-4b02-b391-b523b458e179", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460819884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ee1f941e7214607a1997d44cb9c93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe4b036-1c", "ovs_interfaceid": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:17:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1b735763-45a3-43a3-9c79-461af409617b req-05873c34-4dd5-472a-a734-012cdbc4e0bc service nova] Acquired lock "refresh_cache-332f0212-d8e4-4a99-9688-01a26ba66916" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:17:27 user nova-compute[75071]: DEBUG nova.network.neutron [req-1b735763-45a3-43a3-9c79-461af409617b req-05873c34-4dd5-472a-a734-012cdbc4e0bc service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Refreshing network info cache for port cbe4b036-1cc2-4514-8a71-4709d97cc4a7 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:17:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Start _get_guest_xml network_info=[{"id": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "address": "fa:16:3e:79:0d:f2", "network": {"id": "4c4be769-0b96-4b02-b391-b523b458e179", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460819884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ee1f941e7214607a1997d44cb9c93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe4b036-1c", "ovs_interfaceid": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:17:28 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:17:28 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1498007029',display_name='tempest-VolumesAssistedSnapshotsTest-server-1498007029',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1498007029',id=7,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwlD5wrJovxrnP8dU7IUDUiIcKfG77RPpyyBr9eDcKxS1znSdjuMbMrvFTb+M8ja+mkiq2yFa46kigBIfFAFbrlbFT4MrAfJwZjKCKfY/skdFJFB13wkw9QVW+iQ6AXEQ==',key_name='tempest-keypair-897134019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ee1f941e7214607a1997d44cb9c93a6',ramdisk_id='',reservation_id='r-cj16wh9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2059213640',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2059213640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8556acf84cee485bb42c245386a537b4',uuid=332f0212-d8e4-4a99-9688-01a26ba66916,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "address": "fa:16:3e:79:0d:f2", "network": {"id": "4c4be769-0b96-4b02-b391-b523b458e179", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460819884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ee1f941e7214607a1997d44cb9c93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe4b036-1c", "ovs_interfaceid": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Converting VIF {"id": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "address": "fa:16:3e:79:0d:f2", "network": {"id": "4c4be769-0b96-4b02-b391-b523b458e179", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460819884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ee1f941e7214607a1997d44cb9c93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe4b036-1c", "ovs_interfaceid": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:0d:f2,bridge_name='br-int',has_traffic_filtering=True,id=cbe4b036-1cc2-4514-8a71-4709d97cc4a7,network=Network(4c4be769-0b96-4b02-b391-b523b458e179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe4b036-1c') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.objects.instance [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Lazy-loading 'pci_devices' on Instance uuid 332f0212-d8e4-4a99-9688-01a26ba66916 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:17:28 user nova-compute[75071]:   <uuid>332f0212-d8e4-4a99-9688-01a26ba66916</uuid>
Dec 05 12:17:28 user nova-compute[75071]:   <name>instance-00000007</name>
Dec 05 12:17:28 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:17:28 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:17:28 user nova-compute[75071]:   <metadata>
Dec 05 12:17:28 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:17:28 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:17:28 user nova-compute[75071]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1498007029</nova:name>
Dec 05 12:17:28 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:17:28</nova:creationTime>
Dec 05 12:17:28 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:17:28 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:17:28 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:17:28 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:17:28 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:17:28 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:17:28 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:17:28 user nova-compute[75071]:       <nova:owner>
Dec 05 12:17:28 user nova-compute[75071]:         <nova:user uuid="8556acf84cee485bb42c245386a537b4">tempest-VolumesAssistedSnapshotsTest-2059213640-project-member</nova:user>
Dec 05 12:17:28 user nova-compute[75071]:         <nova:project uuid="8ee1f941e7214607a1997d44cb9c93a6">tempest-VolumesAssistedSnapshotsTest-2059213640</nova:project>
Dec 05 12:17:28 user nova-compute[75071]:       </nova:owner>
Dec 05 12:17:28 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:17:28 user nova-compute[75071]:       <nova:ports>
Dec 05 12:17:28 user nova-compute[75071]:         <nova:port uuid="cbe4b036-1cc2-4514-8a71-4709d97cc4a7">
Dec 05 12:17:28 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 12:17:28 user nova-compute[75071]:         </nova:port>
Dec 05 12:17:28 user nova-compute[75071]:       </nova:ports>
Dec 05 12:17:28 user nova-compute[75071]:     </nova:instance>
Dec 05 12:17:28 user nova-compute[75071]:   </metadata>
Dec 05 12:17:28 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:17:28 user nova-compute[75071]:     <system>
Dec 05 12:17:28 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:17:28 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:17:28 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:17:28 user nova-compute[75071]:       <entry name="serial">332f0212-d8e4-4a99-9688-01a26ba66916</entry>
Dec 05 12:17:28 user nova-compute[75071]:       <entry name="uuid">332f0212-d8e4-4a99-9688-01a26ba66916</entry>
Dec 05 12:17:28 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:17:28 user nova-compute[75071]:     </system>
Dec 05 12:17:28 user nova-compute[75071]:   </sysinfo>
Dec 05 12:17:28 user nova-compute[75071]:   <os>
Dec 05 12:17:28 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:17:28 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:17:28 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:17:28 user nova-compute[75071]:   </os>
Dec 05 12:17:28 user nova-compute[75071]:   <features>
Dec 05 12:17:28 user nova-compute[75071]:     <acpi/>
Dec 05 12:17:28 user nova-compute[75071]:     <apic/>
Dec 05 12:17:28 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:17:28 user nova-compute[75071]:   </features>
Dec 05 12:17:28 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:17:28 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:17:28 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:17:28 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:17:28 user nova-compute[75071]:   </clock>
Dec 05 12:17:28 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:17:28 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:17:28 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:17:28 user nova-compute[75071]:   </cpu>
Dec 05 12:17:28 user nova-compute[75071]:   <devices>
Dec 05 12:17:28 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:17:28 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:17:28 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk"/>
Dec 05 12:17:28 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:17:28 user nova-compute[75071]:     </disk>
Dec 05 12:17:28 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:17:28 user nova-compute[75071]:       <mac address="fa:16:3e:79:0d:f2"/>
Dec 05 12:17:28 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:17:28 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:17:28 user nova-compute[75071]:       <target dev="tapcbe4b036-1c"/>
Dec 05 12:17:28 user nova-compute[75071]:     </interface>
Dec 05 12:17:28 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:17:28 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/console.log" append="off"/>
Dec 05 12:17:28 user nova-compute[75071]:     </serial>
Dec 05 12:17:28 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:17:28 user nova-compute[75071]:     <video>
Dec 05 12:17:28 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:17:28 user nova-compute[75071]:     </video>
Dec 05 12:17:28 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:17:28 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:17:28 user nova-compute[75071]:     </rng>
Dec 05 12:17:28 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:17:28 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:17:28 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:17:28 user nova-compute[75071]:     </memballoon>
Dec 05 12:17:28 user nova-compute[75071]:   </devices>
Dec 05 12:17:28 user nova-compute[75071]: </domain>
Dec 05 12:17:28 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1498007029',display_name='tempest-VolumesAssistedSnapshotsTest-server-1498007029',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1498007029',id=7,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwlD5wrJovxrnP8dU7IUDUiIcKfG77RPpyyBr9eDcKxS1znSdjuMbMrvFTb+M8ja+mkiq2yFa46kigBIfFAFbrlbFT4MrAfJwZjKCKfY/skdFJFB13wkw9QVW+iQ6AXEQ==',key_name='tempest-keypair-897134019',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ee1f941e7214607a1997d44cb9c93a6',ramdisk_id='',reservation_id='r-cj16wh9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2059213640',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2059213640-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8556acf84cee485bb42c245386a537b4',uuid=332f0212-d8e4-4a99-9688-01a26ba66916,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "address": "fa:16:3e:79:0d:f2", "network": {"id": "4c4be769-0b96-4b02-b391-b523b458e179", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460819884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ee1f941e7214607a1997d44cb9c93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe4b036-1c", "ovs_interfaceid": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Converting VIF {"id": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "address": "fa:16:3e:79:0d:f2", "network": {"id": "4c4be769-0b96-4b02-b391-b523b458e179", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460819884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ee1f941e7214607a1997d44cb9c93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe4b036-1c", "ovs_interfaceid": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:0d:f2,bridge_name='br-int',has_traffic_filtering=True,id=cbe4b036-1cc2-4514-8a71-4709d97cc4a7,network=Network(4c4be769-0b96-4b02-b391-b523b458e179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe4b036-1c') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG os_vif [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:0d:f2,bridge_name='br-int',has_traffic_filtering=True,id=cbe4b036-1cc2-4514-8a71-4709d97cc4a7,network=Network(4c4be769-0b96-4b02-b391-b523b458e179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe4b036-1c') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '743fd2f8-5309-57c4-bf72-6b31aaf3849b', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbe4b036-1c, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcbe4b036-1c, col_values=(('qos', UUID('ef7d16d4-ad89-48be-a678-44fec8377635')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcbe4b036-1c, col_values=(('external_ids', {'iface-id': 'cbe4b036-1cc2-4514-8a71-4709d97cc4a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:0d:f2', 'vm-uuid': '332f0212-d8e4-4a99-9688-01a26ba66916'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:28 user nova-compute[75071]: INFO os_vif [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:0d:f2,bridge_name='br-int',has_traffic_filtering=True,id=cbe4b036-1cc2-4514-8a71-4709d97cc4a7,network=Network(4c4be769-0b96-4b02-b391-b523b458e179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe4b036-1c')
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] No VIF found with MAC fa:16:3e:79:0d:f2, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.network.neutron [req-1b735763-45a3-43a3-9c79-461af409617b req-05873c34-4dd5-472a-a734-012cdbc4e0bc service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Updated VIF entry in instance network info cache for port cbe4b036-1cc2-4514-8a71-4709d97cc4a7. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG nova.network.neutron [req-1b735763-45a3-43a3-9c79-461af409617b req-05873c34-4dd5-472a-a734-012cdbc4e0bc service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Updating instance_info_cache with network_info: [{"id": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "address": "fa:16:3e:79:0d:f2", "network": {"id": "4c4be769-0b96-4b02-b391-b523b458e179", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460819884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ee1f941e7214607a1997d44cb9c93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe4b036-1c", "ovs_interfaceid": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:17:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1b735763-45a3-43a3-9c79-461af409617b req-05873c34-4dd5-472a-a734-012cdbc4e0bc service nova] Releasing lock "refresh_cache-332f0212-d8e4-4a99-9688-01a26ba66916" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:17:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:17:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:17:33 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Instance spawned successfully.
Dec 05 12:17:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:17:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:33 user nova-compute[75071]: INFO nova.compute.manager [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Took 8.38 seconds to spawn the instance on the hypervisor.
Dec 05 12:17:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:17:33 user nova-compute[75071]: INFO nova.compute.manager [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Took 9.96 seconds to build instance.
Dec 05 12:17:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-734604b4-5e1e-4a65-94f2-252ae746c903 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Lock "332f0212-d8e4-4a99-9688-01a26ba66916" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.137s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:33 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:17:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 12:17:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 12:17:33 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:17:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 12:17:33 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:17:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-6d4458e5-8ace-452d-946b-06ba7f60e9cf req-f1b6cae2-d34b-4980-845c-89dd3ba38646 service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Received event network-vif-plugged-8f59600f-fe54-49ac-b95c-fc44bad6b5d7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6d4458e5-8ace-452d-946b-06ba7f60e9cf req-f1b6cae2-d34b-4980-845c-89dd3ba38646 service nova] Acquiring lock "e08be776-0fa9-4871-86eb-2093530c00f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6d4458e5-8ace-452d-946b-06ba7f60e9cf req-f1b6cae2-d34b-4980-845c-89dd3ba38646 service nova] Lock "e08be776-0fa9-4871-86eb-2093530c00f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6d4458e5-8ace-452d-946b-06ba7f60e9cf req-f1b6cae2-d34b-4980-845c-89dd3ba38646 service nova] Lock "e08be776-0fa9-4871-86eb-2093530c00f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-6d4458e5-8ace-452d-946b-06ba7f60e9cf req-f1b6cae2-d34b-4980-845c-89dd3ba38646 service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] No waiting events found dispatching network-vif-plugged-8f59600f-fe54-49ac-b95c-fc44bad6b5d7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:17:34 user nova-compute[75071]: WARNING nova.compute.manager [req-6d4458e5-8ace-452d-946b-06ba7f60e9cf req-f1b6cae2-d34b-4980-845c-89dd3ba38646 service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Received unexpected event network-vif-plugged-8f59600f-fe54-49ac-b95c-fc44bad6b5d7 for instance with vm_state active and task_state None.
Dec 05 12:17:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:17:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:17:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:17:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Acquiring lock "c9e37746-57e8-4053-9f52-2c60bab457fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:17:36 user nova-compute[75071]: INFO nova.compute.claims [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Claim successful on node user
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Received event network-vif-plugged-8f59600f-fe54-49ac-b95c-fc44bad6b5d7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Acquiring lock "e08be776-0fa9-4871-86eb-2093530c00f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Lock "e08be776-0fa9-4871-86eb-2093530c00f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Lock "e08be776-0fa9-4871-86eb-2093530c00f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] No waiting events found dispatching network-vif-plugged-8f59600f-fe54-49ac-b95c-fc44bad6b5d7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:17:36 user nova-compute[75071]: WARNING nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Received unexpected event network-vif-plugged-8f59600f-fe54-49ac-b95c-fc44bad6b5d7 for instance with vm_state active and task_state None.
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Received event network-vif-plugged-e56ba39e-d25b-410b-ad40-c5c31f2f7ba4 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Acquiring lock "0d640cf7-170a-4d3e-8983-6165aab46bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] No waiting events found dispatching network-vif-plugged-e56ba39e-d25b-410b-ad40-c5c31f2f7ba4 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:17:36 user nova-compute[75071]: WARNING nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Received unexpected event network-vif-plugged-e56ba39e-d25b-410b-ad40-c5c31f2f7ba4 for instance with vm_state active and task_state None.
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Received event network-vif-plugged-e56ba39e-d25b-410b-ad40-c5c31f2f7ba4 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Acquiring lock "0d640cf7-170a-4d3e-8983-6165aab46bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] No waiting events found dispatching network-vif-plugged-e56ba39e-d25b-410b-ad40-c5c31f2f7ba4 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:17:36 user nova-compute[75071]: WARNING nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Received unexpected event network-vif-plugged-e56ba39e-d25b-410b-ad40-c5c31f2f7ba4 for instance with vm_state active and task_state None.
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Received event network-vif-plugged-eb24fe21-798a-4e87-97e8-5e355a77257f {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Acquiring lock "2625dd24-5c50-4911-9515-57c9483bafa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Lock "2625dd24-5c50-4911-9515-57c9483bafa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Lock "2625dd24-5c50-4911-9515-57c9483bafa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] No waiting events found dispatching network-vif-plugged-eb24fe21-798a-4e87-97e8-5e355a77257f {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:17:36 user nova-compute[75071]: WARNING nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Received unexpected event network-vif-plugged-eb24fe21-798a-4e87-97e8-5e355a77257f for instance with vm_state active and task_state None.
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Received event network-vif-plugged-eb24fe21-798a-4e87-97e8-5e355a77257f {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Acquiring lock "2625dd24-5c50-4911-9515-57c9483bafa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Lock "2625dd24-5c50-4911-9515-57c9483bafa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Lock "2625dd24-5c50-4911-9515-57c9483bafa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] No waiting events found dispatching network-vif-plugged-eb24fe21-798a-4e87-97e8-5e355a77257f {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:17:36 user nova-compute[75071]: WARNING nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Received unexpected event network-vif-plugged-eb24fe21-798a-4e87-97e8-5e355a77257f for instance with vm_state active and task_state None.
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Received event network-vif-plugged-cbe4b036-1cc2-4514-8a71-4709d97cc4a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Acquiring lock "332f0212-d8e4-4a99-9688-01a26ba66916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Lock "332f0212-d8e4-4a99-9688-01a26ba66916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Lock "332f0212-d8e4-4a99-9688-01a26ba66916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] No waiting events found dispatching network-vif-plugged-cbe4b036-1cc2-4514-8a71-4709d97cc4a7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:17:36 user nova-compute[75071]: WARNING nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Received unexpected event network-vif-plugged-cbe4b036-1cc2-4514-8a71-4709d97cc4a7 for instance with vm_state active and task_state None.
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Received event network-vif-plugged-cbe4b036-1cc2-4514-8a71-4709d97cc4a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Acquiring lock "332f0212-d8e4-4a99-9688-01a26ba66916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Lock "332f0212-d8e4-4a99-9688-01a26ba66916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] Lock "332f0212-d8e4-4a99-9688-01a26ba66916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] No waiting events found dispatching network-vif-plugged-cbe4b036-1cc2-4514-8a71-4709d97cc4a7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:17:36 user nova-compute[75071]: WARNING nova.compute.manager [req-c9cf5045-a910-4c85-9678-2b3f5d0ae4aa req-ba93cd8b-5f1c-46b3-9318-3929c89a80ea service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Received unexpected event network-vif-plugged-cbe4b036-1cc2-4514-8a71-4709d97cc4a7 for instance with vm_state active and task_state None.
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.792s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.145s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:17:36 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:17:36 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:17:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:17:37 user nova-compute[75071]: DEBUG nova.policy [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '596a8048e44c4f5985956bba2b06aba7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6a14095bd354df1b0be6e89cd2e0b5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:17:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:37 user nova-compute[75071]: INFO nova.virt.block_device [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Booting with volume ddf5aeb1-c8f8-432d-8c49-68373bb2b665 at /dev/vda
Dec 05 12:17:37 user nova-compute[75071]: DEBUG os_brick.utils [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:17:37 user nova-compute[75071]: INFO oslo.privsep.daemon [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpb_gdqsh0/privsep.sock']
Dec 05 12:17:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:37 user sudo[85618]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpb_gdqsh0/privsep.sock
Dec 05 12:17:37 user sudo[85618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 05 12:17:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Successfully created port: e148c36d-f01c-41e2-8e2e-082e023af6fb {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:17:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:38 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Successfully updated port: e148c36d-f01c-41e2-8e2e-082e023af6fb {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:17:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Acquiring lock "refresh_cache-c9e37746-57e8-4053-9f52-2c60bab457fa" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:17:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Acquired lock "refresh_cache-c9e37746-57e8-4053-9f52-2c60bab457fa" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:17:38 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:17:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-a7e3263b-1343-4737-a225-dd70aa764253 req-ca270601-5eca-46dd-9d27-39646d5b4fa5 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Received event network-changed-e148c36d-f01c-41e2-8e2e-082e023af6fb {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-a7e3263b-1343-4737-a225-dd70aa764253 req-ca270601-5eca-46dd-9d27-39646d5b4fa5 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Refreshing instance network info cache due to event network-changed-e148c36d-f01c-41e2-8e2e-082e023af6fb. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:17:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a7e3263b-1343-4737-a225-dd70aa764253 req-ca270601-5eca-46dd-9d27-39646d5b4fa5 service nova] Acquiring lock "refresh_cache-c9e37746-57e8-4053-9f52-2c60bab457fa" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:17:38 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:17:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:39 user sudo[85618]: pam_unix(sudo:session): session closed for user root
Dec 05 12:17:39 user nova-compute[75071]: INFO oslo.privsep.daemon [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Spawned new privsep daemon via rootwrap
Dec 05 12:17:39 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 05 12:17:39 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 05 12:17:39 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Dec 05 12:17:39 user nova-compute[75071]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85641
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2df6ea0-4f23-495f-bbb4-aee73947afe7]: (2,) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Updating instance_info_cache with network_info: [{"id": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "address": "fa:16:3e:7b:99:8a", "network": {"id": "8f9b3ec7-df46-410f-8603-4e4ce082275b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-988513444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a14095bd354df1b0be6e89cd2e0b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c36d-f0", "ovs_interfaceid": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Releasing lock "refresh_cache-c9e37746-57e8-4053-9f52-2c60bab457fa" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Instance network_info: |[{"id": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "address": "fa:16:3e:7b:99:8a", "network": {"id": "8f9b3ec7-df46-410f-8603-4e4ce082275b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-988513444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a14095bd354df1b0be6e89cd2e0b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c36d-f0", "ovs_interfaceid": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a7e3263b-1343-4737-a225-dd70aa764253 req-ca270601-5eca-46dd-9d27-39646d5b4fa5 service nova] Acquired lock "refresh_cache-c9e37746-57e8-4053-9f52-2c60bab457fa" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG nova.network.neutron [req-a7e3263b-1343-4737-a225-dd70aa764253 req-ca270601-5eca-46dd-9d27-39646d5b4fa5 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Refreshing network info cache for port e148c36d-f01c-41e2-8e2e-082e023af6fb {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[400811dd-6fe0-41fb-a3d8-9c1b516cb7ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:39 user nova-compute[75071]: WARNING os_brick.initiator.connectors.nvmeof [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fd26ff-1c75-4489-a2bc-f66f93529abe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef376104-f269-4af2-9149-32e8e11297a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc25ae26-1e5b-44bf-bd8b-dafa9bdda284]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:17:39 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[12aedac9-3422-4ba0-941f-4bc148750f59]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG os_brick.utils [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] <== get_connector_properties: return (2305ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Updating existing volume attachment record: 8323a1a7-57b5-4a94-a9e7-52cced7344a9 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:40 user nova-compute[75071]: DEBUG nova.network.neutron [req-a7e3263b-1343-4737-a225-dd70aa764253 req-ca270601-5eca-46dd-9d27-39646d5b4fa5 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Updated VIF entry in instance network info cache for port e148c36d-f01c-41e2-8e2e-082e023af6fb. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:17:40 user nova-compute[75071]: DEBUG nova.network.neutron [req-a7e3263b-1343-4737-a225-dd70aa764253 req-ca270601-5eca-46dd-9d27-39646d5b4fa5 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Updating instance_info_cache with network_info: [{"id": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "address": "fa:16:3e:7b:99:8a", "network": {"id": "8f9b3ec7-df46-410f-8603-4e4ce082275b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-988513444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a14095bd354df1b0be6e89cd2e0b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c36d-f0", "ovs_interfaceid": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:17:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a7e3263b-1343-4737-a225-dd70aa764253 req-ca270601-5eca-46dd-9d27-39646d5b4fa5 service nova] Releasing lock "refresh_cache-c9e37746-57e8-4053-9f52-2c60bab457fa" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:17:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:41 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:17:41 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:17:41 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=7884MB free_disk=25.59477996826172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:17:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:41 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 81333acc-8dc7-42f1-9026-e42a30e52a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:17:41 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e08be776-0fa9-4871-86eb-2093530c00f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:17:41 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:17:41 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 854ee980-5c0b-4c4f-b9fd-609720e693be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:17:41 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 0d640cf7-170a-4d3e-8983-6165aab46bae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:17:41 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 2625dd24-5c50-4911-9515-57c9483bafa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:17:41 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 332f0212-d8e4-4a99-9688-01a26ba66916 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:17:41 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c9e37746-57e8-4053-9f52-2c60bab457fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:17:41 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:17:41 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:17:42 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:17:42 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:17:42 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:17:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.139s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:43 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:17:43 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:17:43 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 12:17:43 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Skipping network cache update for instance because it is Building. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 05 12:17:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-81333acc-8dc7-42f1-9026-e42a30e52a5a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:17:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-81333acc-8dc7-42f1-9026-e42a30e52a5a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:17:43 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:17:43 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lazy-loading 'info_cache' on Instance uuid 81333acc-8dc7-42f1-9026-e42a30e52a5a {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:17:44 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Updating instance_info_cache with network_info: [{"id": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "address": "fa:16:3e:53:f5:d1", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcda865e-a8", "ovs_interfaceid": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:17:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-81333acc-8dc7-42f1-9026-e42a30e52a5a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:17:44 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:17:44 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:17:44 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:17:44 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:17:44 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:17:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:17:50 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Creating image(s)
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Ensure instance console log exists: /opt/stack/data/nova/instances/c9e37746-57e8-4053-9f52-2c60bab457fa/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Start _get_guest_xml network_info=[{"id": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "address": "fa:16:3e:7b:99:8a", "network": {"id": "8f9b3ec7-df46-410f-8603-4e4ce082275b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-988513444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a14095bd354df1b0be6e89cd2e0b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c36d-f0", "ovs_interfaceid": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '8323a1a7-57b5-4a94-a9e7-52cced7344a9', 'device_type': 'disk', 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmdYpkry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c9e37746-57e8-4053-9f52-2c60bab457fa', 'attached_at': '', 'detached_at': '', 'volume_id': 'ddf5aeb1-c8f8-432d-8c49-68373bb2b665', 'serial': 'ddf5aeb1-c8f8-432d-8c49-68373bb2b665'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:17:50 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:17:50 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connector [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Factory for ISCSI on None {{(pid=75071) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmdYpkry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:17:50 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:17:50 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:17:50 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10398e2-5f1e-48de-9836-fcad955ba414]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:17:50 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4c1ab4-5920-459a-9cee-7401fb9ddc93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665] added
Dec 05 12:17:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b659c984-d7c2-492e-9468-813ed8c239f4]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0e75eb-98ef-4aa0-92cb-e5b7ff2122cb]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmdYpkry {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmdYpkry" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fe184b-dc6a-406c-9f49-07fe9aa51a1d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gmdYpkry'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5eeca6-c836-4bfc-9fb1-c45d96f9397e]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4bd75b-a3a8-4add-b991-52fa983e57d9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 12:17:50 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 12:17:50 user nova-compute[75071]:  {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:17:50 user nova-compute[75071]: WARNING os_brick.initiator.connectors.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 12:17:50 user nova-compute[75071]: 
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ace3386-b1f5-43ab-af36-c26e29b58fa1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665, portal: 172.16.0.220,3260]
Dec 05 12:17:50 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665, portal: 172.16.0.220,3260] successful.
Dec 05 12:17:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[916fc122-61ef-4415-b1b2-46f785fb3b92]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef120b3-0718-44b2-b6d3-c740a8317125]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:17:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:17:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac43dc25-324b-41d3-bb1e-d83fff1c93dd]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:17:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmdYpkry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:17:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:17:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23931393062333662', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:17:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931393062333662', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:17:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1669594796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1669594796',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJ6xZ5XBcUwxREIE7hpriVQZ0cMhVgvH0PlAMEkl0iPK+uJVd0fd5PCbz5I6L/042zo6fYM5B8tUUzAdxDa0FSOpcGykYLgtM0hDjxMaWQcHYNldfHmf9IbWnr2VIyMRg==',key_name='tempest-keypair-106536343',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6a14095bd354df1b0be6e89cd2e0b5a',ramdisk_id='',reservation_id='r-9ic0uf1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1195759080',owner_user_name='tempest-ServerActionsV293TestJSON-1195759080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='596a8048e44c4f5985956bba2b06aba7',uuid=c9e37746-57e8-4053-9f52-2c60bab457fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "address": "fa:16:3e:7b:99:8a", "network": {"id": "8f9b3ec7-df46-410f-8603-4e4ce082275b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-988513444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a14095bd354df1b0be6e89cd2e0b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c36d-f0", "ovs_interfaceid": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:17:51 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Converting VIF {"id": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "address": "fa:16:3e:7b:99:8a", "network": {"id": "8f9b3ec7-df46-410f-8603-4e4ce082275b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-988513444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a14095bd354df1b0be6e89cd2e0b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c36d-f0", "ovs_interfaceid": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:17:51 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=e148c36d-f01c-41e2-8e2e-082e023af6fb,network=Network(8f9b3ec7-df46-410f-8603-4e4ce082275b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c36d-f0') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:17:51 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lazy-loading 'pci_devices' on Instance uuid c9e37746-57e8-4053-9f52-2c60bab457fa {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:17:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:17:52 user nova-compute[75071]:   <uuid>c9e37746-57e8-4053-9f52-2c60bab457fa</uuid>
Dec 05 12:17:52 user nova-compute[75071]:   <name>instance-00000008</name>
Dec 05 12:17:52 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:17:52 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:17:52 user nova-compute[75071]:   <metadata>
Dec 05 12:17:52 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:17:52 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:17:52 user nova-compute[75071]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1669594796</nova:name>
Dec 05 12:17:52 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:17:50</nova:creationTime>
Dec 05 12:17:52 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:17:52 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:17:52 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:17:52 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:17:52 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:17:52 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:17:52 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:17:52 user nova-compute[75071]:       <nova:owner>
Dec 05 12:17:52 user nova-compute[75071]:         <nova:user uuid="596a8048e44c4f5985956bba2b06aba7">tempest-ServerActionsV293TestJSON-1195759080-project-member</nova:user>
Dec 05 12:17:52 user nova-compute[75071]:         <nova:project uuid="d6a14095bd354df1b0be6e89cd2e0b5a">tempest-ServerActionsV293TestJSON-1195759080</nova:project>
Dec 05 12:17:52 user nova-compute[75071]:       </nova:owner>
Dec 05 12:17:52 user nova-compute[75071]:       <nova:ports>
Dec 05 12:17:52 user nova-compute[75071]:         <nova:port uuid="e148c36d-f01c-41e2-8e2e-082e023af6fb">
Dec 05 12:17:52 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 05 12:17:52 user nova-compute[75071]:         </nova:port>
Dec 05 12:17:52 user nova-compute[75071]:       </nova:ports>
Dec 05 12:17:52 user nova-compute[75071]:     </nova:instance>
Dec 05 12:17:52 user nova-compute[75071]:   </metadata>
Dec 05 12:17:52 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:17:52 user nova-compute[75071]:     <system>
Dec 05 12:17:52 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:17:52 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:17:52 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:17:52 user nova-compute[75071]:       <entry name="serial">c9e37746-57e8-4053-9f52-2c60bab457fa</entry>
Dec 05 12:17:52 user nova-compute[75071]:       <entry name="uuid">c9e37746-57e8-4053-9f52-2c60bab457fa</entry>
Dec 05 12:17:52 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:17:52 user nova-compute[75071]:     </system>
Dec 05 12:17:52 user nova-compute[75071]:   </sysinfo>
Dec 05 12:17:52 user nova-compute[75071]:   <os>
Dec 05 12:17:52 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:17:52 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:17:52 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:17:52 user nova-compute[75071]:   </os>
Dec 05 12:17:52 user nova-compute[75071]:   <features>
Dec 05 12:17:52 user nova-compute[75071]:     <acpi/>
Dec 05 12:17:52 user nova-compute[75071]:     <apic/>
Dec 05 12:17:52 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:17:52 user nova-compute[75071]:   </features>
Dec 05 12:17:52 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:17:52 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:17:52 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:17:52 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:17:52 user nova-compute[75071]:   </clock>
Dec 05 12:17:52 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:17:52 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:17:52 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:17:52 user nova-compute[75071]:   </cpu>
Dec 05 12:17:52 user nova-compute[75071]:   <devices>
Dec 05 12:17:52 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:17:52 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:17:52 user nova-compute[75071]:       <source dev="/dev/sdb"/>
Dec 05 12:17:52 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:17:52 user nova-compute[75071]:       <serial>ddf5aeb1-c8f8-432d-8c49-68373bb2b665</serial>
Dec 05 12:17:52 user nova-compute[75071]:     </disk>
Dec 05 12:17:52 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:17:52 user nova-compute[75071]:       <mac address="fa:16:3e:7b:99:8a"/>
Dec 05 12:17:52 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:17:52 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:17:52 user nova-compute[75071]:       <target dev="tape148c36d-f0"/>
Dec 05 12:17:52 user nova-compute[75071]:     </interface>
Dec 05 12:17:52 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:17:52 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/c9e37746-57e8-4053-9f52-2c60bab457fa/console.log" append="off"/>
Dec 05 12:17:52 user nova-compute[75071]:     </serial>
Dec 05 12:17:52 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:17:52 user nova-compute[75071]:     <video>
Dec 05 12:17:52 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:17:52 user nova-compute[75071]:     </video>
Dec 05 12:17:52 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:17:52 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:17:52 user nova-compute[75071]:     </rng>
Dec 05 12:17:52 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:17:52 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:17:52 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:17:52 user nova-compute[75071]:     </memballoon>
Dec 05 12:17:52 user nova-compute[75071]:   </devices>
Dec 05 12:17:52 user nova-compute[75071]: </domain>
Dec 05 12:17:52 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:17:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1669594796',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1669594796',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJ6xZ5XBcUwxREIE7hpriVQZ0cMhVgvH0PlAMEkl0iPK+uJVd0fd5PCbz5I6L/042zo6fYM5B8tUUzAdxDa0FSOpcGykYLgtM0hDjxMaWQcHYNldfHmf9IbWnr2VIyMRg==',key_name='tempest-keypair-106536343',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6a14095bd354df1b0be6e89cd2e0b5a',ramdisk_id='',reservation_id='r-9ic0uf1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1195759080',owner_user_name='tempest-ServerActionsV293TestJSON-1195759080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='596a8048e44c4f5985956bba2b06aba7',uuid=c9e37746-57e8-4053-9f52-2c60bab457fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "address": "fa:16:3e:7b:99:8a", "network": {"id": "8f9b3ec7-df46-410f-8603-4e4ce082275b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-988513444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a14095bd354df1b0be6e89cd2e0b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c36d-f0", "ovs_interfaceid": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:17:52 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Converting VIF {"id": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "address": "fa:16:3e:7b:99:8a", "network": {"id": "8f9b3ec7-df46-410f-8603-4e4ce082275b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-988513444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a14095bd354df1b0be6e89cd2e0b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c36d-f0", "ovs_interfaceid": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:17:52 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=e148c36d-f01c-41e2-8e2e-082e023af6fb,network=Network(8f9b3ec7-df46-410f-8603-4e4ce082275b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c36d-f0') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:17:52 user nova-compute[75071]: DEBUG os_vif [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=e148c36d-f01c-41e2-8e2e-082e023af6fb,network=Network(8f9b3ec7-df46-410f-8603-4e4ce082275b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c36d-f0') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:17:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:17:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2418ed50-54c0-5053-b066-b3d61d0027e3', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:17:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape148c36d-f0, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape148c36d-f0, col_values=(('qos', UUID('32160bcd-f693-4c41-833a-ebdf32e1deed')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape148c36d-f0, col_values=(('external_ids', {'iface-id': 'e148c36d-f01c-41e2-8e2e-082e023af6fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:99:8a', 'vm-uuid': 'c9e37746-57e8-4053-9f52-2c60bab457fa'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:17:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:17:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:52 user nova-compute[75071]: INFO os_vif [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=e148c36d-f01c-41e2-8e2e-082e023af6fb,network=Network(8f9b3ec7-df46-410f-8603-4e4ce082275b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c36d-f0')
Dec 05 12:17:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:17:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] No VIF found with MAC fa:16:3e:7b:99:8a, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:17:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-1a73d43e-3548-43fc-9e08-2996ae59b578 req-0f5133cb-8181-4d0f-846d-116456f8f334 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Received event network-vif-plugged-e148c36d-f01c-41e2-8e2e-082e023af6fb {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1a73d43e-3548-43fc-9e08-2996ae59b578 req-0f5133cb-8181-4d0f-846d-116456f8f334 service nova] Acquiring lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1a73d43e-3548-43fc-9e08-2996ae59b578 req-0f5133cb-8181-4d0f-846d-116456f8f334 service nova] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1a73d43e-3548-43fc-9e08-2996ae59b578 req-0f5133cb-8181-4d0f-846d-116456f8f334 service nova] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-1a73d43e-3548-43fc-9e08-2996ae59b578 req-0f5133cb-8181-4d0f-846d-116456f8f334 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] No waiting events found dispatching network-vif-plugged-e148c36d-f01c-41e2-8e2e-082e023af6fb {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:17:53 user nova-compute[75071]: WARNING nova.compute.manager [req-1a73d43e-3548-43fc-9e08-2996ae59b578 req-0f5133cb-8181-4d0f-846d-116456f8f334 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Received unexpected event network-vif-plugged-e148c36d-f01c-41e2-8e2e-082e023af6fb for instance with vm_state building and task_state spawning.
Dec 05 12:17:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:17:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:17:54 user nova-compute[75071]: INFO nova.compute.claims [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Claim successful on node user
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Refreshing inventories for resource provider 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Updating ProviderTree inventory for provider 25beb694-9dd7-475f-9657-74a5f0368417 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Updating inventory in ProviderTree for provider 25beb694-9dd7-475f-9657-74a5f0368417 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Refreshing aggregate associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Refreshing trait associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.714s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:17:55 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-950f7c23-ff90-4866-84be-fdc298f865bb req-18c5e1fe-2a3c-4662-a31b-913ac78b5925 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Received event network-vif-plugged-e148c36d-f01c-41e2-8e2e-082e023af6fb {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-950f7c23-ff90-4866-84be-fdc298f865bb req-18c5e1fe-2a3c-4662-a31b-913ac78b5925 service nova] Acquiring lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-950f7c23-ff90-4866-84be-fdc298f865bb req-18c5e1fe-2a3c-4662-a31b-913ac78b5925 service nova] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-950f7c23-ff90-4866-84be-fdc298f865bb req-18c5e1fe-2a3c-4662-a31b-913ac78b5925 service nova] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-950f7c23-ff90-4866-84be-fdc298f865bb req-18c5e1fe-2a3c-4662-a31b-913ac78b5925 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] No waiting events found dispatching network-vif-plugged-e148c36d-f01c-41e2-8e2e-082e023af6fb {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:17:55 user nova-compute[75071]: WARNING nova.compute.manager [req-950f7c23-ff90-4866-84be-fdc298f865bb req-18c5e1fe-2a3c-4662-a31b-913ac78b5925 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Received unexpected event network-vif-plugged-e148c36d-f01c-41e2-8e2e-082e023af6fb for instance with vm_state building and task_state spawning.
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:17:55 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Instance spawned successfully.
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:17:55 user nova-compute[75071]: INFO nova.virt.block_device [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Booting with volume 9d04025a-0b32-47ab-ab5a-75a8bd43a310 at /dev/vda
Dec 05 12:17:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.policy [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c12a1f3c2b3f46acaaf61809bb14ae22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14482277667040c3bc5c0ae2f89c4ed4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:17:55 user nova-compute[75071]: INFO nova.compute.manager [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Took 5.38 seconds to spawn the instance on the hypervisor.
Dec 05 12:17:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG os_brick.utils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9596be16-2017-44c8-8cb0-e424735ea3df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b40fdd-ad11-498c-84b9-e433f3b96ba6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:56 user nova-compute[75071]: INFO nova.compute.manager [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Took 20.06 seconds to build instance.
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:17:56 user nova-compute[75071]: INFO nova.compute.claims [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Claim successful on node user
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4b1c6e-3e94-42fb-b799-44ce94a5aaea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a274ffd8-6fe1-4e91-812c-84dd83819a21 tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.201s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8952be-3091-4db8-bd6a-6d342b98c679]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:17:56 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9e9aac-4bd6-47fe-a107-04fd9c885f74]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG os_brick.utils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Updating existing volume attachment record: a42daaef-1835-4b19-aa71-e297b514de5e {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:17:56 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:17:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:17:56 user nova-compute[75071]: INFO nova.virt.block_device [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Booting with volume 68062df8-0269-41ba-90ac-c150b267890e at /dev/vda
Dec 05 12:17:56 user nova-compute[75071]: DEBUG os_brick.utils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:17:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[492c1d55-84d4-4afa-b046-eb3022fff102]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[11297b20-7826-4e2b-ab43-f01536b97c7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d35989-ed78-4dca-b790-b4c3211e2667]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac2d92c-d0fb-4eef-816a-3ae35beeaa54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:17:57 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:17:57 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d89b555-fefe-4f1f-8d2e-df299460eacb]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG os_brick.utils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Updating existing volume attachment record: 801e33dd-e4ed-4297-9dd2-21707db50535 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG nova.policy [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '52bf9c24f2bb4bac8ac8a8918227708f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9df1de3e82e4fcc801ea3a8dcb1455d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Successfully created port: 21361178-8b0b-43fb-9381-37e603f8d993 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:17:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:17:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Successfully created port: 0d9f17d4-6b21-460d-9a8c-47270cf8a163 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:17:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Successfully created port: 30d569c6-052c-487b-99d8-142bed67ae7e {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:17:59 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Successfully created port: 26c5a6d6-9037-490d-b40b-8e0c5bb16d0b {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:17:59 user nova-compute[75071]: DEBUG nova.network.neutron [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Successfully created port: 443a2f48-d7e4-4368-986d-53e5a9705d3e {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:18:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Successfully created port: 19d60ebb-5100-4ba5-9fe7-d9b246e4971d {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:18:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Successfully created port: d96e645b-e317-4ac8-88b4-67e62a3c41b7 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:18:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:02 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Successfully created port: 7eadd24f-487c-4d19-b5eb-7d9483bf1800 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:18:02 user nova-compute[75071]: DEBUG nova.network.neutron [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Successfully created port: 5e5b1c1e-64c1-4da4-ab47-d1afd13843ac {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:18:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:03 user nova-compute[75071]: DEBUG nova.network.neutron [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Successfully created port: afa68989-e42f-4b32-b4d4-319a6290df7d {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:18:03 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Successfully updated port: 21361178-8b0b-43fb-9381-37e603f8d993 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:18:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-fb6d60b7-4cab-4e9d-922e-287adccad71e req-cedb33ce-fe4e-437d-afd8-079d74ec204d service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-changed-21361178-8b0b-43fb-9381-37e603f8d993 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-fb6d60b7-4cab-4e9d-922e-287adccad71e req-cedb33ce-fe4e-437d-afd8-079d74ec204d service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Refreshing instance network info cache due to event network-changed-21361178-8b0b-43fb-9381-37e603f8d993. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fb6d60b7-4cab-4e9d-922e-287adccad71e req-cedb33ce-fe4e-437d-afd8-079d74ec204d service nova] Acquiring lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fb6d60b7-4cab-4e9d-922e-287adccad71e req-cedb33ce-fe4e-437d-afd8-079d74ec204d service nova] Acquired lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:03 user nova-compute[75071]: DEBUG nova.network.neutron [req-fb6d60b7-4cab-4e9d-922e-287adccad71e req-cedb33ce-fe4e-437d-afd8-079d74ec204d service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Refreshing network info cache for port 21361178-8b0b-43fb-9381-37e603f8d993 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:03 user nova-compute[75071]: DEBUG nova.network.neutron [req-fb6d60b7-4cab-4e9d-922e-287adccad71e req-cedb33ce-fe4e-437d-afd8-079d74ec204d service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:18:04 user nova-compute[75071]: DEBUG nova.network.neutron [req-fb6d60b7-4cab-4e9d-922e-287adccad71e req-cedb33ce-fe4e-437d-afd8-079d74ec204d service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fb6d60b7-4cab-4e9d-922e-287adccad71e req-cedb33ce-fe4e-437d-afd8-079d74ec204d service nova] Releasing lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Successfully updated port: 0d9f17d4-6b21-460d-9a8c-47270cf8a163 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:18:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Successfully updated port: cc837761-a388-414b-9c08-8835b4e255c7 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:18:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-f0608ad8-2b3b-4b6a-b07e-37f28718fb2d req-93d27d04-d96e-47ea-9746-c418e34b46da service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-changed-0d9f17d4-6b21-460d-9a8c-47270cf8a163 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-f0608ad8-2b3b-4b6a-b07e-37f28718fb2d req-93d27d04-d96e-47ea-9746-c418e34b46da service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Refreshing instance network info cache due to event network-changed-0d9f17d4-6b21-460d-9a8c-47270cf8a163. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f0608ad8-2b3b-4b6a-b07e-37f28718fb2d req-93d27d04-d96e-47ea-9746-c418e34b46da service nova] Acquiring lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f0608ad8-2b3b-4b6a-b07e-37f28718fb2d req-93d27d04-d96e-47ea-9746-c418e34b46da service nova] Acquired lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:05 user nova-compute[75071]: DEBUG nova.network.neutron [req-f0608ad8-2b3b-4b6a-b07e-37f28718fb2d req-93d27d04-d96e-47ea-9746-c418e34b46da service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Refreshing network info cache for port 0d9f17d4-6b21-460d-9a8c-47270cf8a163 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:05 user nova-compute[75071]: DEBUG nova.network.neutron [req-f0608ad8-2b3b-4b6a-b07e-37f28718fb2d req-93d27d04-d96e-47ea-9746-c418e34b46da service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:18:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-f0608ad8-2b3b-4b6a-b07e-37f28718fb2d req-93d27d04-d96e-47ea-9746-c418e34b46da service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f0608ad8-2b3b-4b6a-b07e-37f28718fb2d req-93d27d04-d96e-47ea-9746-c418e34b46da service nova] Releasing lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-f0608ad8-2b3b-4b6a-b07e-37f28718fb2d req-93d27d04-d96e-47ea-9746-c418e34b46da service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-changed-cc837761-a388-414b-9c08-8835b4e255c7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-f0608ad8-2b3b-4b6a-b07e-37f28718fb2d req-93d27d04-d96e-47ea-9746-c418e34b46da service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Refreshing instance network info cache due to event network-changed-cc837761-a388-414b-9c08-8835b4e255c7. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f0608ad8-2b3b-4b6a-b07e-37f28718fb2d req-93d27d04-d96e-47ea-9746-c418e34b46da service nova] Acquiring lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f0608ad8-2b3b-4b6a-b07e-37f28718fb2d req-93d27d04-d96e-47ea-9746-c418e34b46da service nova] Acquired lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-f0608ad8-2b3b-4b6a-b07e-37f28718fb2d req-93d27d04-d96e-47ea-9746-c418e34b46da service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Refreshing network info cache for port cc837761-a388-414b-9c08-8835b4e255c7 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-f0608ad8-2b3b-4b6a-b07e-37f28718fb2d req-93d27d04-d96e-47ea-9746-c418e34b46da service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:18:06 user nova-compute[75071]: INFO nova.virt.block_device [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Booting with volume b4a92957-3718-450a-a2d7-c2057464b97b at /dev/vdb
Dec 05 12:18:06 user nova-compute[75071]: DEBUG os_brick.utils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:18:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[496ec193-3077-4c1e-ae4e-ea5308369bba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[441dbfbc-8ed3-4714-b587-45d1df135f62]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4899cbd9-d36b-4b70-bb8a-e767aabdee1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deac2ec-9464-46e5-b33c-c973a7bc41f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-f0608ad8-2b3b-4b6a-b07e-37f28718fb2d req-93d27d04-d96e-47ea-9746-c418e34b46da service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f0608ad8-2b3b-4b6a-b07e-37f28718fb2d req-93d27d04-d96e-47ea-9746-c418e34b46da service nova] Releasing lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:18:07 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:18:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1253bd-909d-4554-8b76-4eb9aee85243]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG os_brick.utils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Updating existing volume attachment record: e756de08-b796-43e5-bea9-c7cfe1aaddb1 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG nova.network.neutron [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Successfully updated port: a580be24-0d0f-4cf1-8abc-2b9514de0cbf {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Successfully updated port: deb82347-819f-40f5-bc84-b1562c29af71 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-f142f361-2240-4952-8259-23d9b73fdc42 req-2599e669-f57b-4b14-9fd0-ac012a8045d4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-changed-a580be24-0d0f-4cf1-8abc-2b9514de0cbf {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-f142f361-2240-4952-8259-23d9b73fdc42 req-2599e669-f57b-4b14-9fd0-ac012a8045d4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Refreshing instance network info cache due to event network-changed-a580be24-0d0f-4cf1-8abc-2b9514de0cbf. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f142f361-2240-4952-8259-23d9b73fdc42 req-2599e669-f57b-4b14-9fd0-ac012a8045d4 service nova] Acquiring lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f142f361-2240-4952-8259-23d9b73fdc42 req-2599e669-f57b-4b14-9fd0-ac012a8045d4 service nova] Acquired lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-f142f361-2240-4952-8259-23d9b73fdc42 req-2599e669-f57b-4b14-9fd0-ac012a8045d4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Refreshing network info cache for port a580be24-0d0f-4cf1-8abc-2b9514de0cbf {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-f142f361-2240-4952-8259-23d9b73fdc42 req-2599e669-f57b-4b14-9fd0-ac012a8045d4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:18:08 user nova-compute[75071]: INFO nova.virt.block_device [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Booting with volume 33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 at /dev/vdb
Dec 05 12:18:08 user nova-compute[75071]: DEBUG os_brick.utils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e4e9c3-38e9-4d6b-bf60-fafbd6bf06df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1820ab39-636f-43bd-b66f-d11f0c5269a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4128c23-54f9-4fc8-a695-664c08e1a303]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[99af9dc0-9c88-4ed4-b9cd-328a370d6fb1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:18:08 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:18:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7ded1c-9ad1-4738-8a7f-b773c90fdad9]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG os_brick.utils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Updating existing volume attachment record: 04d59458-8e8d-4eb3-bcd6-19da1fb4c8e0 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-f142f361-2240-4952-8259-23d9b73fdc42 req-2599e669-f57b-4b14-9fd0-ac012a8045d4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Successfully updated port: 34466bd1-f50e-4643-917f-512f81302b85 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f142f361-2240-4952-8259-23d9b73fdc42 req-2599e669-f57b-4b14-9fd0-ac012a8045d4 service nova] Releasing lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-f142f361-2240-4952-8259-23d9b73fdc42 req-2599e669-f57b-4b14-9fd0-ac012a8045d4 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-changed-deb82347-819f-40f5-bc84-b1562c29af71 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-f142f361-2240-4952-8259-23d9b73fdc42 req-2599e669-f57b-4b14-9fd0-ac012a8045d4 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Refreshing instance network info cache due to event network-changed-deb82347-819f-40f5-bc84-b1562c29af71. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f142f361-2240-4952-8259-23d9b73fdc42 req-2599e669-f57b-4b14-9fd0-ac012a8045d4 service nova] Acquiring lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f142f361-2240-4952-8259-23d9b73fdc42 req-2599e669-f57b-4b14-9fd0-ac012a8045d4 service nova] Acquired lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-f142f361-2240-4952-8259-23d9b73fdc42 req-2599e669-f57b-4b14-9fd0-ac012a8045d4 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Refreshing network info cache for port deb82347-819f-40f5-bc84-b1562c29af71 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Successfully updated port: 30d569c6-052c-487b-99d8-142bed67ae7e {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:18:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-f142f361-2240-4952-8259-23d9b73fdc42 req-2599e669-f57b-4b14-9fd0-ac012a8045d4 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:18:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-f142f361-2240-4952-8259-23d9b73fdc42 req-2599e669-f57b-4b14-9fd0-ac012a8045d4 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f142f361-2240-4952-8259-23d9b73fdc42 req-2599e669-f57b-4b14-9fd0-ac012a8045d4 service nova] Releasing lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-0f78d25f-044b-47c0-8b69-f33ba83de5a4 req-eea9676e-54ad-4227-9cd5-fbb45bef9755 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-changed-34466bd1-f50e-4643-917f-512f81302b85 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-0f78d25f-044b-47c0-8b69-f33ba83de5a4 req-eea9676e-54ad-4227-9cd5-fbb45bef9755 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Refreshing instance network info cache due to event network-changed-34466bd1-f50e-4643-917f-512f81302b85. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f78d25f-044b-47c0-8b69-f33ba83de5a4 req-eea9676e-54ad-4227-9cd5-fbb45bef9755 service nova] Acquiring lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f78d25f-044b-47c0-8b69-f33ba83de5a4 req-eea9676e-54ad-4227-9cd5-fbb45bef9755 service nova] Acquired lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-0f78d25f-044b-47c0-8b69-f33ba83de5a4 req-eea9676e-54ad-4227-9cd5-fbb45bef9755 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Refreshing network info cache for port 34466bd1-f50e-4643-917f-512f81302b85 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:10 user nova-compute[75071]: DEBUG nova.network.neutron [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Successfully updated port: 443a2f48-d7e4-4368-986d-53e5a9705d3e {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:18:10 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Successfully updated port: 26c5a6d6-9037-490d-b40b-8e0c5bb16d0b {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:18:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-0f78d25f-044b-47c0-8b69-f33ba83de5a4 req-eea9676e-54ad-4227-9cd5-fbb45bef9755 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:18:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-0f78d25f-044b-47c0-8b69-f33ba83de5a4 req-eea9676e-54ad-4227-9cd5-fbb45bef9755 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f78d25f-044b-47c0-8b69-f33ba83de5a4 req-eea9676e-54ad-4227-9cd5-fbb45bef9755 service nova] Releasing lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-0f78d25f-044b-47c0-8b69-f33ba83de5a4 req-eea9676e-54ad-4227-9cd5-fbb45bef9755 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-changed-30d569c6-052c-487b-99d8-142bed67ae7e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-0f78d25f-044b-47c0-8b69-f33ba83de5a4 req-eea9676e-54ad-4227-9cd5-fbb45bef9755 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Refreshing instance network info cache due to event network-changed-30d569c6-052c-487b-99d8-142bed67ae7e. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f78d25f-044b-47c0-8b69-f33ba83de5a4 req-eea9676e-54ad-4227-9cd5-fbb45bef9755 service nova] Acquiring lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f78d25f-044b-47c0-8b69-f33ba83de5a4 req-eea9676e-54ad-4227-9cd5-fbb45bef9755 service nova] Acquired lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-0f78d25f-044b-47c0-8b69-f33ba83de5a4 req-eea9676e-54ad-4227-9cd5-fbb45bef9755 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Refreshing network info cache for port 30d569c6-052c-487b-99d8-142bed67ae7e {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-0f78d25f-044b-47c0-8b69-f33ba83de5a4 req-eea9676e-54ad-4227-9cd5-fbb45bef9755 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:18:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-0f78d25f-044b-47c0-8b69-f33ba83de5a4 req-eea9676e-54ad-4227-9cd5-fbb45bef9755 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0f78d25f-044b-47c0-8b69-f33ba83de5a4 req-eea9676e-54ad-4227-9cd5-fbb45bef9755 service nova] Releasing lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:11 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Successfully updated port: d96e645b-e317-4ac8-88b4-67e62a3c41b7 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:18:11 user nova-compute[75071]: DEBUG nova.network.neutron [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Successfully updated port: 19d60ebb-5100-4ba5-9fe7-d9b246e4971d {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:18:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-changed-443a2f48-d7e4-4368-986d-53e5a9705d3e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Refreshing instance network info cache due to event network-changed-443a2f48-d7e4-4368-986d-53e5a9705d3e. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] Acquiring lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] Acquired lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:12 user nova-compute[75071]: DEBUG nova.network.neutron [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Refreshing network info cache for port 443a2f48-d7e4-4368-986d-53e5a9705d3e {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:12 user nova-compute[75071]: DEBUG nova.network.neutron [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:18:12 user nova-compute[75071]: DEBUG nova.network.neutron [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] Releasing lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-changed-26c5a6d6-9037-490d-b40b-8e0c5bb16d0b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Refreshing instance network info cache due to event network-changed-26c5a6d6-9037-490d-b40b-8e0c5bb16d0b. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] Acquiring lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] Acquired lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:12 user nova-compute[75071]: DEBUG nova.network.neutron [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Refreshing network info cache for port 26c5a6d6-9037-490d-b40b-8e0c5bb16d0b {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:12 user nova-compute[75071]: DEBUG nova.network.neutron [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG nova.network.neutron [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] Releasing lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-changed-d96e645b-e317-4ac8-88b4-67e62a3c41b7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Refreshing instance network info cache due to event network-changed-d96e645b-e317-4ac8-88b4-67e62a3c41b7. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] Acquiring lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] Acquired lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG nova.network.neutron [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Refreshing network info cache for port d96e645b-e317-4ac8-88b4-67e62a3c41b7 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG nova.network.neutron [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Successfully updated port: 7eadd24f-487c-4d19-b5eb-7d9483bf1800 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Acquiring lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG nova.network.neutron [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG nova.network.neutron [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Successfully updated port: 5e5b1c1e-64c1-4da4-ab47-d1afd13843ac {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] Releasing lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-changed-19d60ebb-5100-4ba5-9fe7-d9b246e4971d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Refreshing instance network info cache due to event network-changed-19d60ebb-5100-4ba5-9fe7-d9b246e4971d. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] Acquiring lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] Acquired lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG nova.network.neutron [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Refreshing network info cache for port 19d60ebb-5100-4ba5-9fe7-d9b246e4971d {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Acquired lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:18:13 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:18:14 user nova-compute[75071]: DEBUG nova.network.neutron [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:18:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-ebf72df8-3f68-403e-87bd-68dffe330816 req-8a42a847-331f-41bf-a829-faf5dc06ac39 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-changed-7eadd24f-487c-4d19-b5eb-7d9483bf1800 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-ebf72df8-3f68-403e-87bd-68dffe330816 req-8a42a847-331f-41bf-a829-faf5dc06ac39 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Refreshing instance network info cache due to event network-changed-7eadd24f-487c-4d19-b5eb-7d9483bf1800. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ebf72df8-3f68-403e-87bd-68dffe330816 req-8a42a847-331f-41bf-a829-faf5dc06ac39 service nova] Acquiring lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:14 user nova-compute[75071]: DEBUG nova.network.neutron [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-da08b8ae-d874-4de5-ab7a-0af79621c7b1 req-4fbe1a7d-c1a8-4a9c-90bd-9b8c73ae3329 service nova] Releasing lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:15 user nova-compute[75071]: DEBUG nova.network.neutron [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Successfully updated port: afa68989-e42f-4b32-b4d4-319a6290df7d {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:18:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Acquiring lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Acquired lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:15 user nova-compute[75071]: DEBUG nova.network.neutron [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:18:15 user nova-compute[75071]: DEBUG nova.network.neutron [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:18:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-6257878e-a4c5-4384-a878-ac90dba2ece8 req-b2ebfec6-1617-417b-a61f-435a0b5ecb9a service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-changed-afa68989-e42f-4b32-b4d4-319a6290df7d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-6257878e-a4c5-4384-a878-ac90dba2ece8 req-b2ebfec6-1617-417b-a61f-435a0b5ecb9a service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Refreshing instance network info cache due to event network-changed-afa68989-e42f-4b32-b4d4-319a6290df7d. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6257878e-a4c5-4384-a878-ac90dba2ece8 req-b2ebfec6-1617-417b-a61f-435a0b5ecb9a service nova] Acquiring lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:18:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:18:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:18:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Updating instance_info_cache with network_info: [{"id": "21361178-8b0b-43fb-9381-37e603f8d993", "address": "fa:16:3e:86:db:af", "network": {"id": "150ec31a-5cc2-485a-8ed6-07bd26173225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-441693172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21361178-8b", "ovs_interfaceid": "21361178-8b0b-43fb-9381-37e603f8d993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc837761-a388-414b-9c08-8835b4e255c7", "address": "fa:16:3e:bd:f8:40", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc837761-a3", "ovs_interfaceid": "cc837761-a388-414b-9c08-8835b4e255c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "deb82347-819f-40f5-bc84-b1562c29af71", "address": "fa:16:3e:16:d6:e0", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb82347-81", "ovs_interfaceid": "deb82347-819f-40f5-bc84-b1562c29af71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "30d569c6-052c-487b-99d8-142bed67ae7e", "address": "fa:16:3e:8f:44:7e", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d569c6-05", "ovs_interfaceid": "30d569c6-052c-487b-99d8-142bed67ae7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "address": "fa:16:3e:3f:fb:3b", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c5a6d6-90", "ovs_interfaceid": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "address": "fa:16:3e:22:b6:fc", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e645b-e3", "ovs_interfaceid": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "address": "fa:16:3e:eb:4e:30", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eadd24f-48", "ovs_interfaceid": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Releasing lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Instance network_info: |[{"id": "21361178-8b0b-43fb-9381-37e603f8d993", "address": "fa:16:3e:86:db:af", "network": {"id": "150ec31a-5cc2-485a-8ed6-07bd26173225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-441693172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21361178-8b", "ovs_interfaceid": "21361178-8b0b-43fb-9381-37e603f8d993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc837761-a388-414b-9c08-8835b4e255c7", "address": "fa:16:3e:bd:f8:40", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc837761-a3", "ovs_interfaceid": "cc837761-a388-414b-9c08-8835b4e255c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "deb82347-819f-40f5-bc84-b1562c29af71", "address": "fa:16:3e:16:d6:e0", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb82347-81", "ovs_interfaceid": "deb82347-819f-40f5-bc84-b1562c29af71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "30d569c6-052c-487b-99d8-142bed67ae7e", "address": "fa:16:3e:8f:44:7e", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d569c6-05", "ovs_interfaceid": "30d569c6-052c-487b-99d8-142bed67ae7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "address": "fa:16:3e:3f:fb:3b", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c5a6d6-90", "ovs_interfaceid": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "address": "fa:16:3e:22:b6:fc", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e645b-e3", "ovs_interfaceid": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "address": "fa:16:3e:eb:4e:30", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eadd24f-48", "ovs_interfaceid": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:18:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ebf72df8-3f68-403e-87bd-68dffe330816 req-8a42a847-331f-41bf-a829-faf5dc06ac39 service nova] Acquired lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:17 user nova-compute[75071]: DEBUG nova.network.neutron [req-ebf72df8-3f68-403e-87bd-68dffe330816 req-8a42a847-331f-41bf-a829-faf5dc06ac39 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Refreshing network info cache for port 7eadd24f-487c-4d19-b5eb-7d9483bf1800 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:18 user nova-compute[75071]: DEBUG nova.network.neutron [req-ebf72df8-3f68-403e-87bd-68dffe330816 req-8a42a847-331f-41bf-a829-faf5dc06ac39 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Updated VIF entry in instance network info cache for port 7eadd24f-487c-4d19-b5eb-7d9483bf1800. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:18:18 user nova-compute[75071]: DEBUG nova.network.neutron [req-ebf72df8-3f68-403e-87bd-68dffe330816 req-8a42a847-331f-41bf-a829-faf5dc06ac39 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Updating instance_info_cache with network_info: [{"id": "21361178-8b0b-43fb-9381-37e603f8d993", "address": "fa:16:3e:86:db:af", "network": {"id": "150ec31a-5cc2-485a-8ed6-07bd26173225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-441693172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21361178-8b", "ovs_interfaceid": "21361178-8b0b-43fb-9381-37e603f8d993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc837761-a388-414b-9c08-8835b4e255c7", "address": "fa:16:3e:bd:f8:40", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc837761-a3", "ovs_interfaceid": "cc837761-a388-414b-9c08-8835b4e255c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "deb82347-819f-40f5-bc84-b1562c29af71", "address": "fa:16:3e:16:d6:e0", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb82347-81", "ovs_interfaceid": "deb82347-819f-40f5-bc84-b1562c29af71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "30d569c6-052c-487b-99d8-142bed67ae7e", "address": "fa:16:3e:8f:44:7e", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d569c6-05", "ovs_interfaceid": "30d569c6-052c-487b-99d8-142bed67ae7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "address": "fa:16:3e:3f:fb:3b", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c5a6d6-90", "ovs_interfaceid": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "address": "fa:16:3e:22:b6:fc", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e645b-e3", "ovs_interfaceid": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "address": "fa:16:3e:eb:4e:30", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eadd24f-48", "ovs_interfaceid": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ebf72df8-3f68-403e-87bd-68dffe330816 req-8a42a847-331f-41bf-a829-faf5dc06ac39 service nova] Releasing lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-ebf72df8-3f68-403e-87bd-68dffe330816 req-8a42a847-331f-41bf-a829-faf5dc06ac39 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-changed-5e5b1c1e-64c1-4da4-ab47-d1afd13843ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-ebf72df8-3f68-403e-87bd-68dffe330816 req-8a42a847-331f-41bf-a829-faf5dc06ac39 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Refreshing instance network info cache due to event network-changed-5e5b1c1e-64c1-4da4-ab47-d1afd13843ac. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ebf72df8-3f68-403e-87bd-68dffe330816 req-8a42a847-331f-41bf-a829-faf5dc06ac39 service nova] Acquiring lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:18 user nova-compute[75071]: DEBUG nova.network.neutron [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Updating instance_info_cache with network_info: [{"id": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "address": "fa:16:3e:71:02:8a", "network": {"id": "f50e74cc-b2a2-4c93-ba7d-b11c02b457f2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2077462928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9f17d4-6b", "ovs_interfaceid": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "address": "fa:16:3e:02:bc:64", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa580be24-0d", "ovs_interfaceid": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34466bd1-f50e-4643-917f-512f81302b85", "address": "fa:16:3e:03:67:06", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34466bd1-f5", "ovs_interfaceid": "34466bd1-f50e-4643-917f-512f81302b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "address": "fa:16:3e:57:d9:ae", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443a2f48-d7", "ovs_interfaceid": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "address": "fa:16:3e:51:c5:b6", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d60ebb-51", "ovs_interfaceid": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "address": "fa:16:3e:e6:3a:a8", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5b1c1e-64", "ovs_interfaceid": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "afa68989-e42f-4b32-b4d4-319a6290df7d", "address": "fa:16:3e:c6:0a:e2", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa68989-e4", "ovs_interfaceid": "afa68989-e42f-4b32-b4d4-319a6290df7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Releasing lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Instance network_info: |[{"id": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "address": "fa:16:3e:71:02:8a", "network": {"id": "f50e74cc-b2a2-4c93-ba7d-b11c02b457f2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2077462928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9f17d4-6b", "ovs_interfaceid": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "address": "fa:16:3e:02:bc:64", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa580be24-0d", "ovs_interfaceid": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34466bd1-f50e-4643-917f-512f81302b85", "address": "fa:16:3e:03:67:06", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34466bd1-f5", "ovs_interfaceid": "34466bd1-f50e-4643-917f-512f81302b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "address": "fa:16:3e:57:d9:ae", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443a2f48-d7", "ovs_interfaceid": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "address": "fa:16:3e:51:c5:b6", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d60ebb-51", "ovs_interfaceid": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "address": "fa:16:3e:e6:3a:a8", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5b1c1e-64", "ovs_interfaceid": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "afa68989-e42f-4b32-b4d4-319a6290df7d", "address": "fa:16:3e:c6:0a:e2", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa68989-e4", "ovs_interfaceid": "afa68989-e42f-4b32-b4d4-319a6290df7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:18:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6257878e-a4c5-4384-a878-ac90dba2ece8 req-b2ebfec6-1617-417b-a61f-435a0b5ecb9a service nova] Acquired lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:18 user nova-compute[75071]: DEBUG nova.network.neutron [req-6257878e-a4c5-4384-a878-ac90dba2ece8 req-b2ebfec6-1617-417b-a61f-435a0b5ecb9a service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Refreshing network info cache for port afa68989-e42f-4b32-b4d4-319a6290df7d {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:19 user nova-compute[75071]: DEBUG nova.network.neutron [req-6257878e-a4c5-4384-a878-ac90dba2ece8 req-b2ebfec6-1617-417b-a61f-435a0b5ecb9a service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Updated VIF entry in instance network info cache for port afa68989-e42f-4b32-b4d4-319a6290df7d. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:18:19 user nova-compute[75071]: DEBUG nova.network.neutron [req-6257878e-a4c5-4384-a878-ac90dba2ece8 req-b2ebfec6-1617-417b-a61f-435a0b5ecb9a service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Updating instance_info_cache with network_info: [{"id": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "address": "fa:16:3e:71:02:8a", "network": {"id": "f50e74cc-b2a2-4c93-ba7d-b11c02b457f2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2077462928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9f17d4-6b", "ovs_interfaceid": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "address": "fa:16:3e:02:bc:64", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa580be24-0d", "ovs_interfaceid": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34466bd1-f50e-4643-917f-512f81302b85", "address": "fa:16:3e:03:67:06", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34466bd1-f5", "ovs_interfaceid": "34466bd1-f50e-4643-917f-512f81302b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "address": "fa:16:3e:57:d9:ae", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443a2f48-d7", "ovs_interfaceid": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "address": "fa:16:3e:51:c5:b6", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d60ebb-51", "ovs_interfaceid": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "address": "fa:16:3e:e6:3a:a8", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5b1c1e-64", "ovs_interfaceid": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "afa68989-e42f-4b32-b4d4-319a6290df7d", "address": "fa:16:3e:c6:0a:e2", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa68989-e4", "ovs_interfaceid": "afa68989-e42f-4b32-b4d4-319a6290df7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6257878e-a4c5-4384-a878-ac90dba2ece8 req-b2ebfec6-1617-417b-a61f-435a0b5ecb9a service nova] Releasing lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ebf72df8-3f68-403e-87bd-68dffe330816 req-8a42a847-331f-41bf-a829-faf5dc06ac39 service nova] Acquired lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:19 user nova-compute[75071]: DEBUG nova.network.neutron [req-ebf72df8-3f68-403e-87bd-68dffe330816 req-8a42a847-331f-41bf-a829-faf5dc06ac39 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Refreshing network info cache for port 5e5b1c1e-64c1-4da4-ab47-d1afd13843ac {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:19 user nova-compute[75071]: INFO nova.virt.block_device [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Booting with volume 868d4f51-285b-40ec-bcae-16f761d6bd95 at /dev/vdc
Dec 05 12:18:19 user nova-compute[75071]: DEBUG os_brick.utils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4378918c-a591-42fe-b0cb-5c8089c14e80]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a96372-3e35-44e0-8bc9-b2c9b0d4d9c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f553070-b539-44ac-b1b4-63853cf6bd32]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8de6c1-29f7-4a27-a05d-b7b545945d52]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG nova.network.neutron [req-ebf72df8-3f68-403e-87bd-68dffe330816 req-8a42a847-331f-41bf-a829-faf5dc06ac39 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Updated VIF entry in instance network info cache for port 5e5b1c1e-64c1-4da4-ab47-d1afd13843ac. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG nova.network.neutron [req-ebf72df8-3f68-403e-87bd-68dffe330816 req-8a42a847-331f-41bf-a829-faf5dc06ac39 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Updating instance_info_cache with network_info: [{"id": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "address": "fa:16:3e:71:02:8a", "network": {"id": "f50e74cc-b2a2-4c93-ba7d-b11c02b457f2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2077462928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9f17d4-6b", "ovs_interfaceid": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "address": "fa:16:3e:02:bc:64", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa580be24-0d", "ovs_interfaceid": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34466bd1-f50e-4643-917f-512f81302b85", "address": "fa:16:3e:03:67:06", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34466bd1-f5", "ovs_interfaceid": "34466bd1-f50e-4643-917f-512f81302b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "address": "fa:16:3e:57:d9:ae", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443a2f48-d7", "ovs_interfaceid": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "address": "fa:16:3e:51:c5:b6", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d60ebb-51", "ovs_interfaceid": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "address": "fa:16:3e:e6:3a:a8", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5b1c1e-64", "ovs_interfaceid": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "afa68989-e42f-4b32-b4d4-319a6290df7d", "address": "fa:16:3e:c6:0a:e2", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa68989-e4", "ovs_interfaceid": "afa68989-e42f-4b32-b4d4-319a6290df7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:18:20 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b632246-1027-4ed3-a555-b0572e47aa04]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG os_brick.utils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Updating existing volume attachment record: 150141be-b38c-431a-bb4b-c0a6815a6a5b {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ebf72df8-3f68-403e-87bd-68dffe330816 req-8a42a847-331f-41bf-a829-faf5dc06ac39 service nova] Releasing lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:20 user nova-compute[75071]: INFO nova.virt.block_device [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Booting with volume d04d142d-8f9a-4914-a89c-e2640edd770a at /dev/vdc
Dec 05 12:18:20 user nova-compute[75071]: DEBUG os_brick.utils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d001e347-7893-43cb-8f7e-bb23cd2fc094]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b66bae3-4a30-4f85-aced-090d65ad03a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b937984-b195-433b-85aa-e5fce00864bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a20c80-b731-49a4-b767-50ab02d1bc81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:18:20 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:18:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b7ba1c-0fc4-4253-a13f-484385f8ff08]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG os_brick.utils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:18:20 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Updating existing volume attachment record: b0f352f7-feb0-4263-b76a-41a68f9ee899 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:18:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:18:30 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Creating image(s)
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Ensure instance console log exists: /opt/stack/data/nova/instances/94aa75f8-6097-4cba-b567-112ec59efd8f/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Start _get_guest_xml network_info=[{"id": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "address": "fa:16:3e:71:02:8a", "network": {"id": "f50e74cc-b2a2-4c93-ba7d-b11c02b457f2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2077462928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9f17d4-6b", "ovs_interfaceid": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "address": "fa:16:3e:02:bc:64", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa580be24-0d", "ovs_interfaceid": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34466bd1-f50e-4643-917f-512f81302b85", "address": "fa:16:3e:03:67:06", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34466bd1-f5", "ovs_interfaceid": "34466bd1-f50e-4643-917f-512f81302b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "address": "fa:16:3e:57:d9:ae", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443a2f48-d7", "ovs_interfaceid": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "address": "fa:16:3e:51:c5:b6", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d60ebb-51", "ovs_interfaceid": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "address": "fa:16:3e:e6:3a:a8", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5b1c1e-64", "ovs_interfaceid": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "afa68989-e42f-4b32-b4d4-319a6290df7d", "address": "fa:16:3e:c6:0a:e2", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa68989-e4", "ovs_interfaceid": "afa68989-e42f-4b32-b4d4-319a6290df7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '801e33dd-e4ed-4297-9dd2-21707db50535', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUylKfSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94aa75f8-6097-4cba-b567-112ec59efd8f', 'attached_at': '', 'detached_at': '', 'volume_id': '68062df8-0269-41ba-90ac-c150b267890e', 'serial': '68062df8-0269-41ba-90ac-c150b267890e'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None}, {'boot_index': 1, 'attachment_id': '04d59458-8e8d-4eb3-bcd6-19da1fb4c8e0', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpWQFyAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94aa75f8-6097-4cba-b567-112ec59efd8f', 'attached_at': '', 'detached_at': '', 'volume_id': '33ff0db5-7a52-4c1f-80cd-63bc8c746bc6', 'serial': '33ff0db5-7a52-4c1f-80cd-63bc8c746bc6'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None}, {'boot_index': 2, 'attachment_id': '150141be-b38c-431a-bb4b-c0a6815a6a5b', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIumDFar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94aa75f8-6097-4cba-b567-112ec59efd8f', 'attached_at': '', 'detached_at': '', 'volume_id': '868d4f51-285b-40ec-bcae-16f761d6bd95', 'serial': '868d4f51-285b-40ec-bcae-16f761d6bd95'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:18:30 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:18:30 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUylKfSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:18:30 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:18:30 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:18:30 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3cb962-03d1-4ac8-99a1-100984c505ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:18:30 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[feda19c1-68a0-467a-821b-00ac656403ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e] added
Dec 05 12:18:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4ba8e2-761a-49aa-8457-f610eeae9667]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[761cb319-427e-4206-b32c-d35edfe0f821]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tUylKfSi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tUylKfSi" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da2cf83-a031-47b3-b5e6-889a75b3677f]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tUylKfSi'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2377aba0-a84d-49c9-a2bd-3c4dc3090071]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d66451b-3e89-4e42-8500-5e9d80a9f0a1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[22509cb6-b8e0-43cc-8b69-a018e947ebcd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e, portal: 172.16.0.220,3260]
Dec 05 12:18:30 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e, portal: 172.16.0.220,3260] successful.
Dec 05 12:18:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8ffc2a-d5f6-43e1-81e3-e77d10d8f41d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a8de51-568e-42f5-b796-6534ffd614c0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:30 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:30 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dccda2-3624-48f2-8ed9-22d95b0f56b9]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUylKfSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:18:30 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Creating image(s)
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Ensure instance console log exists: /opt/stack/data/nova/instances/58e955b6-be0c-41bc-9a39-4eeec3b694a1/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Start _get_guest_xml network_info=[{"id": "21361178-8b0b-43fb-9381-37e603f8d993", "address": "fa:16:3e:86:db:af", "network": {"id": "150ec31a-5cc2-485a-8ed6-07bd26173225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-441693172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21361178-8b", "ovs_interfaceid": "21361178-8b0b-43fb-9381-37e603f8d993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc837761-a388-414b-9c08-8835b4e255c7", "address": "fa:16:3e:bd:f8:40", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc837761-a3", "ovs_interfaceid": "cc837761-a388-414b-9c08-8835b4e255c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "deb82347-819f-40f5-bc84-b1562c29af71", "address": "fa:16:3e:16:d6:e0", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb82347-81", "ovs_interfaceid": "deb82347-819f-40f5-bc84-b1562c29af71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "30d569c6-052c-487b-99d8-142bed67ae7e", "address": "fa:16:3e:8f:44:7e", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d569c6-05", "ovs_interfaceid": "30d569c6-052c-487b-99d8-142bed67ae7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "address": "fa:16:3e:3f:fb:3b", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c5a6d6-90", "ovs_interfaceid": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "address": "fa:16:3e:22:b6:fc", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e645b-e3", "ovs_interfaceid": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "address": "fa:16:3e:eb:4e:30", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eadd24f-48", "ovs_interfaceid": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'a42daaef-1835-4b19-aa71-e297b514de5e', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjykqYeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58e955b6-be0c-41bc-9a39-4eeec3b694a1', 'attached_at': '', 'detached_at': '', 'volume_id': '9d04025a-0b32-47ab-ab5a-75a8bd43a310', 'serial': '9d04025a-0b32-47ab-ab5a-75a8bd43a310'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None}, {'boot_index': 1, 'attachment_id': 'e756de08-b796-43e5-bea9-c7cfe1aaddb1', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQdKTCuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58e955b6-be0c-41bc-9a39-4eeec3b694a1', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4a92957-3718-450a-a2d7-c2057464b97b', 'serial': 'b4a92957-3718-450a-a2d7-c2057464b97b'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None}, {'boot_index': 2, 'attachment_id': 'b0f352f7-feb0-4263-b76a-41a68f9ee899', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcWIyLFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58e955b6-be0c-41bc-9a39-4eeec3b694a1', 'attached_at': '', 'detached_at': '', 'volume_id': 'd04d142d-8f9a-4914-a89c-e2640edd770a', 'serial': 'd04d142d-8f9a-4914-a89c-e2640edd770a'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:18:30 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:18:30 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:18:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjykqYeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:18:31 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:18:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '26561393466636439', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561393466636439', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.823s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:18:31 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:18:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:18:31 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1156ca6e-4470-4ecc-a2bc-a0699145868d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:18:31 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpWQFyAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:18:31 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:18:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8889a249-d598-4f6f-bde7-3d0c9372777f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310] added
Dec 05 12:18:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[12451d5c-877b-45c6-9dc4-41aebdd73ffe]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7172066a-6bcf-45d6-ac9b-698fd11a94cb]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VjykqYeG {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VjykqYeG" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd24bbc9-211d-4143-b868-0dfffe83c5db]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VjykqYeG'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c250f7-1e97-4702-9588-f3cfe648869e]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb7dc6a-2c20-4eee-9f7e-208aba2603e5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:31 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:31 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:18:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --login" returned: 0 in 1.058s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0589dd3-45f9-4134-9253-909d6ed73f63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310, portal: 172.16.0.220,3260]
Dec 05 12:18:33 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310, portal: 172.16.0.220,3260] successful.
Dec 05 12:18:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[386413ea-1ead-4ff9-8506-1593b04dfe6e]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1849c708-c59d-4e34-bb20-62dcfe5a312f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:33 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:33 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:33 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:33 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.263s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e529a9af-2919-4b8a-9797-a5380df592f0]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjykqYeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:18:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.300s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] <== connect_volume: return (3123ms) {'type': 'block', 'scsi_wwn': '23163326537306162', 'path': '/dev/sdd'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163326537306162', 'path': '/dev/sdd'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.276s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:18:34 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:18:34 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eb4c88-9228-4d14-9280-3470f648b920]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:18:34 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQdKTCuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:18:34 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a470e4-0df1-4615-abc7-aed6203d8f3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6] added
Dec 05 12:18:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d20ed4-3480-4478-9025-312cc3ff5ee8]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5aede20-6304-4650-a26c-08afda44efef]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kpWQFyAV {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kpWQFyAV" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf63e68-2692-4af5-8754-de59e4383db8]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kpWQFyAV'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de9b571-0780-4f2f-abde-35f6ce894839]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad138d22-affd-4e40-8970-51cf94f550c0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:34 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:34 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:34 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:34 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adff075-7e65-408b-b119-d831bda3df14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6, portal: 172.16.0.220,3260]
Dec 05 12:18:34 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6, portal: 172.16.0.220,3260] successful.
Dec 05 12:18:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.087s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2603a3ed-e2dd-4b42-a4af-de42ee2e27c4]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3adbe1-4717-4e62-89b9-7fb91518d4ea]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:34 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:34 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:34 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:18:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:34 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:34 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:34 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:18:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33b4e26-e97f-4b16-aa68-14dd7da26e82]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:18:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpWQFyAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] <== connect_volume: return (3705ms) {'type': 'block', 'scsi_wwn': '26236306364323966', 'path': '/dev/sde'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236306364323966', 'path': '/dev/sde'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.398s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:18:35 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:18:35 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0a817b-8589-49d5-bd48-f07e00b1e220]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:18:35 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIumDFar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:18:35 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e2f764-99ab-4f2c-b9cf-0abfe52b9f65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b] added
Dec 05 12:18:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[651aa5d3-efbf-40bd-9019-3d0d2a94c703]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2159f256-94aa-45df-b0cb-84195802568a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tQdKTCuW {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tQdKTCuW" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55bde27-7720-4ca4-8612-a03017c5ae1e]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tQdKTCuW'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[29019c89-6476-4c40-80f8-96e3c46b72dd]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afc4a33-78b7-48e6-9cbb-0e3939942bf2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:35 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:35 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:35 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:18:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:35 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:35 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:35 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:18:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e364ce33-7ce0-4d45-a1e1-4c30d5c883b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b, portal: 172.16.0.220,3260]
Dec 05 12:18:35 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b, portal: 172.16.0.220,3260] successful.
Dec 05 12:18:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[638455e4-b2b7-49f9-b1bc-579351667872]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8300f2b8-1ca6-4f86-89cf-b8094d497f86]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:35 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:35 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:35 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:18:35 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:18:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:35 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:35 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:35 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:18:35 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:18:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0876b6-71b2-4fc1-acac-d35f37baeef6]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:18:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQdKTCuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] <== connect_volume: return (2732ms) {'type': 'block', 'scsi_wwn': '23866323563353930', 'path': '/dev/sdf'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866323563353930', 'path': '/dev/sdf'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.290s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:18:36 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:18:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:18:36 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:18:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6972104-6265-4b06-b4ff-04d773c031a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:18:36 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcWIyLFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:18:36 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:18:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[120a2742-b94b-43e1-a240-27eef4a3127b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95] added
Dec 05 12:18:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0505126-286f-4275-bf67-47503c0b67f6]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[89045a13-27f2-4cc0-901c-51eead452cc0]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CIumDFar {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CIumDFar" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e439b036-a496-4c32-84fb-2c835d5dd572]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CIumDFar'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8456a55b-6ae3-40d5-a1c4-465aa2d0377c]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1feec916-2b88-45f5-84c3-bee00831f831]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:37 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:37 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:37 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:18:37 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:18:37 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:37 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:37 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:37 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:18:37 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:18:37 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e802285-9ace-4c05-a4b7-e826fc4ece72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95, portal: 172.16.0.220,3260]
Dec 05 12:18:37 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95, portal: 172.16.0.220,3260] successful.
Dec 05 12:18:37 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b650c833-26a4-4cfd-86cf-4d2906800f4a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[db100149-ce1e-456e-8bdc-d9b7b072efb9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:37 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:37 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:37 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:18:37 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:18:37 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:18:37 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:37 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:37 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:37 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:18:37 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:18:37 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:18:37 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf787c6d-598a-4b8d-b263-6c7f3607758a]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIumDFar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] <== connect_volume: return (2698ms) {'type': 'block', 'scsi_wwn': '23133653930643732', 'path': '/dev/sdg'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133653930643732', 'path': '/dev/sdg'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.370s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:18:38 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:18:38 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[95847ab7-1309-4cd8-a9c3-c21a1b952065]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:18:38 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "address": "fa:16:3e:71:02:8a", "network": {"id": "f50e74cc-b2a2-4c93-ba7d-b11c02b457f2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2077462928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9f17d4-6b", "ovs_interfaceid": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "address": "fa:16:3e:71:02:8a", "network": {"id": "f50e74cc-b2a2-4c93-ba7d-b11c02b457f2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2077462928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9f17d4-6b", "ovs_interfaceid": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:02:8a,bridge_name='br-int',has_traffic_filtering=True,id=0d9f17d4-6b21-460d-9a8c-47270cf8a163,network=Network(f50e74cc-b2a2-4c93-ba7d-b11c02b457f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9f17d4-6b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "address": "fa:16:3e:02:bc:64", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa580be24-0d", "ovs_interfaceid": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "address": "fa:16:3e:02:bc:64", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa580be24-0d", "ovs_interfaceid": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:bc:64,bridge_name='br-int',has_traffic_filtering=True,id=a580be24-0d0f-4cf1-8abc-2b9514de0cbf,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa580be24-0d') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34466bd1-f50e-4643-917f-512f81302b85", "address": "fa:16:3e:03:67:06", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34466bd1-f5", "ovs_interfaceid": "34466bd1-f50e-4643-917f-512f81302b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "34466bd1-f50e-4643-917f-512f81302b85", "address": "fa:16:3e:03:67:06", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34466bd1-f5", "ovs_interfaceid": "34466bd1-f50e-4643-917f-512f81302b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:67:06,bridge_name='br-int',has_traffic_filtering=True,id=34466bd1-f50e-4643-917f-512f81302b85,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34466bd1-f5') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "address": "fa:16:3e:57:d9:ae", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443a2f48-d7", "ovs_interfaceid": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "address": "fa:16:3e:57:d9:ae", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443a2f48-d7", "ovs_interfaceid": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:d9:ae,bridge_name='br-int',has_traffic_filtering=True,id=443a2f48-d7e4-4368-986d-53e5a9705d3e,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443a2f48-d7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "address": "fa:16:3e:51:c5:b6", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d60ebb-51", "ovs_interfaceid": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "address": "fa:16:3e:51:c5:b6", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d60ebb-51", "ovs_interfaceid": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:c5:b6,bridge_name='br-int',has_traffic_filtering=True,id=19d60ebb-5100-4ba5-9fe7-d9b246e4971d,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d60ebb-51') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "address": "fa:16:3e:e6:3a:a8", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5b1c1e-64", "ovs_interfaceid": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "address": "fa:16:3e:e6:3a:a8", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5b1c1e-64", "ovs_interfaceid": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:3a:a8,bridge_name='br-int',has_traffic_filtering=True,id=5e5b1c1e-64c1-4da4-ab47-d1afd13843ac,network=Network(f60d4f97-646c-4b6b-88d3-8096377d4dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5b1c1e-64') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afa68989-e42f-4b32-b4d4-319a6290df7d", "address": "fa:16:3e:c6:0a:e2", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa68989-e4", "ovs_interfaceid": "afa68989-e42f-4b32-b4d4-319a6290df7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "afa68989-e42f-4b32-b4d4-319a6290df7d", "address": "fa:16:3e:c6:0a:e2", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa68989-e4", "ovs_interfaceid": "afa68989-e42f-4b32-b4d4-319a6290df7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:0a:e2,bridge_name='br-int',has_traffic_filtering=True,id=afa68989-e42f-4b32-b4d4-319a6290df7d,network=Network(f60d4f97-646c-4b6b-88d3-8096377d4dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa68989-e4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.objects.instance [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lazy-loading 'pci_devices' on Instance uuid 94aa75f8-6097-4cba-b567-112ec59efd8f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41d2d74-8030-47e1-ba67-8794cf698137]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a] added
Dec 05 12:18:38 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:18:38 user nova-compute[75071]:   <uuid>94aa75f8-6097-4cba-b567-112ec59efd8f</uuid>
Dec 05 12:18:38 user nova-compute[75071]:   <name>instance-0000000a</name>
Dec 05 12:18:38 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:18:38 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:18:38 user nova-compute[75071]:   <metadata>
Dec 05 12:18:38 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:18:38 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:18:38 user nova-compute[75071]:       <nova:name>tempest-device-tagging-server-1040881087</nova:name>
Dec 05 12:18:38 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:18:30</nova:creationTime>
Dec 05 12:18:38 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:18:38 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:18:38 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:18:38 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:18:38 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:18:38 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:18:38 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:18:38 user nova-compute[75071]:       <nova:owner>
Dec 05 12:18:38 user nova-compute[75071]:         <nova:user uuid="52bf9c24f2bb4bac8ac8a8918227708f">tempest-TaggedBootDevicesTest-2001589583-project-member</nova:user>
Dec 05 12:18:38 user nova-compute[75071]:         <nova:project uuid="d9df1de3e82e4fcc801ea3a8dcb1455d">tempest-TaggedBootDevicesTest-2001589583</nova:project>
Dec 05 12:18:38 user nova-compute[75071]:       </nova:owner>
Dec 05 12:18:38 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:18:38 user nova-compute[75071]:       <nova:ports>
Dec 05 12:18:38 user nova-compute[75071]:         <nova:port uuid="0d9f17d4-6b21-460d-9a8c-47270cf8a163">
Dec 05 12:18:38 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 05 12:18:38 user nova-compute[75071]:         </nova:port>
Dec 05 12:18:38 user nova-compute[75071]:         <nova:port uuid="a580be24-0d0f-4cf1-8abc-2b9514de0cbf">
Dec 05 12:18:38 user nova-compute[75071]:           <nova:ip type="fixed" address="10.1.1.40" ipVersion="4"/>
Dec 05 12:18:38 user nova-compute[75071]:         </nova:port>
Dec 05 12:18:38 user nova-compute[75071]:         <nova:port uuid="34466bd1-f50e-4643-917f-512f81302b85">
Dec 05 12:18:38 user nova-compute[75071]:           <nova:ip type="fixed" address="10.1.1.147" ipVersion="4"/>
Dec 05 12:18:38 user nova-compute[75071]:         </nova:port>
Dec 05 12:18:38 user nova-compute[75071]:         <nova:port uuid="443a2f48-d7e4-4368-986d-53e5a9705d3e">
Dec 05 12:18:38 user nova-compute[75071]:           <nova:ip type="fixed" address="10.1.1.242" ipVersion="4"/>
Dec 05 12:18:38 user nova-compute[75071]:         </nova:port>
Dec 05 12:18:38 user nova-compute[75071]:         <nova:port uuid="19d60ebb-5100-4ba5-9fe7-d9b246e4971d">
Dec 05 12:18:38 user nova-compute[75071]:           <nova:ip type="fixed" address="10.1.1.9" ipVersion="4"/>
Dec 05 12:18:38 user nova-compute[75071]:         </nova:port>
Dec 05 12:18:38 user nova-compute[75071]:         <nova:port uuid="5e5b1c1e-64c1-4da4-ab47-d1afd13843ac">
Dec 05 12:18:38 user nova-compute[75071]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Dec 05 12:18:38 user nova-compute[75071]:         </nova:port>
Dec 05 12:18:38 user nova-compute[75071]:         <nova:port uuid="afa68989-e42f-4b32-b4d4-319a6290df7d">
Dec 05 12:18:38 user nova-compute[75071]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Dec 05 12:18:38 user nova-compute[75071]:         </nova:port>
Dec 05 12:18:38 user nova-compute[75071]:       </nova:ports>
Dec 05 12:18:38 user nova-compute[75071]:     </nova:instance>
Dec 05 12:18:38 user nova-compute[75071]:   </metadata>
Dec 05 12:18:38 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:18:38 user nova-compute[75071]:     <system>
Dec 05 12:18:38 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:18:38 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:18:38 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:18:38 user nova-compute[75071]:       <entry name="serial">94aa75f8-6097-4cba-b567-112ec59efd8f</entry>
Dec 05 12:18:38 user nova-compute[75071]:       <entry name="uuid">94aa75f8-6097-4cba-b567-112ec59efd8f</entry>
Dec 05 12:18:38 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:18:38 user nova-compute[75071]:     </system>
Dec 05 12:18:38 user nova-compute[75071]:   </sysinfo>
Dec 05 12:18:38 user nova-compute[75071]:   <os>
Dec 05 12:18:38 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:18:38 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:18:38 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:18:38 user nova-compute[75071]:   </os>
Dec 05 12:18:38 user nova-compute[75071]:   <features>
Dec 05 12:18:38 user nova-compute[75071]:     <acpi/>
Dec 05 12:18:38 user nova-compute[75071]:     <apic/>
Dec 05 12:18:38 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:18:38 user nova-compute[75071]:   </features>
Dec 05 12:18:38 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:18:38 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:18:38 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:18:38 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:18:38 user nova-compute[75071]:   </clock>
Dec 05 12:18:38 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:18:38 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:18:38 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:18:38 user nova-compute[75071]:   </cpu>
Dec 05 12:18:38 user nova-compute[75071]:   <devices>
Dec 05 12:18:38 user nova-compute[75071]:     <disk type="file" device="cdrom">
Dec 05 12:18:38 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none"/>
Dec 05 12:18:38 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/94aa75f8-6097-4cba-b567-112ec59efd8f/disk.config"/>
Dec 05 12:18:38 user nova-compute[75071]:       <target dev="hda" bus="ide"/>
Dec 05 12:18:38 user nova-compute[75071]:     </disk>
Dec 05 12:18:38 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:18:38 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:18:38 user nova-compute[75071]:       <source dev="/dev/sdc"/>
Dec 05 12:18:38 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:18:38 user nova-compute[75071]:       <serial>68062df8-0269-41ba-90ac-c150b267890e</serial>
Dec 05 12:18:38 user nova-compute[75071]:     </disk>
Dec 05 12:18:38 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:18:38 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:18:38 user nova-compute[75071]:       <source dev="/dev/sde"/>
Dec 05 12:18:38 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Dec 05 12:18:38 user nova-compute[75071]:       <serial>33ff0db5-7a52-4c1f-80cd-63bc8c746bc6</serial>
Dec 05 12:18:38 user nova-compute[75071]:     </disk>
Dec 05 12:18:38 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:18:38 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:18:38 user nova-compute[75071]:       <source dev="/dev/sdg"/>
Dec 05 12:18:38 user nova-compute[75071]:       <target dev="vdc" bus="virtio"/>
Dec 05 12:18:38 user nova-compute[75071]:       <serial>868d4f51-285b-40ec-bcae-16f761d6bd95</serial>
Dec 05 12:18:38 user nova-compute[75071]:     </disk>
Dec 05 12:18:38 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:18:38 user nova-compute[75071]:       <mac address="fa:16:3e:71:02:8a"/>
Dec 05 12:18:38 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:18:38 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:18:38 user nova-compute[75071]:       <target dev="tap0d9f17d4-6b"/>
Dec 05 12:18:38 user nova-compute[75071]:     </interface>
Dec 05 12:18:38 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:18:38 user nova-compute[75071]:       <mac address="fa:16:3e:02:bc:64"/>
Dec 05 12:18:38 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:18:38 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:18:38 user nova-compute[75071]:       <target dev="tapa580be24-0d"/>
Dec 05 12:18:38 user nova-compute[75071]:     </interface>
Dec 05 12:18:38 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:18:38 user nova-compute[75071]:       <mac address="fa:16:3e:03:67:06"/>
Dec 05 12:18:38 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:18:38 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:18:38 user nova-compute[75071]:       <target dev="tap34466bd1-f5"/>
Dec 05 12:18:38 user nova-compute[75071]:     </interface>
Dec 05 12:18:38 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:18:38 user nova-compute[75071]:       <mac address="fa:16:3e:57:d9:ae"/>
Dec 05 12:18:38 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:18:38 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:18:38 user nova-compute[75071]:       <target dev="tap443a2f48-d7"/>
Dec 05 12:18:38 user nova-compute[75071]:     </interface>
Dec 05 12:18:38 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:18:38 user nova-compute[75071]:       <mac address="fa:16:3e:51:c5:b6"/>
Dec 05 12:18:38 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:18:38 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:18:38 user nova-compute[75071]:       <target dev="tap19d60ebb-51"/>
Dec 05 12:18:38 user nova-compute[75071]:     </interface>
Dec 05 12:18:38 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:18:38 user nova-compute[75071]:       <mac address="fa:16:3e:e6:3a:a8"/>
Dec 05 12:18:38 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:18:38 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:18:38 user nova-compute[75071]:       <target dev="tap5e5b1c1e-64"/>
Dec 05 12:18:38 user nova-compute[75071]:     </interface>
Dec 05 12:18:38 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:18:38 user nova-compute[75071]:       <mac address="fa:16:3e:c6:0a:e2"/>
Dec 05 12:18:38 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:18:38 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:18:38 user nova-compute[75071]:       <target dev="tapafa68989-e4"/>
Dec 05 12:18:38 user nova-compute[75071]:     </interface>
Dec 05 12:18:38 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:18:38 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/94aa75f8-6097-4cba-b567-112ec59efd8f/console.log" append="off"/>
Dec 05 12:18:38 user nova-compute[75071]:     </serial>
Dec 05 12:18:38 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:18:38 user nova-compute[75071]:     <video>
Dec 05 12:18:38 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:18:38 user nova-compute[75071]:     </video>
Dec 05 12:18:38 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:18:38 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:18:38 user nova-compute[75071]:     </rng>
Dec 05 12:18:38 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:18:38 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:18:38 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:18:38 user nova-compute[75071]:     </memballoon>
Dec 05 12:18:38 user nova-compute[75071]:   </devices>
Dec 05 12:18:38 user nova-compute[75071]: </domain>
Dec 05 12:18:38 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "address": "fa:16:3e:71:02:8a", "network": {"id": "f50e74cc-b2a2-4c93-ba7d-b11c02b457f2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2077462928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9f17d4-6b", "ovs_interfaceid": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "address": "fa:16:3e:71:02:8a", "network": {"id": "f50e74cc-b2a2-4c93-ba7d-b11c02b457f2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2077462928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9f17d4-6b", "ovs_interfaceid": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:02:8a,bridge_name='br-int',has_traffic_filtering=True,id=0d9f17d4-6b21-460d-9a8c-47270cf8a163,network=Network(f50e74cc-b2a2-4c93-ba7d-b11c02b457f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9f17d4-6b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:02:8a,bridge_name='br-int',has_traffic_filtering=True,id=0d9f17d4-6b21-460d-9a8c-47270cf8a163,network=Network(f50e74cc-b2a2-4c93-ba7d-b11c02b457f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9f17d4-6b') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c214f14b-9770-5d72-a8a6-256db0e04252', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[86722da3-1789-47c6-8e6d-7f6589c03a2f]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d9f17d4-6b, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d9f17d4-6b, col_values=(('qos', UUID('b52cfff7-d53e-4592-b837-d06fefc36797')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d9f17d4-6b, col_values=(('external_ids', {'iface-id': '0d9f17d4-6b21-460d-9a8c-47270cf8a163', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:02:8a', 'vm-uuid': '94aa75f8-6097-4cba-b567-112ec59efd8f'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[746c2e4c-47a2-4d28-b043-b632ea65ceb2]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XcWIyLFk {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: INFO os_vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:02:8a,bridge_name='br-int',has_traffic_filtering=True,id=0d9f17d4-6b21-460d-9a8c-47270cf8a163,network=Network(f50e74cc-b2a2-4c93-ba7d-b11c02b457f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9f17d4-6b')
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "address": "fa:16:3e:02:bc:64", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa580be24-0d", "ovs_interfaceid": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "address": "fa:16:3e:02:bc:64", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa580be24-0d", "ovs_interfaceid": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:bc:64,bridge_name='br-int',has_traffic_filtering=True,id=a580be24-0d0f-4cf1-8abc-2b9514de0cbf,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa580be24-0d') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:bc:64,bridge_name='br-int',has_traffic_filtering=True,id=a580be24-0d0f-4cf1-8abc-2b9514de0cbf,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa580be24-0d') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3002a35-2ca7-578f-bc8e-43d2b363e14a', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XcWIyLFk" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3ad97e-8686-42ce-802a-e6571dfdffbb]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XcWIyLFk'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa580be24-0d, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa580be24-0d, col_values=(('qos', UUID('fce5a915-60cb-41fa-ace5-56e655cf89bb')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa580be24-0d, col_values=(('external_ids', {'iface-id': 'a580be24-0d0f-4cf1-8abc-2b9514de0cbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:bc:64', 'vm-uuid': '94aa75f8-6097-4cba-b567-112ec59efd8f'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5eb2ba7-e7ab-4256-96bd-3ee775f4e2ca]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: INFO os_vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:bc:64,bridge_name='br-int',has_traffic_filtering=True,id=a580be24-0d0f-4cf1-8abc-2b9514de0cbf,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa580be24-0d')
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34466bd1-f50e-4643-917f-512f81302b85", "address": "fa:16:3e:03:67:06", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34466bd1-f5", "ovs_interfaceid": "34466bd1-f50e-4643-917f-512f81302b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "34466bd1-f50e-4643-917f-512f81302b85", "address": "fa:16:3e:03:67:06", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34466bd1-f5", "ovs_interfaceid": "34466bd1-f50e-4643-917f-512f81302b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:67:06,bridge_name='br-int',has_traffic_filtering=True,id=34466bd1-f50e-4643-917f-512f81302b85,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34466bd1-f5') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:67:06,bridge_name='br-int',has_traffic_filtering=True,id=34466bd1-f50e-4643-917f-512f81302b85,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34466bd1-f5') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5e9791e-a9a4-5d27-9ae0-405ec4b16151', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cbaec4-1fc5-4b5e-a2d8-ab47ede4ce3a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:18:38 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:18:38 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap34466bd1-f5, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap34466bd1-f5, col_values=(('qos', UUID('b779e1f1-3f3d-451f-9cd8-5ccc5366070a')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap34466bd1-f5, col_values=(('external_ids', {'iface-id': '34466bd1-f50e-4643-917f-512f81302b85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:67:06', 'vm-uuid': '94aa75f8-6097-4cba-b567-112ec59efd8f'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee0ade1-b699-4189-8560-fb30c2e7b974]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a, portal: 172.16.0.220,3260]
Dec 05 12:18:38 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a, portal: 172.16.0.220,3260] successful.
Dec 05 12:18:38 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: INFO os_vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:67:06,bridge_name='br-int',has_traffic_filtering=True,id=34466bd1-f50e-4643-917f-512f81302b85,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34466bd1-f5')
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "address": "fa:16:3e:57:d9:ae", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443a2f48-d7", "ovs_interfaceid": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "address": "fa:16:3e:57:d9:ae", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443a2f48-d7", "ovs_interfaceid": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:d9:ae,bridge_name='br-int',has_traffic_filtering=True,id=443a2f48-d7e4-4368-986d-53e5a9705d3e,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443a2f48-d7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d9:ae,bridge_name='br-int',has_traffic_filtering=True,id=443a2f48-d7e4-4368-986d-53e5a9705d3e,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443a2f48-d7') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93474166-5811-5beb-84d5-6517fa9d45f2', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[169f4af3-66df-49b0-b2f5-de0328dcd25d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8bbcb5-ab7f-45b7-86bd-245be6797243]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:18:38 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:18:38 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:18:38 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap443a2f48-d7, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap443a2f48-d7, col_values=(('qos', UUID('3ae1dcaa-6e34-498c-8052-e2456b7265a2')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap443a2f48-d7, col_values=(('external_ids', {'iface-id': '443a2f48-d7e4-4368-986d-53e5a9705d3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:d9:ae', 'vm-uuid': '94aa75f8-6097-4cba-b567-112ec59efd8f'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[225fec60-f8d3-47af-82bc-2cdf9ffc1557]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcWIyLFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: INFO os_vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d9:ae,bridge_name='br-int',has_traffic_filtering=True,id=443a2f48-d7e4-4368-986d-53e5a9705d3e,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443a2f48-d7')
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "address": "fa:16:3e:51:c5:b6", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d60ebb-51", "ovs_interfaceid": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "address": "fa:16:3e:51:c5:b6", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d60ebb-51", "ovs_interfaceid": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:c5:b6,bridge_name='br-int',has_traffic_filtering=True,id=19d60ebb-5100-4ba5-9fe7-d9b246e4971d,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d60ebb-51') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:c5:b6,bridge_name='br-int',has_traffic_filtering=True,id=19d60ebb-5100-4ba5-9fe7-d9b246e4971d,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d60ebb-51') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '257ff5b2-b6c5-5148-8d9b-16a8b4f6b381', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19d60ebb-51, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19d60ebb-51, col_values=(('qos', UUID('fe5636cc-dea2-4e06-9a2a-254ea0e111f8')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19d60ebb-51, col_values=(('external_ids', {'iface-id': '19d60ebb-5100-4ba5-9fe7-d9b246e4971d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:c5:b6', 'vm-uuid': '94aa75f8-6097-4cba-b567-112ec59efd8f'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: INFO os_vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:c5:b6,bridge_name='br-int',has_traffic_filtering=True,id=19d60ebb-5100-4ba5-9fe7-d9b246e4971d,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d60ebb-51')
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "address": "fa:16:3e:e6:3a:a8", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5b1c1e-64", "ovs_interfaceid": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "address": "fa:16:3e:e6:3a:a8", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5b1c1e-64", "ovs_interfaceid": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:3a:a8,bridge_name='br-int',has_traffic_filtering=True,id=5e5b1c1e-64c1-4da4-ab47-d1afd13843ac,network=Network(f60d4f97-646c-4b6b-88d3-8096377d4dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5b1c1e-64') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG os_vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:3a:a8,bridge_name='br-int',has_traffic_filtering=True,id=5e5b1c1e-64c1-4da4-ab47-d1afd13843ac,network=Network(f60d4f97-646c-4b6b-88d3-8096377d4dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5b1c1e-64') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf2c3e98-34af-5dcc-96ef-59b4dde79789', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e5b1c1e-64, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5e5b1c1e-64, col_values=(('qos', UUID('ffc9d8ee-8489-47fb-b016-5d26a66874c6')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5e5b1c1e-64, col_values=(('external_ids', {'iface-id': '5e5b1c1e-64c1-4da4-ab47-d1afd13843ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:3a:a8', 'vm-uuid': '94aa75f8-6097-4cba-b567-112ec59efd8f'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:18:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:39 user nova-compute[75071]: INFO os_vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:3a:a8,bridge_name='br-int',has_traffic_filtering=True,id=5e5b1c1e-64c1-4da4-ab47-d1afd13843ac,network=Network(f60d4f97-646c-4b6b-88d3-8096377d4dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5b1c1e-64')
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afa68989-e42f-4b32-b4d4-319a6290df7d", "address": "fa:16:3e:c6:0a:e2", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa68989-e4", "ovs_interfaceid": "afa68989-e42f-4b32-b4d4-319a6290df7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "afa68989-e42f-4b32-b4d4-319a6290df7d", "address": "fa:16:3e:c6:0a:e2", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa68989-e4", "ovs_interfaceid": "afa68989-e42f-4b32-b4d4-319a6290df7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:0a:e2,bridge_name='br-int',has_traffic_filtering=True,id=afa68989-e42f-4b32-b4d4-319a6290df7d,network=Network(f60d4f97-646c-4b6b-88d3-8096377d4dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa68989-e4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG os_vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:0a:e2,bridge_name='br-int',has_traffic_filtering=True,id=afa68989-e42f-4b32-b4d4-319a6290df7d,network=Network(f60d4f97-646c-4b6b-88d3-8096377d4dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa68989-e4') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e8d73a6-aa11-5be8-b07c-edd68f9b1971', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafa68989-e4, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapafa68989-e4, col_values=(('qos', UUID('bb24a895-46ca-47b1-903f-6bb0810d733e')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapafa68989-e4, col_values=(('external_ids', {'iface-id': 'afa68989-e42f-4b32-b4d4-319a6290df7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:0a:e2', 'vm-uuid': '94aa75f8-6097-4cba-b567-112ec59efd8f'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquiring lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:39 user nova-compute[75071]: INFO os_vif [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:0a:e2,bridge_name='br-int',has_traffic_filtering=True,id=afa68989-e42f-4b32-b4d4-319a6290df7d,network=Network(f60d4f97-646c-4b6b-88d3-8096377d4dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa68989-e4')
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:18:39 user nova-compute[75071]: INFO nova.compute.claims [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Claim successful on node user
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] No BDM found with device name hda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] No VIF found with MAC fa:16:3e:71:02:8a, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] No VIF found with MAC fa:16:3e:51:c5:b6, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:18:39 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Using config drive
Dec 05 12:18:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:39 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Creating config drive at /opt/stack/data/nova/instances/94aa75f8-6097-4cba-b567-112ec59efd8f/disk.config
Dec 05 12:18:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/94aa75f8-6097-4cba-b567-112ec59efd8f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7n7xfb95 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/94aa75f8-6097-4cba-b567-112ec59efd8f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7n7xfb95" returned: 0 in 0.061s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] <== connect_volume: return (2751ms) {'type': 'block', 'scsi_wwn': '23234626639393936', 'path': '/dev/sdh'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234626639393936', 'path': '/dev/sdh'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21361178-8b0b-43fb-9381-37e603f8d993", "address": "fa:16:3e:86:db:af", "network": {"id": "150ec31a-5cc2-485a-8ed6-07bd26173225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-441693172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21361178-8b", "ovs_interfaceid": "21361178-8b0b-43fb-9381-37e603f8d993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "21361178-8b0b-43fb-9381-37e603f8d993", "address": "fa:16:3e:86:db:af", "network": {"id": "150ec31a-5cc2-485a-8ed6-07bd26173225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-441693172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21361178-8b", "ovs_interfaceid": "21361178-8b0b-43fb-9381-37e603f8d993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:db:af,bridge_name='br-int',has_traffic_filtering=True,id=21361178-8b0b-43fb-9381-37e603f8d993,network=Network(150ec31a-5cc2-485a-8ed6-07bd26173225),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21361178-8b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc837761-a388-414b-9c08-8835b4e255c7", "address": "fa:16:3e:bd:f8:40", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc837761-a3", "ovs_interfaceid": "cc837761-a388-414b-9c08-8835b4e255c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "cc837761-a388-414b-9c08-8835b4e255c7", "address": "fa:16:3e:bd:f8:40", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc837761-a3", "ovs_interfaceid": "cc837761-a388-414b-9c08-8835b4e255c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=cc837761-a388-414b-9c08-8835b4e255c7,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcc837761-a3') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "deb82347-819f-40f5-bc84-b1562c29af71", "address": "fa:16:3e:16:d6:e0", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb82347-81", "ovs_interfaceid": "deb82347-819f-40f5-bc84-b1562c29af71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "deb82347-819f-40f5-bc84-b1562c29af71", "address": "fa:16:3e:16:d6:e0", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb82347-81", "ovs_interfaceid": "deb82347-819f-40f5-bc84-b1562c29af71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:d6:e0,bridge_name='br-int',has_traffic_filtering=True,id=deb82347-819f-40f5-bc84-b1562c29af71,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdeb82347-81') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30d569c6-052c-487b-99d8-142bed67ae7e", "address": "fa:16:3e:8f:44:7e", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d569c6-05", "ovs_interfaceid": "30d569c6-052c-487b-99d8-142bed67ae7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "30d569c6-052c-487b-99d8-142bed67ae7e", "address": "fa:16:3e:8f:44:7e", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d569c6-05", "ovs_interfaceid": "30d569c6-052c-487b-99d8-142bed67ae7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:44:7e,bridge_name='br-int',has_traffic_filtering=True,id=30d569c6-052c-487b-99d8-142bed67ae7e,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30d569c6-05') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "address": "fa:16:3e:3f:fb:3b", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c5a6d6-90", "ovs_interfaceid": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "address": "fa:16:3e:3f:fb:3b", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c5a6d6-90", "ovs_interfaceid": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:fb:3b,bridge_name='br-int',has_traffic_filtering=True,id=26c5a6d6-9037-490d-b40b-8e0c5bb16d0b,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c5a6d6-90') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "address": "fa:16:3e:22:b6:fc", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e645b-e3", "ovs_interfaceid": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "address": "fa:16:3e:22:b6:fc", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e645b-e3", "ovs_interfaceid": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:b6:fc,bridge_name='br-int',has_traffic_filtering=True,id=d96e645b-e317-4ac8-88b4-67e62a3c41b7,network=Network(99af4e0a-7f37-4fab-9dfb-ba79dc331a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd96e645b-e3') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "address": "fa:16:3e:eb:4e:30", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eadd24f-48", "ovs_interfaceid": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "address": "fa:16:3e:eb:4e:30", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eadd24f-48", "ovs_interfaceid": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:4e:30,bridge_name='br-int',has_traffic_filtering=True,id=7eadd24f-487c-4d19-b5eb-7d9483bf1800,network=Network(99af4e0a-7f37-4fab-9dfb-ba79dc331a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eadd24f-48') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.objects.instance [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lazy-loading 'pci_devices' on Instance uuid 58e955b6-be0c-41bc-9a39-4eeec3b694a1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:18:39 user nova-compute[75071]:   <uuid>58e955b6-be0c-41bc-9a39-4eeec3b694a1</uuid>
Dec 05 12:18:39 user nova-compute[75071]:   <name>instance-00000009</name>
Dec 05 12:18:39 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:18:39 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:18:39 user nova-compute[75071]:   <metadata>
Dec 05 12:18:39 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:18:39 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:18:39 user nova-compute[75071]:       <nova:name>tempest-device-tagging-server-1934056873</nova:name>
Dec 05 12:18:39 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:18:30</nova:creationTime>
Dec 05 12:18:39 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:18:39 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:18:39 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:18:39 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:18:39 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:18:39 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:18:39 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:18:39 user nova-compute[75071]:       <nova:owner>
Dec 05 12:18:39 user nova-compute[75071]:         <nova:user uuid="c12a1f3c2b3f46acaaf61809bb14ae22">tempest-TaggedBootDevicesTest_v242-319921360-project-member</nova:user>
Dec 05 12:18:39 user nova-compute[75071]:         <nova:project uuid="14482277667040c3bc5c0ae2f89c4ed4">tempest-TaggedBootDevicesTest_v242-319921360</nova:project>
Dec 05 12:18:39 user nova-compute[75071]:       </nova:owner>
Dec 05 12:18:39 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:18:39 user nova-compute[75071]:       <nova:ports>
Dec 05 12:18:39 user nova-compute[75071]:         <nova:port uuid="21361178-8b0b-43fb-9381-37e603f8d993">
Dec 05 12:18:39 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 05 12:18:39 user nova-compute[75071]:         </nova:port>
Dec 05 12:18:39 user nova-compute[75071]:         <nova:port uuid="cc837761-a388-414b-9c08-8835b4e255c7">
Dec 05 12:18:39 user nova-compute[75071]:           <nova:ip type="fixed" address="10.1.1.124" ipVersion="4"/>
Dec 05 12:18:39 user nova-compute[75071]:         </nova:port>
Dec 05 12:18:39 user nova-compute[75071]:         <nova:port uuid="deb82347-819f-40f5-bc84-b1562c29af71">
Dec 05 12:18:39 user nova-compute[75071]:           <nova:ip type="fixed" address="10.1.1.36" ipVersion="4"/>
Dec 05 12:18:39 user nova-compute[75071]:         </nova:port>
Dec 05 12:18:39 user nova-compute[75071]:         <nova:port uuid="30d569c6-052c-487b-99d8-142bed67ae7e">
Dec 05 12:18:39 user nova-compute[75071]:           <nova:ip type="fixed" address="10.1.1.48" ipVersion="4"/>
Dec 05 12:18:39 user nova-compute[75071]:         </nova:port>
Dec 05 12:18:39 user nova-compute[75071]:         <nova:port uuid="26c5a6d6-9037-490d-b40b-8e0c5bb16d0b">
Dec 05 12:18:39 user nova-compute[75071]:           <nova:ip type="fixed" address="10.1.1.243" ipVersion="4"/>
Dec 05 12:18:39 user nova-compute[75071]:         </nova:port>
Dec 05 12:18:39 user nova-compute[75071]:         <nova:port uuid="d96e645b-e317-4ac8-88b4-67e62a3c41b7">
Dec 05 12:18:39 user nova-compute[75071]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Dec 05 12:18:39 user nova-compute[75071]:         </nova:port>
Dec 05 12:18:39 user nova-compute[75071]:         <nova:port uuid="7eadd24f-487c-4d19-b5eb-7d9483bf1800">
Dec 05 12:18:39 user nova-compute[75071]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Dec 05 12:18:39 user nova-compute[75071]:         </nova:port>
Dec 05 12:18:39 user nova-compute[75071]:       </nova:ports>
Dec 05 12:18:39 user nova-compute[75071]:     </nova:instance>
Dec 05 12:18:39 user nova-compute[75071]:   </metadata>
Dec 05 12:18:39 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:18:39 user nova-compute[75071]:     <system>
Dec 05 12:18:39 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:18:39 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:18:39 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:18:39 user nova-compute[75071]:       <entry name="serial">58e955b6-be0c-41bc-9a39-4eeec3b694a1</entry>
Dec 05 12:18:39 user nova-compute[75071]:       <entry name="uuid">58e955b6-be0c-41bc-9a39-4eeec3b694a1</entry>
Dec 05 12:18:39 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:18:39 user nova-compute[75071]:     </system>
Dec 05 12:18:39 user nova-compute[75071]:   </sysinfo>
Dec 05 12:18:39 user nova-compute[75071]:   <os>
Dec 05 12:18:39 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:18:39 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:18:39 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:18:39 user nova-compute[75071]:   </os>
Dec 05 12:18:39 user nova-compute[75071]:   <features>
Dec 05 12:18:39 user nova-compute[75071]:     <acpi/>
Dec 05 12:18:39 user nova-compute[75071]:     <apic/>
Dec 05 12:18:39 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:18:39 user nova-compute[75071]:   </features>
Dec 05 12:18:39 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:18:39 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:18:39 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:18:39 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:18:39 user nova-compute[75071]:   </clock>
Dec 05 12:18:39 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:18:39 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:18:39 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:18:39 user nova-compute[75071]:   </cpu>
Dec 05 12:18:39 user nova-compute[75071]:   <devices>
Dec 05 12:18:39 user nova-compute[75071]:     <disk type="file" device="cdrom">
Dec 05 12:18:39 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none"/>
Dec 05 12:18:39 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/58e955b6-be0c-41bc-9a39-4eeec3b694a1/disk.config"/>
Dec 05 12:18:39 user nova-compute[75071]:       <target dev="hda" bus="ide"/>
Dec 05 12:18:39 user nova-compute[75071]:     </disk>
Dec 05 12:18:39 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:18:39 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:18:39 user nova-compute[75071]:       <source dev="/dev/sdd"/>
Dec 05 12:18:39 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:18:39 user nova-compute[75071]:       <serial>9d04025a-0b32-47ab-ab5a-75a8bd43a310</serial>
Dec 05 12:18:39 user nova-compute[75071]:     </disk>
Dec 05 12:18:39 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:18:39 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:18:39 user nova-compute[75071]:       <source dev="/dev/sdf"/>
Dec 05 12:18:39 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Dec 05 12:18:39 user nova-compute[75071]:       <serial>b4a92957-3718-450a-a2d7-c2057464b97b</serial>
Dec 05 12:18:39 user nova-compute[75071]:     </disk>
Dec 05 12:18:39 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:18:39 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:18:39 user nova-compute[75071]:       <source dev="/dev/sdh"/>
Dec 05 12:18:39 user nova-compute[75071]:       <target dev="vdc" bus="virtio"/>
Dec 05 12:18:39 user nova-compute[75071]:       <serial>d04d142d-8f9a-4914-a89c-e2640edd770a</serial>
Dec 05 12:18:39 user nova-compute[75071]:     </disk>
Dec 05 12:18:39 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:18:39 user nova-compute[75071]:       <mac address="fa:16:3e:86:db:af"/>
Dec 05 12:18:39 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:18:39 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:18:39 user nova-compute[75071]:       <target dev="tap21361178-8b"/>
Dec 05 12:18:39 user nova-compute[75071]:     </interface>
Dec 05 12:18:39 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:18:39 user nova-compute[75071]:       <mac address="fa:16:3e:bd:f8:40"/>
Dec 05 12:18:39 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:18:39 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:18:39 user nova-compute[75071]:       <target dev="tapcc837761-a3"/>
Dec 05 12:18:39 user nova-compute[75071]:     </interface>
Dec 05 12:18:39 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:18:39 user nova-compute[75071]:       <mac address="fa:16:3e:16:d6:e0"/>
Dec 05 12:18:39 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:18:39 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:18:39 user nova-compute[75071]:       <target dev="tapdeb82347-81"/>
Dec 05 12:18:39 user nova-compute[75071]:     </interface>
Dec 05 12:18:39 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:18:39 user nova-compute[75071]:       <mac address="fa:16:3e:8f:44:7e"/>
Dec 05 12:18:39 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:18:39 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:18:39 user nova-compute[75071]:       <target dev="tap30d569c6-05"/>
Dec 05 12:18:39 user nova-compute[75071]:     </interface>
Dec 05 12:18:39 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:18:39 user nova-compute[75071]:       <mac address="fa:16:3e:3f:fb:3b"/>
Dec 05 12:18:39 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:18:39 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:18:39 user nova-compute[75071]:       <target dev="tap26c5a6d6-90"/>
Dec 05 12:18:39 user nova-compute[75071]:     </interface>
Dec 05 12:18:39 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:18:39 user nova-compute[75071]:       <mac address="fa:16:3e:22:b6:fc"/>
Dec 05 12:18:39 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:18:39 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:18:39 user nova-compute[75071]:       <target dev="tapd96e645b-e3"/>
Dec 05 12:18:39 user nova-compute[75071]:     </interface>
Dec 05 12:18:39 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:18:39 user nova-compute[75071]:       <mac address="fa:16:3e:eb:4e:30"/>
Dec 05 12:18:39 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:18:39 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:18:39 user nova-compute[75071]:       <target dev="tap7eadd24f-48"/>
Dec 05 12:18:39 user nova-compute[75071]:     </interface>
Dec 05 12:18:39 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:18:39 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/58e955b6-be0c-41bc-9a39-4eeec3b694a1/console.log" append="off"/>
Dec 05 12:18:39 user nova-compute[75071]:     </serial>
Dec 05 12:18:39 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:18:39 user nova-compute[75071]:     <video>
Dec 05 12:18:39 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:18:39 user nova-compute[75071]:     </video>
Dec 05 12:18:39 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:18:39 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:18:39 user nova-compute[75071]:     </rng>
Dec 05 12:18:39 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:18:39 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:18:39 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:18:39 user nova-compute[75071]:     </memballoon>
Dec 05 12:18:39 user nova-compute[75071]:   </devices>
Dec 05 12:18:39 user nova-compute[75071]: </domain>
Dec 05 12:18:39 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21361178-8b0b-43fb-9381-37e603f8d993", "address": "fa:16:3e:86:db:af", "network": {"id": "150ec31a-5cc2-485a-8ed6-07bd26173225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-441693172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21361178-8b", "ovs_interfaceid": "21361178-8b0b-43fb-9381-37e603f8d993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "21361178-8b0b-43fb-9381-37e603f8d993", "address": "fa:16:3e:86:db:af", "network": {"id": "150ec31a-5cc2-485a-8ed6-07bd26173225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-441693172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21361178-8b", "ovs_interfaceid": "21361178-8b0b-43fb-9381-37e603f8d993", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:db:af,bridge_name='br-int',has_traffic_filtering=True,id=21361178-8b0b-43fb-9381-37e603f8d993,network=Network(150ec31a-5cc2-485a-8ed6-07bd26173225),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21361178-8b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG os_vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:db:af,bridge_name='br-int',has_traffic_filtering=True,id=21361178-8b0b-43fb-9381-37e603f8d993,network=Network(150ec31a-5cc2-485a-8ed6-07bd26173225),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21361178-8b') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a8538e9-6902-5509-9fae-c3f939ee99f5', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-6e613770-a0b2-48a1-abfb-b0f6bf50f530 req-3b896d00-39f4-4256-a4bf-d4ec70d00e93 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-0d9f17d4-6b21-460d-9a8c-47270cf8a163 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6e613770-a0b2-48a1-abfb-b0f6bf50f530 req-3b896d00-39f4-4256-a4bf-d4ec70d00e93 service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6e613770-a0b2-48a1-abfb-b0f6bf50f530 req-3b896d00-39f4-4256-a4bf-d4ec70d00e93 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6e613770-a0b2-48a1-abfb-b0f6bf50f530 req-3b896d00-39f4-4256-a4bf-d4ec70d00e93 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-6e613770-a0b2-48a1-abfb-b0f6bf50f530 req-3b896d00-39f4-4256-a4bf-d4ec70d00e93 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-0d9f17d4-6b21-460d-9a8c-47270cf8a163 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:45 user nova-compute[75071]: WARNING nova.compute.manager [req-6e613770-a0b2-48a1-abfb-b0f6bf50f530 req-3b896d00-39f4-4256-a4bf-d4ec70d00e93 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-0d9f17d4-6b21-460d-9a8c-47270cf8a163 for instance with vm_state building and task_state spawning.
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-9f3530cc-cece-45fb-a30f-1e995b4d9a06 req-6119e08b-be5f-4d08-a78a-33c8da5ff057 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Received event network-changed-bcda865e-a8e7-4f6a-a633-95c0d037b04e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-9f3530cc-cece-45fb-a30f-1e995b4d9a06 req-6119e08b-be5f-4d08-a78a-33c8da5ff057 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Refreshing instance network info cache due to event network-changed-bcda865e-a8e7-4f6a-a633-95c0d037b04e. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9f3530cc-cece-45fb-a30f-1e995b4d9a06 req-6119e08b-be5f-4d08-a78a-33c8da5ff057 service nova] Acquiring lock "refresh_cache-81333acc-8dc7-42f1-9026-e42a30e52a5a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9f3530cc-cece-45fb-a30f-1e995b4d9a06 req-6119e08b-be5f-4d08-a78a-33c8da5ff057 service nova] Acquired lock "refresh_cache-81333acc-8dc7-42f1-9026-e42a30e52a5a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.network.neutron [req-9f3530cc-cece-45fb-a30f-1e995b4d9a06 req-6119e08b-be5f-4d08-a78a-33c8da5ff057 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Refreshing network info cache for port bcda865e-a8e7-4f6a-a633-95c0d037b04e {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-0d9f17d4-6b21-460d-9a8c-47270cf8a163 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-0d9f17d4-6b21-460d-9a8c-47270cf8a163 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:45 user nova-compute[75071]: WARNING nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-0d9f17d4-6b21-460d-9a8c-47270cf8a163 for instance with vm_state building and task_state spawning.
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-a580be24-0d0f-4cf1-8abc-2b9514de0cbf {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-a580be24-0d0f-4cf1-8abc-2b9514de0cbf {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:45 user nova-compute[75071]: WARNING nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-a580be24-0d0f-4cf1-8abc-2b9514de0cbf for instance with vm_state building and task_state spawning.
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-a580be24-0d0f-4cf1-8abc-2b9514de0cbf {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-a580be24-0d0f-4cf1-8abc-2b9514de0cbf {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:45 user nova-compute[75071]: WARNING nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-a580be24-0d0f-4cf1-8abc-2b9514de0cbf for instance with vm_state building and task_state spawning.
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-34466bd1-f50e-4643-917f-512f81302b85 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-34466bd1-f50e-4643-917f-512f81302b85 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:45 user nova-compute[75071]: WARNING nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-34466bd1-f50e-4643-917f-512f81302b85 for instance with vm_state building and task_state spawning.
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-34466bd1-f50e-4643-917f-512f81302b85 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-34466bd1-f50e-4643-917f-512f81302b85 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:45 user nova-compute[75071]: WARNING nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-34466bd1-f50e-4643-917f-512f81302b85 for instance with vm_state building and task_state spawning.
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-443a2f48-d7e4-4368-986d-53e5a9705d3e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-443a2f48-d7e4-4368-986d-53e5a9705d3e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:45 user nova-compute[75071]: WARNING nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-443a2f48-d7e4-4368-986d-53e5a9705d3e for instance with vm_state building and task_state spawning.
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-443a2f48-d7e4-4368-986d-53e5a9705d3e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-443a2f48-d7e4-4368-986d-53e5a9705d3e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:45 user nova-compute[75071]: WARNING nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-443a2f48-d7e4-4368-986d-53e5a9705d3e for instance with vm_state building and task_state spawning.
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-5e5b1c1e-64c1-4da4-ab47-d1afd13843ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-5e5b1c1e-64c1-4da4-ab47-d1afd13843ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:45 user nova-compute[75071]: WARNING nova.compute.manager [req-dd254374-51fa-4727-9572-97a3489fa614 req-a3736cfb-c047-4f17-9c92-aee3aeb121e4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-5e5b1c1e-64c1-4da4-ab47-d1afd13843ac for instance with vm_state building and task_state spawning.
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-2fe2daab-cc12-4376-8b33-03a06dbd365d req-13bf4d9e-dec0-4483-9bb9-a6cdb73b4c5d service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-19d60ebb-5100-4ba5-9fe7-d9b246e4971d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2fe2daab-cc12-4376-8b33-03a06dbd365d req-13bf4d9e-dec0-4483-9bb9-a6cdb73b4c5d service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2fe2daab-cc12-4376-8b33-03a06dbd365d req-13bf4d9e-dec0-4483-9bb9-a6cdb73b4c5d service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2fe2daab-cc12-4376-8b33-03a06dbd365d req-13bf4d9e-dec0-4483-9bb9-a6cdb73b4c5d service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-2fe2daab-cc12-4376-8b33-03a06dbd365d req-13bf4d9e-dec0-4483-9bb9-a6cdb73b4c5d service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-19d60ebb-5100-4ba5-9fe7-d9b246e4971d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:45 user nova-compute[75071]: WARNING nova.compute.manager [req-2fe2daab-cc12-4376-8b33-03a06dbd365d req-13bf4d9e-dec0-4483-9bb9-a6cdb73b4c5d service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-19d60ebb-5100-4ba5-9fe7-d9b246e4971d for instance with vm_state building and task_state spawning.
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-2fe2daab-cc12-4376-8b33-03a06dbd365d req-13bf4d9e-dec0-4483-9bb9-a6cdb73b4c5d service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-19d60ebb-5100-4ba5-9fe7-d9b246e4971d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2fe2daab-cc12-4376-8b33-03a06dbd365d req-13bf4d9e-dec0-4483-9bb9-a6cdb73b4c5d service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2fe2daab-cc12-4376-8b33-03a06dbd365d req-13bf4d9e-dec0-4483-9bb9-a6cdb73b4c5d service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2fe2daab-cc12-4376-8b33-03a06dbd365d req-13bf4d9e-dec0-4483-9bb9-a6cdb73b4c5d service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-2fe2daab-cc12-4376-8b33-03a06dbd365d req-13bf4d9e-dec0-4483-9bb9-a6cdb73b4c5d service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-19d60ebb-5100-4ba5-9fe7-d9b246e4971d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:45 user nova-compute[75071]: WARNING nova.compute.manager [req-2fe2daab-cc12-4376-8b33-03a06dbd365d req-13bf4d9e-dec0-4483-9bb9-a6cdb73b4c5d service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-19d60ebb-5100-4ba5-9fe7-d9b246e4971d for instance with vm_state building and task_state spawning.
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-94c4281e-0ba4-42ff-91b1-e784440547c4 req-37f24b55-8cb0-4470-8177-95aa4ead8da4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-5e5b1c1e-64c1-4da4-ab47-d1afd13843ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-94c4281e-0ba4-42ff-91b1-e784440547c4 req-37f24b55-8cb0-4470-8177-95aa4ead8da4 service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-94c4281e-0ba4-42ff-91b1-e784440547c4 req-37f24b55-8cb0-4470-8177-95aa4ead8da4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-94c4281e-0ba4-42ff-91b1-e784440547c4 req-37f24b55-8cb0-4470-8177-95aa4ead8da4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-94c4281e-0ba4-42ff-91b1-e784440547c4 req-37f24b55-8cb0-4470-8177-95aa4ead8da4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-5e5b1c1e-64c1-4da4-ab47-d1afd13843ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:45 user nova-compute[75071]: WARNING nova.compute.manager [req-94c4281e-0ba4-42ff-91b1-e784440547c4 req-37f24b55-8cb0-4470-8177-95aa4ead8da4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-5e5b1c1e-64c1-4da4-ab47-d1afd13843ac for instance with vm_state building and task_state spawning.
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-94c4281e-0ba4-42ff-91b1-e784440547c4 req-37f24b55-8cb0-4470-8177-95aa4ead8da4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-afa68989-e42f-4b32-b4d4-319a6290df7d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-94c4281e-0ba4-42ff-91b1-e784440547c4 req-37f24b55-8cb0-4470-8177-95aa4ead8da4 service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-94c4281e-0ba4-42ff-91b1-e784440547c4 req-37f24b55-8cb0-4470-8177-95aa4ead8da4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-94c4281e-0ba4-42ff-91b1-e784440547c4 req-37f24b55-8cb0-4470-8177-95aa4ead8da4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-94c4281e-0ba4-42ff-91b1-e784440547c4 req-37f24b55-8cb0-4470-8177-95aa4ead8da4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-afa68989-e42f-4b32-b4d4-319a6290df7d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:45 user nova-compute[75071]: WARNING nova.compute.manager [req-94c4281e-0ba4-42ff-91b1-e784440547c4 req-37f24b55-8cb0-4470-8177-95aa4ead8da4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-afa68989-e42f-4b32-b4d4-319a6290df7d for instance with vm_state building and task_state spawning.
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-94c4281e-0ba4-42ff-91b1-e784440547c4 req-37f24b55-8cb0-4470-8177-95aa4ead8da4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-afa68989-e42f-4b32-b4d4-319a6290df7d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-94c4281e-0ba4-42ff-91b1-e784440547c4 req-37f24b55-8cb0-4470-8177-95aa4ead8da4 service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-94c4281e-0ba4-42ff-91b1-e784440547c4 req-37f24b55-8cb0-4470-8177-95aa4ead8da4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-94c4281e-0ba4-42ff-91b1-e784440547c4 req-37f24b55-8cb0-4470-8177-95aa4ead8da4 service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-94c4281e-0ba4-42ff-91b1-e784440547c4 req-37f24b55-8cb0-4470-8177-95aa4ead8da4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-afa68989-e42f-4b32-b4d4-319a6290df7d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:45 user nova-compute[75071]: WARNING nova.compute.manager [req-94c4281e-0ba4-42ff-91b1-e784440547c4 req-37f24b55-8cb0-4470-8177-95aa4ead8da4 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-afa68989-e42f-4b32-b4d4-319a6290df7d for instance with vm_state building and task_state spawning.
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21361178-8b, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21361178-8b, col_values=(('qos', UUID('a3dd90f0-6dff-4327-a07f-ef62ba1df859')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21361178-8b, col_values=(('external_ids', {'iface-id': '21361178-8b0b-43fb-9381-37e603f8d993', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:db:af', 'vm-uuid': '58e955b6-be0c-41bc-9a39-4eeec3b694a1'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:45 user nova-compute[75071]: INFO os_vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:db:af,bridge_name='br-int',has_traffic_filtering=True,id=21361178-8b0b-43fb-9381-37e603f8d993,network=Network(150ec31a-5cc2-485a-8ed6-07bd26173225),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21361178-8b')
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc837761-a388-414b-9c08-8835b4e255c7", "address": "fa:16:3e:bd:f8:40", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc837761-a3", "ovs_interfaceid": "cc837761-a388-414b-9c08-8835b4e255c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "cc837761-a388-414b-9c08-8835b4e255c7", "address": "fa:16:3e:bd:f8:40", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc837761-a3", "ovs_interfaceid": "cc837761-a388-414b-9c08-8835b4e255c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=cc837761-a388-414b-9c08-8835b4e255c7,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcc837761-a3') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG os_vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=cc837761-a388-414b-9c08-8835b4e255c7,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcc837761-a3') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c90b9c9d-69df-5146-8304-305b8fef7744', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:45 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:18:45 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=7417MB free_disk=25.49155044555664GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Instance spawned successfully.
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc837761-a3, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc837761-a3, col_values=(('qos', UUID('f29a172a-f378-447f-95ac-93a716300298')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc837761-a3, col_values=(('external_ids', {'iface-id': 'cc837761-a388-414b-9c08-8835b4e255c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:f8:40', 'vm-uuid': '58e955b6-be0c-41bc-9a39-4eeec3b694a1'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:45 user nova-compute[75071]: INFO os_vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=cc837761-a388-414b-9c08-8835b4e255c7,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcc837761-a3')
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "deb82347-819f-40f5-bc84-b1562c29af71", "address": "fa:16:3e:16:d6:e0", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb82347-81", "ovs_interfaceid": "deb82347-819f-40f5-bc84-b1562c29af71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "deb82347-819f-40f5-bc84-b1562c29af71", "address": "fa:16:3e:16:d6:e0", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb82347-81", "ovs_interfaceid": "deb82347-819f-40f5-bc84-b1562c29af71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:d6:e0,bridge_name='br-int',has_traffic_filtering=True,id=deb82347-819f-40f5-bc84-b1562c29af71,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdeb82347-81') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG os_vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:d6:e0,bridge_name='br-int',has_traffic_filtering=True,id=deb82347-819f-40f5-bc84-b1562c29af71,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdeb82347-81') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc0f9613-1d35-5279-9b87-1f630017a2a2', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:18:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 6.670s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.082s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdeb82347-81, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdeb82347-81, col_values=(('qos', UUID('fb97bb2e-bc49-419e-a8de-cb36a57f626c')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdeb82347-81, col_values=(('external_ids', {'iface-id': 'deb82347-819f-40f5-bc84-b1562c29af71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:d6:e0', 'vm-uuid': '58e955b6-be0c-41bc-9a39-4eeec3b694a1'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: INFO os_vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:d6:e0,bridge_name='br-int',has_traffic_filtering=True,id=deb82347-819f-40f5-bc84-b1562c29af71,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdeb82347-81')
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30d569c6-052c-487b-99d8-142bed67ae7e", "address": "fa:16:3e:8f:44:7e", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d569c6-05", "ovs_interfaceid": "30d569c6-052c-487b-99d8-142bed67ae7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "30d569c6-052c-487b-99d8-142bed67ae7e", "address": "fa:16:3e:8f:44:7e", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d569c6-05", "ovs_interfaceid": "30d569c6-052c-487b-99d8-142bed67ae7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:44:7e,bridge_name='br-int',has_traffic_filtering=True,id=30d569c6-052c-487b-99d8-142bed67ae7e,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30d569c6-05') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG os_vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:44:7e,bridge_name='br-int',has_traffic_filtering=True,id=30d569c6-052c-487b-99d8-142bed67ae7e,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30d569c6-05') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b41b521f-a579-5302-9d49-72bfc0542a3f', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:18:46 user nova-compute[75071]: INFO nova.compute.manager [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Took 15.67 seconds to spawn the instance on the hypervisor.
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30d569c6-05, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30d569c6-05, col_values=(('qos', UUID('b9445cb2-2103-48a8-9529-9680b4b392f1')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30d569c6-05, col_values=(('external_ids', {'iface-id': '30d569c6-052c-487b-99d8-142bed67ae7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:44:7e', 'vm-uuid': '58e955b6-be0c-41bc-9a39-4eeec3b694a1'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: INFO os_vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:44:7e,bridge_name='br-int',has_traffic_filtering=True,id=30d569c6-052c-487b-99d8-142bed67ae7e,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30d569c6-05')
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "address": "fa:16:3e:3f:fb:3b", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c5a6d6-90", "ovs_interfaceid": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "address": "fa:16:3e:3f:fb:3b", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c5a6d6-90", "ovs_interfaceid": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:fb:3b,bridge_name='br-int',has_traffic_filtering=True,id=26c5a6d6-9037-490d-b40b-8e0c5bb16d0b,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c5a6d6-90') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG os_vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:fb:3b,bridge_name='br-int',has_traffic_filtering=True,id=26c5a6d6-9037-490d-b40b-8e0c5bb16d0b,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c5a6d6-90') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd09aa891-11a0-5d8a-9e39-d4870ae46cf1', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 81333acc-8dc7-42f1-9026-e42a30e52a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e08be776-0fa9-4871-86eb-2093530c00f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 854ee980-5c0b-4c4f-b9fd-609720e693be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 0d640cf7-170a-4d3e-8983-6165aab46bae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 2625dd24-5c50-4911-9515-57c9483bafa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 332f0212-d8e4-4a99-9688-01a26ba66916 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c9e37746-57e8-4053-9f52-2c60bab457fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 58e955b6-be0c-41bc-9a39-4eeec3b694a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 94aa75f8-6097-4cba-b567-112ec59efd8f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "81333acc-8dc7-42f1-9026-e42a30e52a5a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.policy [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44a85d29f03344119f15021c037ae5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce66477a63c44ac8df4b147456f3653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26c5a6d6-90, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26c5a6d6-90, col_values=(('qos', UUID('dc8c91b4-5d25-4e79-8005-88092e795dcb')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26c5a6d6-90, col_values=(('external_ids', {'iface-id': '26c5a6d6-9037-490d-b40b-8e0c5bb16d0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:fb:3b', 'vm-uuid': '58e955b6-be0c-41bc-9a39-4eeec3b694a1'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lazy-loading 'flavor' on Instance uuid 81333acc-8dc7-42f1-9026-e42a30e52a5a {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:18:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Creating image(s)
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "/opt/stack/data/nova/instances/1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "/opt/stack/data/nova/instances/1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: INFO nova.compute.manager [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Took 50.28 seconds to build instance.
Dec 05 12:18:46 user nova-compute[75071]: INFO os_vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:fb:3b,bridge_name='br-int',has_traffic_filtering=True,id=26c5a6d6-9037-490d-b40b-8e0c5bb16d0b,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c5a6d6-90')
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "address": "fa:16:3e:22:b6:fc", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e645b-e3", "ovs_interfaceid": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "address": "fa:16:3e:22:b6:fc", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e645b-e3", "ovs_interfaceid": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:b6:fc,bridge_name='br-int',has_traffic_filtering=True,id=d96e645b-e317-4ac8-88b4-67e62a3c41b7,network=Network(99af4e0a-7f37-4fab-9dfb-ba79dc331a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd96e645b-e3') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG os_vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:b6:fc,bridge_name='br-int',has_traffic_filtering=True,id=d96e645b-e317-4ac8-88b4-67e62a3c41b7,network=Network(99af4e0a-7f37-4fab-9dfb-ba79dc331a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd96e645b-e3') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-905039e9-3d21-44c1-bbc9-3c713b1d3fa6 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 50.465s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '722c0e8f-a9a0-5a10-ac9c-21b6098798e0', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.215s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd96e645b-e3, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd96e645b-e3, col_values=(('qos', UUID('d94ab0ba-c749-4ba8-ab4b-a9c7e2b00f54')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd96e645b-e3, col_values=(('external_ids', {'iface-id': 'd96e645b-e317-4ac8-88b4-67e62a3c41b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:b6:fc', 'vm-uuid': '58e955b6-be0c-41bc-9a39-4eeec3b694a1'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: INFO os_vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:b6:fc,bridge_name='br-int',has_traffic_filtering=True,id=d96e645b-e317-4ac8-88b4-67e62a3c41b7,network=Network(99af4e0a-7f37-4fab-9dfb-ba79dc331a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd96e645b-e3')
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:17:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "address": "fa:16:3e:eb:4e:30", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eadd24f-48", "ovs_interfaceid": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "address": "fa:16:3e:eb:4e:30", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eadd24f-48", "ovs_interfaceid": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:4e:30,bridge_name='br-int',has_traffic_filtering=True,id=7eadd24f-487c-4d19-b5eb-7d9483bf1800,network=Network(99af4e0a-7f37-4fab-9dfb-ba79dc331a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eadd24f-48') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG os_vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:4e:30,bridge_name='br-int',has_traffic_filtering=True,id=7eadd24f-487c-4d19-b5eb-7d9483bf1800,network=Network(99af4e0a-7f37-4fab-9dfb-ba79dc331a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eadd24f-48') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79637ae9-fa0e-5cd0-92d9-16f1f2feacfc', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "81333acc-8dc7-42f1-9026-e42a30e52a5a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:46 user nova-compute[75071]: INFO nova.compute.manager [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Attaching volume 93490fef-282f-4f1b-bc4e-0489b01f710c to /dev/vdb
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7eadd24f-48, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7eadd24f-48, col_values=(('qos', UUID('882b9441-04d5-4d0f-8498-ab3a0544ed31')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7eadd24f-48, col_values=(('external_ids', {'iface-id': '7eadd24f-487c-4d19-b5eb-7d9483bf1800', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:4e:30', 'vm-uuid': '58e955b6-be0c-41bc-9a39-4eeec3b694a1'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.network.neutron [req-9f3530cc-cece-45fb-a30f-1e995b4d9a06 req-6119e08b-be5f-4d08-a78a-33c8da5ff057 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Updated VIF entry in instance network info cache for port bcda865e-a8e7-4f6a-a633-95c0d037b04e. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.network.neutron [req-9f3530cc-cece-45fb-a30f-1e995b4d9a06 req-6119e08b-be5f-4d08-a78a-33c8da5ff057 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Updating instance_info_cache with network_info: [{"id": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "address": "fa:16:3e:53:f5:d1", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcda865e-a8", "ovs_interfaceid": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9f3530cc-cece-45fb-a30f-1e995b4d9a06 req-6119e08b-be5f-4d08-a78a-33c8da5ff057 service nova] Releasing lock "refresh_cache-81333acc-8dc7-42f1-9026-e42a30e52a5a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG os_brick.utils [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.207s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c5ade8-fd69-494a-9184-56295a8d301c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:46 user nova-compute[75071]: INFO os_vif [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:4e:30,bridge_name='br-int',has_traffic_filtering=True,id=7eadd24f-487c-4d19-b5eb-7d9483bf1800,network=Network(99af4e0a-7f37-4fab-9dfb-ba79dc331a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eadd24f-48')
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ada20a-a57b-4c56-a66c-961cd3054624]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b/disk 1073741824" returned: 0 in 0.068s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[571ec35d-bff8-4db8-8e22-f96d018ec0f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Successfully created port: b2f8657a-3b46-4736-8a9e-101e997c0b30 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c25f25f-43d8-4f90-b2ce-53e1e8a6c423]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:18:46 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:18:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47fd1e3-6937-41d1-a490-73426800b6e0]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG os_brick.utils [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] <== get_connector_properties: return (228ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Updating existing volume attachment record: 3172c725-1b88-44d0-9bc3-fc62c3b15e50 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] No BDM found with device name hda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] No VIF found with MAC fa:16:3e:86:db:af, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] No VIF found with MAC fa:16:3e:3f:fb:3b, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:18:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Using config drive
Dec 05 12:18:46 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.197s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.063s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Cannot resize image /opt/stack/data/nova/instances/1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Ensure instance console log exists: /opt/stack/data/nova/instances/1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:47 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Creating config drive at /opt/stack/data/nova/instances/58e955b6-be0c-41bc-9a39-4eeec3b694a1/disk.config
Dec 05 12:18:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/58e955b6-be0c-41bc-9a39-4eeec3b694a1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpludnbs15 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/58e955b6-be0c-41bc-9a39-4eeec3b694a1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpludnbs15" returned: 0 in 0.063s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Successfully updated port: b2f8657a-3b46-4736-8a9e-101e997c0b30 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquiring lock "refresh_cache-1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquired lock "refresh_cache-1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-a488fcee-3bdc-409d-a252-e713cde70ec4 req-9a1f2bdc-9747-4b87-860d-dbbd65ec02d8 service nova] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Received event network-changed-b2f8657a-3b46-4736-8a9e-101e997c0b30 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-a488fcee-3bdc-409d-a252-e713cde70ec4 req-9a1f2bdc-9747-4b87-860d-dbbd65ec02d8 service nova] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Refreshing instance network info cache due to event network-changed-b2f8657a-3b46-4736-8a9e-101e997c0b30. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a488fcee-3bdc-409d-a252-e713cde70ec4 req-9a1f2bdc-9747-4b87-860d-dbbd65ec02d8 service nova] Acquiring lock "refresh_cache-1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:47 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Updating instance_info_cache with network_info: [{"id": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "address": "fa:16:3e:d2:a9:51", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2f8657a-3b", "ovs_interfaceid": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Releasing lock "refresh_cache-1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Instance network_info: |[{"id": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "address": "fa:16:3e:d2:a9:51", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2f8657a-3b", "ovs_interfaceid": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a488fcee-3bdc-409d-a252-e713cde70ec4 req-9a1f2bdc-9747-4b87-860d-dbbd65ec02d8 service nova] Acquired lock "refresh_cache-1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.network.neutron [req-a488fcee-3bdc-409d-a252-e713cde70ec4 req-9a1f2bdc-9747-4b87-860d-dbbd65ec02d8 service nova] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Refreshing network info cache for port b2f8657a-3b46-4736-8a9e-101e997c0b30 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Start _get_guest_xml network_info=[{"id": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "address": "fa:16:3e:d2:a9:51", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2f8657a-3b", "ovs_interfaceid": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:18:48 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:18:48 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:18:48 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:18:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1001798486',display_name='tempest-VolumesActionsTest-instance-1001798486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1001798486',id=11,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dce66477a63c44ac8df4b147456f3653',ramdisk_id='',reservation_id='r-uq2udegs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-128873361',owner_user_name='tempest-VolumesActionsTest-128873361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:18:46Z,user_data=None,user_id='44a85d29f03344119f15021c037ae5e0',uuid=1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "address": "fa:16:3e:d2:a9:51", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2f8657a-3b", "ovs_interfaceid": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Converting VIF {"id": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "address": "fa:16:3e:d2:a9:51", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2f8657a-3b", "ovs_interfaceid": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=b2f8657a-3b46-4736-8a9e-101e997c0b30,network=Network(a5b2962d-4c1e-40d6-adc0-ea51e41d06a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2f8657a-3b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:18:48 user nova-compute[75071]:   <uuid>1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b</uuid>
Dec 05 12:18:48 user nova-compute[75071]:   <name>instance-0000000b</name>
Dec 05 12:18:48 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:18:48 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:18:48 user nova-compute[75071]:   <metadata>
Dec 05 12:18:48 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:18:48 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:18:48 user nova-compute[75071]:       <nova:name>tempest-VolumesActionsTest-instance-1001798486</nova:name>
Dec 05 12:18:48 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:18:48</nova:creationTime>
Dec 05 12:18:48 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:18:48 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:18:48 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:18:48 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:18:48 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:18:48 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:18:48 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:18:48 user nova-compute[75071]:       <nova:owner>
Dec 05 12:18:48 user nova-compute[75071]:         <nova:user uuid="44a85d29f03344119f15021c037ae5e0">tempest-VolumesActionsTest-128873361-project-member</nova:user>
Dec 05 12:18:48 user nova-compute[75071]:         <nova:project uuid="dce66477a63c44ac8df4b147456f3653">tempest-VolumesActionsTest-128873361</nova:project>
Dec 05 12:18:48 user nova-compute[75071]:       </nova:owner>
Dec 05 12:18:48 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:18:48 user nova-compute[75071]:       <nova:ports>
Dec 05 12:18:48 user nova-compute[75071]:         <nova:port uuid="b2f8657a-3b46-4736-8a9e-101e997c0b30">
Dec 05 12:18:48 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 12:18:48 user nova-compute[75071]:         </nova:port>
Dec 05 12:18:48 user nova-compute[75071]:       </nova:ports>
Dec 05 12:18:48 user nova-compute[75071]:     </nova:instance>
Dec 05 12:18:48 user nova-compute[75071]:   </metadata>
Dec 05 12:18:48 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:18:48 user nova-compute[75071]:     <system>
Dec 05 12:18:48 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:18:48 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:18:48 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:18:48 user nova-compute[75071]:       <entry name="serial">1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b</entry>
Dec 05 12:18:48 user nova-compute[75071]:       <entry name="uuid">1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b</entry>
Dec 05 12:18:48 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:18:48 user nova-compute[75071]:     </system>
Dec 05 12:18:48 user nova-compute[75071]:   </sysinfo>
Dec 05 12:18:48 user nova-compute[75071]:   <os>
Dec 05 12:18:48 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:18:48 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:18:48 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:18:48 user nova-compute[75071]:   </os>
Dec 05 12:18:48 user nova-compute[75071]:   <features>
Dec 05 12:18:48 user nova-compute[75071]:     <acpi/>
Dec 05 12:18:48 user nova-compute[75071]:     <apic/>
Dec 05 12:18:48 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:18:48 user nova-compute[75071]:   </features>
Dec 05 12:18:48 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:18:48 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:18:48 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:18:48 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:18:48 user nova-compute[75071]:   </clock>
Dec 05 12:18:48 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:18:48 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:18:48 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:18:48 user nova-compute[75071]:   </cpu>
Dec 05 12:18:48 user nova-compute[75071]:   <devices>
Dec 05 12:18:48 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:18:48 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:18:48 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b/disk"/>
Dec 05 12:18:48 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:18:48 user nova-compute[75071]:     </disk>
Dec 05 12:18:48 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:18:48 user nova-compute[75071]:       <mac address="fa:16:3e:d2:a9:51"/>
Dec 05 12:18:48 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:18:48 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:18:48 user nova-compute[75071]:       <target dev="tapb2f8657a-3b"/>
Dec 05 12:18:48 user nova-compute[75071]:     </interface>
Dec 05 12:18:48 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:18:48 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b/console.log" append="off"/>
Dec 05 12:18:48 user nova-compute[75071]:     </serial>
Dec 05 12:18:48 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:18:48 user nova-compute[75071]:     <video>
Dec 05 12:18:48 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:18:48 user nova-compute[75071]:     </video>
Dec 05 12:18:48 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:18:48 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:18:48 user nova-compute[75071]:     </rng>
Dec 05 12:18:48 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:18:48 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:18:48 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:18:48 user nova-compute[75071]:     </memballoon>
Dec 05 12:18:48 user nova-compute[75071]:   </devices>
Dec 05 12:18:48 user nova-compute[75071]: </domain>
Dec 05 12:18:48 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:18:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1001798486',display_name='tempest-VolumesActionsTest-instance-1001798486',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1001798486',id=11,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dce66477a63c44ac8df4b147456f3653',ramdisk_id='',reservation_id='r-uq2udegs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-128873361',owner_user_name='tempest-VolumesActionsTest-128873361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:18:46Z,user_data=None,user_id='44a85d29f03344119f15021c037ae5e0',uuid=1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "address": "fa:16:3e:d2:a9:51", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2f8657a-3b", "ovs_interfaceid": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Converting VIF {"id": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "address": "fa:16:3e:d2:a9:51", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2f8657a-3b", "ovs_interfaceid": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=b2f8657a-3b46-4736-8a9e-101e997c0b30,network=Network(a5b2962d-4c1e-40d6-adc0-ea51e41d06a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2f8657a-3b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG os_vif [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=b2f8657a-3b46-4736-8a9e-101e997c0b30,network=Network(a5b2962d-4c1e-40d6-adc0-ea51e41d06a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2f8657a-3b') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee0ee01b-c91e-552c-b210-4b0b592d590c', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2f8657a-3b, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2f8657a-3b, col_values=(('qos', UUID('5d8da690-8ff9-4901-9319-2a6ecb0837c5')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2f8657a-3b, col_values=(('external_ids', {'iface-id': 'b2f8657a-3b46-4736-8a9e-101e997c0b30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:a9:51', 'vm-uuid': '1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-85c729f9-8071-4afa-80ea-21e0f8f646da req-af3866a3-bcd5-4bb9-b2b7-ea507e917bef service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received event network-changed-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-85c729f9-8071-4afa-80ea-21e0f8f646da req-af3866a3-bcd5-4bb9-b2b7-ea507e917bef service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Refreshing instance network info cache due to event network-changed-30895720-729f-445d-b49a-d843f1cb23a8. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-85c729f9-8071-4afa-80ea-21e0f8f646da req-af3866a3-bcd5-4bb9-b2b7-ea507e917bef service nova] Acquiring lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-85c729f9-8071-4afa-80ea-21e0f8f646da req-af3866a3-bcd5-4bb9-b2b7-ea507e917bef service nova] Acquired lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.network.neutron [req-85c729f9-8071-4afa-80ea-21e0f8f646da req-af3866a3-bcd5-4bb9-b2b7-ea507e917bef service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Refreshing network info cache for port 30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:48 user nova-compute[75071]: INFO os_vif [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=b2f8657a-3b46-4736-8a9e-101e997c0b30,network=Network(a5b2962d-4c1e-40d6-adc0-ea51e41d06a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2f8657a-3b')
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] No VIF found with MAC fa:16:3e:d2:a9:51, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG nova.network.neutron [req-a488fcee-3bdc-409d-a252-e713cde70ec4 req-9a1f2bdc-9747-4b87-860d-dbbd65ec02d8 service nova] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Updated VIF entry in instance network info cache for port b2f8657a-3b46-4736-8a9e-101e997c0b30. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG nova.network.neutron [req-a488fcee-3bdc-409d-a252-e713cde70ec4 req-9a1f2bdc-9747-4b87-860d-dbbd65ec02d8 service nova] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Updating instance_info_cache with network_info: [{"id": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "address": "fa:16:3e:d2:a9:51", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2f8657a-3b", "ovs_interfaceid": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a488fcee-3bdc-409d-a252-e713cde70ec4 req-9a1f2bdc-9747-4b87-860d-dbbd65ec02d8 service nova] Releasing lock "refresh_cache-1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG nova.network.neutron [req-85c729f9-8071-4afa-80ea-21e0f8f646da req-af3866a3-bcd5-4bb9-b2b7-ea507e917bef service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updated VIF entry in instance network info cache for port 30895720-729f-445d-b49a-d843f1cb23a8. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG nova.network.neutron [req-85c729f9-8071-4afa-80ea-21e0f8f646da req-af3866a3-bcd5-4bb9-b2b7-ea507e917bef service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updating instance_info_cache with network_info: [{"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-297d00c0-8f14-4984-99b1-b875a646d58f req-e4500c31-cdb1-4d0d-b9ba-d4f95e5e2cdf service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-21361178-8b0b-43fb-9381-37e603f8d993 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-297d00c0-8f14-4984-99b1-b875a646d58f req-e4500c31-cdb1-4d0d-b9ba-d4f95e5e2cdf service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-297d00c0-8f14-4984-99b1-b875a646d58f req-e4500c31-cdb1-4d0d-b9ba-d4f95e5e2cdf service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-297d00c0-8f14-4984-99b1-b875a646d58f req-e4500c31-cdb1-4d0d-b9ba-d4f95e5e2cdf service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-297d00c0-8f14-4984-99b1-b875a646d58f req-e4500c31-cdb1-4d0d-b9ba-d4f95e5e2cdf service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-21361178-8b0b-43fb-9381-37e603f8d993 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:49 user nova-compute[75071]: WARNING nova.compute.manager [req-297d00c0-8f14-4984-99b1-b875a646d58f req-e4500c31-cdb1-4d0d-b9ba-d4f95e5e2cdf service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-21361178-8b0b-43fb-9381-37e603f8d993 for instance with vm_state building and task_state spawning.
Dec 05 12:18:49 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Updating instance_info_cache with network_info: [{"id": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "address": "fa:16:3e:32:a2:62", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f59600f-fe", "ovs_interfaceid": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-85c729f9-8071-4afa-80ea-21e0f8f646da req-af3866a3-bcd5-4bb9-b2b7-ea507e917bef service nova] Releasing lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:18:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-917c9030-518c-41bc-9a61-bd5ad37401a1 req-a7eb47a5-90f4-4c4f-973f-3f9100058839 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-cc837761-a388-414b-9c08-8835b4e255c7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-917c9030-518c-41bc-9a61-bd5ad37401a1 req-a7eb47a5-90f4-4c4f-973f-3f9100058839 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-917c9030-518c-41bc-9a61-bd5ad37401a1 req-a7eb47a5-90f4-4c4f-973f-3f9100058839 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-917c9030-518c-41bc-9a61-bd5ad37401a1 req-a7eb47a5-90f4-4c4f-973f-3f9100058839 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-917c9030-518c-41bc-9a61-bd5ad37401a1 req-a7eb47a5-90f4-4c4f-973f-3f9100058839 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-cc837761-a388-414b-9c08-8835b4e255c7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:50 user nova-compute[75071]: WARNING nova.compute.manager [req-917c9030-518c-41bc-9a61-bd5ad37401a1 req-a7eb47a5-90f4-4c4f-973f-3f9100058839 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-cc837761-a388-414b-9c08-8835b4e255c7 for instance with vm_state building and task_state spawning.
Dec 05 12:18:50 user nova-compute[75071]: INFO nova.compute.manager [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] instance snapshotting
Dec 05 12:18:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:50 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Beginning live snapshot process
Dec 05 12:18:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-5e5786c4-94f5-42a8-abe0-a131b2d73b05 req-f58643de-5b8f-4058-8b89-6c75b35f9c39 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-deb82347-819f-40f5-bc84-b1562c29af71 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5e5786c4-94f5-42a8-abe0-a131b2d73b05 req-f58643de-5b8f-4058-8b89-6c75b35f9c39 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5e5786c4-94f5-42a8-abe0-a131b2d73b05 req-f58643de-5b8f-4058-8b89-6c75b35f9c39 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5e5786c4-94f5-42a8-abe0-a131b2d73b05 req-f58643de-5b8f-4058-8b89-6c75b35f9c39 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-5e5786c4-94f5-42a8-abe0-a131b2d73b05 req-f58643de-5b8f-4058-8b89-6c75b35f9c39 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-deb82347-819f-40f5-bc84-b1562c29af71 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:50 user nova-compute[75071]: WARNING nova.compute.manager [req-5e5786c4-94f5-42a8-abe0-a131b2d73b05 req-f58643de-5b8f-4058-8b89-6c75b35f9c39 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-deb82347-819f-40f5-bc84-b1562c29af71 for instance with vm_state building and task_state spawning.
Dec 05 12:18:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json -f qcow2 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json -f qcow2 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json -f qcow2" returned: 0 in 0.221s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.221s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph6ztuw6r/6cc73f49a94e4cb5ad74f367fe693ecb.delta 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph6ztuw6r/6cc73f49a94e4cb5ad74f367fe693ecb.delta 1073741824" returned: 0 in 0.079s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:51 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 05 12:18:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75071) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Dec 05 12:18:51 user nova-compute[75071]: INFO nova.virt.libvirt.host [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] UEFI support detected
Dec 05 12:18:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Received event network-changed-8f59600f-fe54-49ac-b95c-fc44bad6b5d7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Refreshing instance network info cache due to event network-changed-8f59600f-fe54-49ac-b95c-fc44bad6b5d7. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] Acquiring lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] Acquired lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG nova.network.neutron [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Refreshing network info cache for port 8f59600f-fe54-49ac-b95c-fc44bad6b5d7 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-732b1822-accf-442a-b436-4e4de8bfeffe req-d50219cc-0e63-4bc4-b7db-ea6dea3dc87b service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-cc837761-a388-414b-9c08-8835b4e255c7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-732b1822-accf-442a-b436-4e4de8bfeffe req-d50219cc-0e63-4bc4-b7db-ea6dea3dc87b service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-732b1822-accf-442a-b436-4e4de8bfeffe req-d50219cc-0e63-4bc4-b7db-ea6dea3dc87b service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-732b1822-accf-442a-b436-4e4de8bfeffe req-d50219cc-0e63-4bc4-b7db-ea6dea3dc87b service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-732b1822-accf-442a-b436-4e4de8bfeffe req-d50219cc-0e63-4bc4-b7db-ea6dea3dc87b service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-cc837761-a388-414b-9c08-8835b4e255c7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:52 user nova-compute[75071]: WARNING nova.compute.manager [req-732b1822-accf-442a-b436-4e4de8bfeffe req-d50219cc-0e63-4bc4-b7db-ea6dea3dc87b service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-cc837761-a388-414b-9c08-8835b4e255c7 for instance with vm_state building and task_state spawning.
Dec 05 12:18:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-732b1822-accf-442a-b436-4e4de8bfeffe req-d50219cc-0e63-4bc4-b7db-ea6dea3dc87b service nova] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Received event network-vif-plugged-b2f8657a-3b46-4736-8a9e-101e997c0b30 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-732b1822-accf-442a-b436-4e4de8bfeffe req-d50219cc-0e63-4bc4-b7db-ea6dea3dc87b service nova] Acquiring lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-732b1822-accf-442a-b436-4e4de8bfeffe req-d50219cc-0e63-4bc4-b7db-ea6dea3dc87b service nova] Lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-732b1822-accf-442a-b436-4e4de8bfeffe req-d50219cc-0e63-4bc4-b7db-ea6dea3dc87b service nova] Lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-732b1822-accf-442a-b436-4e4de8bfeffe req-d50219cc-0e63-4bc4-b7db-ea6dea3dc87b service nova] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] No waiting events found dispatching network-vif-plugged-b2f8657a-3b46-4736-8a9e-101e997c0b30 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:52 user nova-compute[75071]: WARNING nova.compute.manager [req-732b1822-accf-442a-b436-4e4de8bfeffe req-d50219cc-0e63-4bc4-b7db-ea6dea3dc87b service nova] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Received unexpected event network-vif-plugged-b2f8657a-3b46-4736-8a9e-101e997c0b30 for instance with vm_state building and task_state spawning.
Dec 05 12:18:52 user nova-compute[75071]: DEBUG nova.network.neutron [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Updated VIF entry in instance network info cache for port 8f59600f-fe54-49ac-b95c-fc44bad6b5d7. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG nova.network.neutron [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Updating instance_info_cache with network_info: [{"id": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "address": "fa:16:3e:32:a2:62", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f59600f-fe", "ovs_interfaceid": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] Releasing lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-21361178-8b0b-43fb-9381-37e603f8d993 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-21361178-8b0b-43fb-9381-37e603f8d993 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:52 user nova-compute[75071]: WARNING nova.compute.manager [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-21361178-8b0b-43fb-9381-37e603f8d993 for instance with vm_state building and task_state spawning.
Dec 05 12:18:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-30d569c6-052c-487b-99d8-142bed67ae7e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-30d569c6-052c-487b-99d8-142bed67ae7e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:52 user nova-compute[75071]: WARNING nova.compute.manager [req-43c59b0e-e213-46a6-9e4e-25b063817be4 req-e7efc1ba-b5dd-41da-a030-1707d3852075 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-30d569c6-052c-487b-99d8-142bed67ae7e for instance with vm_state building and task_state spawning.
Dec 05 12:18:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-c522fd72-0446-4149-93df-c584ce978fee req-fcd36174-586d-4523-b5b7-877012c13b2c service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-deb82347-819f-40f5-bc84-b1562c29af71 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c522fd72-0446-4149-93df-c584ce978fee req-fcd36174-586d-4523-b5b7-877012c13b2c service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c522fd72-0446-4149-93df-c584ce978fee req-fcd36174-586d-4523-b5b7-877012c13b2c service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c522fd72-0446-4149-93df-c584ce978fee req-fcd36174-586d-4523-b5b7-877012c13b2c service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-c522fd72-0446-4149-93df-c584ce978fee req-fcd36174-586d-4523-b5b7-877012c13b2c service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-deb82347-819f-40f5-bc84-b1562c29af71 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:52 user nova-compute[75071]: WARNING nova.compute.manager [req-c522fd72-0446-4149-93df-c584ce978fee req-fcd36174-586d-4523-b5b7-877012c13b2c service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-deb82347-819f-40f5-bc84-b1562c29af71 for instance with vm_state building and task_state spawning.
Dec 05 12:18:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] COPY block job progress, current cursor: 24051712 final cursor: 75497472 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-e426b699-21f7-4d68-8ae3-859c42539634 req-40b37904-c1ee-4e9e-901c-6350e4ed6417 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-30d569c6-052c-487b-99d8-142bed67ae7e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e426b699-21f7-4d68-8ae3-859c42539634 req-40b37904-c1ee-4e9e-901c-6350e4ed6417 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e426b699-21f7-4d68-8ae3-859c42539634 req-40b37904-c1ee-4e9e-901c-6350e4ed6417 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e426b699-21f7-4d68-8ae3-859c42539634 req-40b37904-c1ee-4e9e-901c-6350e4ed6417 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-e426b699-21f7-4d68-8ae3-859c42539634 req-40b37904-c1ee-4e9e-901c-6350e4ed6417 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-30d569c6-052c-487b-99d8-142bed67ae7e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:53 user nova-compute[75071]: WARNING nova.compute.manager [req-e426b699-21f7-4d68-8ae3-859c42539634 req-40b37904-c1ee-4e9e-901c-6350e4ed6417 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-30d569c6-052c-487b-99d8-142bed67ae7e for instance with vm_state building and task_state spawning.
Dec 05 12:18:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-e426b699-21f7-4d68-8ae3-859c42539634 req-40b37904-c1ee-4e9e-901c-6350e4ed6417 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-26c5a6d6-9037-490d-b40b-8e0c5bb16d0b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e426b699-21f7-4d68-8ae3-859c42539634 req-40b37904-c1ee-4e9e-901c-6350e4ed6417 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e426b699-21f7-4d68-8ae3-859c42539634 req-40b37904-c1ee-4e9e-901c-6350e4ed6417 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e426b699-21f7-4d68-8ae3-859c42539634 req-40b37904-c1ee-4e9e-901c-6350e4ed6417 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-e426b699-21f7-4d68-8ae3-859c42539634 req-40b37904-c1ee-4e9e-901c-6350e4ed6417 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-26c5a6d6-9037-490d-b40b-8e0c5bb16d0b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:53 user nova-compute[75071]: WARNING nova.compute.manager [req-e426b699-21f7-4d68-8ae3-859c42539634 req-40b37904-c1ee-4e9e-901c-6350e4ed6417 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-26c5a6d6-9037-490d-b40b-8e0c5bb16d0b for instance with vm_state building and task_state spawning.
Dec 05 12:18:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-e426b699-21f7-4d68-8ae3-859c42539634 req-40b37904-c1ee-4e9e-901c-6350e4ed6417 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-26c5a6d6-9037-490d-b40b-8e0c5bb16d0b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e426b699-21f7-4d68-8ae3-859c42539634 req-40b37904-c1ee-4e9e-901c-6350e4ed6417 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e426b699-21f7-4d68-8ae3-859c42539634 req-40b37904-c1ee-4e9e-901c-6350e4ed6417 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e426b699-21f7-4d68-8ae3-859c42539634 req-40b37904-c1ee-4e9e-901c-6350e4ed6417 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-e426b699-21f7-4d68-8ae3-859c42539634 req-40b37904-c1ee-4e9e-901c-6350e4ed6417 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-26c5a6d6-9037-490d-b40b-8e0c5bb16d0b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:53 user nova-compute[75071]: WARNING nova.compute.manager [req-e426b699-21f7-4d68-8ae3-859c42539634 req-40b37904-c1ee-4e9e-901c-6350e4ed6417 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-26c5a6d6-9037-490d-b40b-8e0c5bb16d0b for instance with vm_state building and task_state spawning.
Dec 05 12:18:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] COPY block job progress, current cursor: 75628544 final cursor: 75628544 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:18:53 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 05 12:18:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:54 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 12:18:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph6ztuw6r/6cc73f49a94e4cb5ad74f367fe693ecb.delta /opt/stack/data/nova/instances/snapshots/tmph6ztuw6r/6cc73f49a94e4cb5ad74f367fe693ecb {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-1c11e832-3c9d-4d0a-8726-908a7b462e89 req-f4e239f4-a5da-4c66-85b5-09821c4f6dff service nova] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Received event network-vif-plugged-b2f8657a-3b46-4736-8a9e-101e997c0b30 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1c11e832-3c9d-4d0a-8726-908a7b462e89 req-f4e239f4-a5da-4c66-85b5-09821c4f6dff service nova] Acquiring lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1c11e832-3c9d-4d0a-8726-908a7b462e89 req-f4e239f4-a5da-4c66-85b5-09821c4f6dff service nova] Lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1c11e832-3c9d-4d0a-8726-908a7b462e89 req-f4e239f4-a5da-4c66-85b5-09821c4f6dff service nova] Lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-1c11e832-3c9d-4d0a-8726-908a7b462e89 req-f4e239f4-a5da-4c66-85b5-09821c4f6dff service nova] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] No waiting events found dispatching network-vif-plugged-b2f8657a-3b46-4736-8a9e-101e997c0b30 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:54 user nova-compute[75071]: WARNING nova.compute.manager [req-1c11e832-3c9d-4d0a-8726-908a7b462e89 req-f4e239f4-a5da-4c66-85b5-09821c4f6dff service nova] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Received unexpected event network-vif-plugged-b2f8657a-3b46-4736-8a9e-101e997c0b30 for instance with vm_state building and task_state spawning.
Dec 05 12:18:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-a65502d1-d956-4e76-9d79-193748a04898 req-b816df57-5a91-4fec-8d95-5aac9c9e6c65 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-d96e645b-e317-4ac8-88b4-67e62a3c41b7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a65502d1-d956-4e76-9d79-193748a04898 req-b816df57-5a91-4fec-8d95-5aac9c9e6c65 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a65502d1-d956-4e76-9d79-193748a04898 req-b816df57-5a91-4fec-8d95-5aac9c9e6c65 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a65502d1-d956-4e76-9d79-193748a04898 req-b816df57-5a91-4fec-8d95-5aac9c9e6c65 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-a65502d1-d956-4e76-9d79-193748a04898 req-b816df57-5a91-4fec-8d95-5aac9c9e6c65 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-d96e645b-e317-4ac8-88b4-67e62a3c41b7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:55 user nova-compute[75071]: WARNING nova.compute.manager [req-a65502d1-d956-4e76-9d79-193748a04898 req-b816df57-5a91-4fec-8d95-5aac9c9e6c65 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-d96e645b-e317-4ac8-88b4-67e62a3c41b7 for instance with vm_state building and task_state spawning.
Dec 05 12:18:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-a65502d1-d956-4e76-9d79-193748a04898 req-b816df57-5a91-4fec-8d95-5aac9c9e6c65 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-d96e645b-e317-4ac8-88b4-67e62a3c41b7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a65502d1-d956-4e76-9d79-193748a04898 req-b816df57-5a91-4fec-8d95-5aac9c9e6c65 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a65502d1-d956-4e76-9d79-193748a04898 req-b816df57-5a91-4fec-8d95-5aac9c9e6c65 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a65502d1-d956-4e76-9d79-193748a04898 req-b816df57-5a91-4fec-8d95-5aac9c9e6c65 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-a65502d1-d956-4e76-9d79-193748a04898 req-b816df57-5a91-4fec-8d95-5aac9c9e6c65 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-d96e645b-e317-4ac8-88b4-67e62a3c41b7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:55 user nova-compute[75071]: WARNING nova.compute.manager [req-a65502d1-d956-4e76-9d79-193748a04898 req-b816df57-5a91-4fec-8d95-5aac9c9e6c65 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-d96e645b-e317-4ac8-88b4-67e62a3c41b7 for instance with vm_state building and task_state spawning.
Dec 05 12:18:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-58b2c565-768e-4d33-a052-b204e5eb7d8a req-05792f7b-5268-48d3-93bf-936892aecb69 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-7eadd24f-487c-4d19-b5eb-7d9483bf1800 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-58b2c565-768e-4d33-a052-b204e5eb7d8a req-05792f7b-5268-48d3-93bf-936892aecb69 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-58b2c565-768e-4d33-a052-b204e5eb7d8a req-05792f7b-5268-48d3-93bf-936892aecb69 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-58b2c565-768e-4d33-a052-b204e5eb7d8a req-05792f7b-5268-48d3-93bf-936892aecb69 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-58b2c565-768e-4d33-a052-b204e5eb7d8a req-05792f7b-5268-48d3-93bf-936892aecb69 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-7eadd24f-487c-4d19-b5eb-7d9483bf1800 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:55 user nova-compute[75071]: WARNING nova.compute.manager [req-58b2c565-768e-4d33-a052-b204e5eb7d8a req-05792f7b-5268-48d3-93bf-936892aecb69 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-7eadd24f-487c-4d19-b5eb-7d9483bf1800 for instance with vm_state building and task_state spawning.
Dec 05 12:18:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-58b2c565-768e-4d33-a052-b204e5eb7d8a req-05792f7b-5268-48d3-93bf-936892aecb69 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-7eadd24f-487c-4d19-b5eb-7d9483bf1800 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-58b2c565-768e-4d33-a052-b204e5eb7d8a req-05792f7b-5268-48d3-93bf-936892aecb69 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:18:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-58b2c565-768e-4d33-a052-b204e5eb7d8a req-05792f7b-5268-48d3-93bf-936892aecb69 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:18:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-58b2c565-768e-4d33-a052-b204e5eb7d8a req-05792f7b-5268-48d3-93bf-936892aecb69 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-58b2c565-768e-4d33-a052-b204e5eb7d8a req-05792f7b-5268-48d3-93bf-936892aecb69 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-7eadd24f-487c-4d19-b5eb-7d9483bf1800 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:18:55 user nova-compute[75071]: WARNING nova.compute.manager [req-58b2c565-768e-4d33-a052-b204e5eb7d8a req-05792f7b-5268-48d3-93bf-936892aecb69 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-7eadd24f-487c-4d19-b5eb-7d9483bf1800 for instance with vm_state building and task_state spawning.
Dec 05 12:18:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph6ztuw6r/6cc73f49a94e4cb5ad74f367fe693ecb.delta /opt/stack/data/nova/instances/snapshots/tmph6ztuw6r/6cc73f49a94e4cb5ad74f367fe693ecb" returned: 0 in 1.842s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:55 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Snapshot extracted, beginning image upload
Dec 05 12:18:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:18:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:18:56 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Instance spawned successfully.
Dec 05 12:18:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:18:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:18:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:18:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:18:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:18:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:18:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:18:56 user nova-compute[75071]: INFO nova.compute.manager [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Took 10.30 seconds to spawn the instance on the hypervisor.
Dec 05 12:18:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:18:56 user nova-compute[75071]: INFO nova.compute.manager [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Took 17.37 seconds to build instance.
Dec 05 12:18:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a24149cb-b819-46cc-b6d1-1c80c5208a88 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.524s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-91b3ef31-28fe-4664-a598-cf3a11775f54 req-55b1014a-faf1-4a0d-a259-40fef8a0ecfc service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Received event network-changed-cbc3d793-a281-45c9-a3fa-4d1fb88a3d45 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-91b3ef31-28fe-4664-a598-cf3a11775f54 req-55b1014a-faf1-4a0d-a259-40fef8a0ecfc service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Refreshing instance network info cache due to event network-changed-cbc3d793-a281-45c9-a3fa-4d1fb88a3d45. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-91b3ef31-28fe-4664-a598-cf3a11775f54 req-55b1014a-faf1-4a0d-a259-40fef8a0ecfc service nova] Acquiring lock "refresh_cache-854ee980-5c0b-4c4f-b9fd-609720e693be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-91b3ef31-28fe-4664-a598-cf3a11775f54 req-55b1014a-faf1-4a0d-a259-40fef8a0ecfc service nova] Acquired lock "refresh_cache-854ee980-5c0b-4c4f-b9fd-609720e693be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:57 user nova-compute[75071]: DEBUG nova.network.neutron [req-91b3ef31-28fe-4664-a598-cf3a11775f54 req-55b1014a-faf1-4a0d-a259-40fef8a0ecfc service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Refreshing network info cache for port cbc3d793-a281-45c9-a3fa-4d1fb88a3d45 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:18:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:18:57 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Instance spawned successfully.
Dec 05 12:18:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:18:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:18:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:18:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:18:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:18:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:18:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:18:57 user nova-compute[75071]: INFO nova.compute.manager [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Took 26.37 seconds to spawn the instance on the hypervisor.
Dec 05 12:18:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:18:57 user nova-compute[75071]: INFO nova.compute.manager [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Took 62.60 seconds to build instance.
Dec 05 12:18:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e38bc749-acc1-4e8f-b180-fc70d7d1edf8 tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 62.744s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:18:57 user nova-compute[75071]: DEBUG nova.network.neutron [req-91b3ef31-28fe-4664-a598-cf3a11775f54 req-55b1014a-faf1-4a0d-a259-40fef8a0ecfc service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Updated VIF entry in instance network info cache for port cbc3d793-a281-45c9-a3fa-4d1fb88a3d45. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:18:57 user nova-compute[75071]: DEBUG nova.network.neutron [req-91b3ef31-28fe-4664-a598-cf3a11775f54 req-55b1014a-faf1-4a0d-a259-40fef8a0ecfc service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Updating instance_info_cache with network_info: [{"id": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "address": "fa:16:3e:85:5c:09", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc3d793-a2", "ovs_interfaceid": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-91b3ef31-28fe-4664-a598-cf3a11775f54 req-55b1014a-faf1-4a0d-a259-40fef8a0ecfc service nova] Releasing lock "refresh_cache-854ee980-5c0b-4c4f-b9fd-609720e693be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:18:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:18:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:18:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQRwvdHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:18:58 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:18:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:18:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:18:58 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:18:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:18:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:18:58 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:18:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7fc1f9-b413-4f11-abff-0c35869b71b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:18:59 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9236785e-36dd-4cb9-8396-4ab50a41c1d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c] added
Dec 05 12:18:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2e008e-a8cd-4233-bb0b-f73ba2afa098]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a8534f-7cc4-484a-b8be-9c8499f54503]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UQRwvdHF {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UQRwvdHF" returned: 0 in 0.030s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f4cef1-4a2c-42a2-b9d3-71e86217c6ed]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UQRwvdHF'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-5aa48f01-93e0-4944-b595-6ae106f7d696 req-a44cfdf6-044f-4ea3-9384-5de68a97121b service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Received event network-changed-e56ba39e-d25b-410b-ad40-c5c31f2f7ba4 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-5aa48f01-93e0-4944-b595-6ae106f7d696 req-a44cfdf6-044f-4ea3-9384-5de68a97121b service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Refreshing instance network info cache due to event network-changed-e56ba39e-d25b-410b-ad40-c5c31f2f7ba4. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5aa48f01-93e0-4944-b595-6ae106f7d696 req-a44cfdf6-044f-4ea3-9384-5de68a97121b service nova] Acquiring lock "refresh_cache-0d640cf7-170a-4d3e-8983-6165aab46bae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5aa48f01-93e0-4944-b595-6ae106f7d696 req-a44cfdf6-044f-4ea3-9384-5de68a97121b service nova] Acquired lock "refresh_cache-0d640cf7-170a-4d3e-8983-6165aab46bae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-5aa48f01-93e0-4944-b595-6ae106f7d696 req-a44cfdf6-044f-4ea3-9384-5de68a97121b service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Refreshing network info cache for port e56ba39e-d25b-410b-ad40-c5c31f2f7ba4 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.044s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2d6afd-bccc-418c-bfce-df541f1a0acb]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d001ae-046f-4ec2-b269-9ce5436436ce]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:18:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:18:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f0f88e-bae4-4c49-9bea-0f7bd3c5b61a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c, portal: 172.16.0.220,3260]
Dec 05 12:18:59 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c, portal: 172.16.0.220,3260] successful.
Dec 05 12:18:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0833126-a38b-4d6f-936d-b3ed08af6575]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d96a934-9fc0-48f5-9721-7d39d0df6954]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:18:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:18:59 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:18:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.458s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.041s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[01adb6e9-c4c0-49ae-bf0a-70b4f5c4b50a]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:18:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Snapshot image upload complete
Dec 05 12:18:59 user nova-compute[75071]: INFO nova.compute.manager [None req-144e2de4-0343-4227-834f-46465496624b tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Took 9.41 seconds to snapshot the instance on the hypervisor.
Dec 05 12:18:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-5aa48f01-93e0-4944-b595-6ae106f7d696 req-a44cfdf6-044f-4ea3-9384-5de68a97121b service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Updated VIF entry in instance network info cache for port e56ba39e-d25b-410b-ad40-c5c31f2f7ba4. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-5aa48f01-93e0-4944-b595-6ae106f7d696 req-a44cfdf6-044f-4ea3-9384-5de68a97121b service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Updating instance_info_cache with network_info: [{"id": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "address": "fa:16:3e:5a:b3:91", "network": {"id": "0aeb2212-537b-4b5a-bf1c-7db98afb29dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-443578788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d309487087b4b089a63e314fd8813e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape56ba39e-d2", "ovs_interfaceid": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:18:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5aa48f01-93e0-4944-b595-6ae106f7d696 req-a44cfdf6-044f-4ea3-9384-5de68a97121b service nova] Releasing lock "refresh_cache-0d640cf7-170a-4d3e-8983-6165aab46bae" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQRwvdHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.516s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] <== connect_volume: return (1517ms) {'type': 'block', 'scsi_wwn': '23138323531663064', 'path': '/dev/sdi'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138323531663064', 'path': '/dev/sdi'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "854ee980-5c0b-4c4f-b9fd-609720e693be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lazy-loading 'flavor' on Instance uuid 81333acc-8dc7-42f1-9026-e42a30e52a5a {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lazy-loading 'flavor' on Instance uuid 854ee980-5c0b-4c4f-b9fd-609720e693be {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:19:00 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:19:00 user nova-compute[75071]:   <source dev="/dev/sdi"/>
Dec 05 12:19:00 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:19:00 user nova-compute[75071]:   <serial>93490fef-282f-4f1b-bc4e-0489b01f710c</serial>
Dec 05 12:19:00 user nova-compute[75071]: </disk>
Dec 05 12:19:00 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.169s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-d4a11798-d3ea-46bc-9326-c18db7d6fbd6 req-74760b67-e4a7-4e68-9ca9-d783398ddc77 service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Received event network-changed-eb24fe21-798a-4e87-97e8-5e355a77257f {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-d4a11798-d3ea-46bc-9326-c18db7d6fbd6 req-74760b67-e4a7-4e68-9ca9-d783398ddc77 service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Refreshing instance network info cache due to event network-changed-eb24fe21-798a-4e87-97e8-5e355a77257f. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d4a11798-d3ea-46bc-9326-c18db7d6fbd6 req-74760b67-e4a7-4e68-9ca9-d783398ddc77 service nova] Acquiring lock "refresh_cache-2625dd24-5c50-4911-9515-57c9483bafa1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d4a11798-d3ea-46bc-9326-c18db7d6fbd6 req-74760b67-e4a7-4e68-9ca9-d783398ddc77 service nova] Acquired lock "refresh_cache-2625dd24-5c50-4911-9515-57c9483bafa1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG nova.network.neutron [req-d4a11798-d3ea-46bc-9326-c18db7d6fbd6 req-74760b67-e4a7-4e68-9ca9-d783398ddc77 service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Refreshing network info cache for port eb24fe21-798a-4e87-97e8-5e355a77257f {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "854ee980-5c0b-4c4f-b9fd-609720e693be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:00 user nova-compute[75071]: INFO nova.compute.manager [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Attaching volume d2d477f6-bcc5-4fa7-b93d-fcd32423a829 to /dev/vdb
Dec 05 12:19:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Acquiring lock "0d640cf7-170a-4d3e-8983-6165aab46bae" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lazy-loading 'flavor' on Instance uuid 0d640cf7-170a-4d3e-8983-6165aab46bae {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG os_brick.utils [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[46da8527-ac46-4d82-9308-fad0f89fd4f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ef21eb-992e-4f03-b9ff-fcc3c6b12e8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.041s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ac5426-6899-44b5-a3a3-ac7de3642003]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8851a9df-0c37-4a07-92b9-55ec751e803d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Acquiring lock "2625dd24-5c50-4911-9515-57c9483bafa1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "2625dd24-5c50-4911-9515-57c9483bafa1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:19:01 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8349545d-b073-41d9-93a4-39b5406c73ee]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG nova.objects.instance [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lazy-loading 'flavor' on Instance uuid 2625dd24-5c50-4911-9515-57c9483bafa1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG os_brick.utils [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] <== get_connector_properties: return (205ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Updating existing volume attachment record: 82f1fc37-77fe-4fb7-98fb-34bd7a9a5dfb {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Acquiring lock "0d640cf7-170a-4d3e-8983-6165aab46bae" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:01 user nova-compute[75071]: INFO nova.compute.manager [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Attaching volume ac667f29-b7c2-40df-a9c6-3786ab7848ec to /dev/sdc
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "2625dd24-5c50-4911-9515-57c9483bafa1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG os_brick.utils [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.036s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab3ff70-135f-4ffa-aa66-52ba6ede43a0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58dad6c-b298-4b0e-b18e-989fe505ea55]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG nova.network.neutron [req-d4a11798-d3ea-46bc-9326-c18db7d6fbd6 req-74760b67-e4a7-4e68-9ca9-d783398ddc77 service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Updated VIF entry in instance network info cache for port eb24fe21-798a-4e87-97e8-5e355a77257f. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG nova.network.neutron [req-d4a11798-d3ea-46bc-9326-c18db7d6fbd6 req-74760b67-e4a7-4e68-9ca9-d783398ddc77 service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Updating instance_info_cache with network_info: [{"id": "eb24fe21-798a-4e87-97e8-5e355a77257f", "address": "fa:16:3e:fd:56:66", "network": {"id": "466db5e3-5c09-4319-9cee-3b0c44e1c718", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1639720127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "522698b61d514357b9ea490cbfa828ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb24fe21-79", "ovs_interfaceid": "eb24fe21-798a-4e87-97e8-5e355a77257f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a2c91b-7cf8-469b-b2e0-b20765ab7e6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e31650-a253-4d1e-92ed-624837bc6578]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d4a11798-d3ea-46bc-9326-c18db7d6fbd6 req-74760b67-e4a7-4e68-9ca9-d783398ddc77 service nova] Releasing lock "refresh_cache-2625dd24-5c50-4911-9515-57c9483bafa1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] No VIF found with MAC fa:16:3e:53:f5:d1, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:19:01 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3c44aa-cee4-47c5-b0d5-7255c7d083ae]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG os_brick.utils [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] <== get_connector_properties: return (211ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Updating existing volume attachment record: 3d80132b-278d-4c8d-93c6-559532d17f20 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Acquiring lock "2625dd24-5c50-4911-9515-57c9483bafa1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "2625dd24-5c50-4911-9515-57c9483bafa1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:01 user nova-compute[75071]: INFO nova.compute.manager [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Attaching volume f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 to /dev/vdb
Dec 05 12:19:01 user nova-compute[75071]: DEBUG os_brick.utils [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[722619bf-3931-43ec-864a-ee27f1909a75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3af484-7144-4b34-ac66-d55f666c094f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2d7d99-39a7-4198-8a9d-ca5cdd5cc6bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[959da77d-4e2a-4a79-a71b-175a89077670]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c0f53ec7-cbac-4800-afaa-ebaed523b6ec tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.204s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:19:01 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:19:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a0ccaf-de1c-4ea1-ad91-8170bf7b10d5]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG os_brick.utils [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:19:01 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Updating existing volume attachment record: 97445552-eff3-4768-9dca-dc713c07678e {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:19:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-b26856a9-3002-497e-9644-d284daa19c12 req-e58c4929-4974-4a91-aa2a-c1f575b648ed service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Received event network-changed-cbe4b036-1cc2-4514-8a71-4709d97cc4a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-b26856a9-3002-497e-9644-d284daa19c12 req-e58c4929-4974-4a91-aa2a-c1f575b648ed service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Refreshing instance network info cache due to event network-changed-cbe4b036-1cc2-4514-8a71-4709d97cc4a7. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b26856a9-3002-497e-9644-d284daa19c12 req-e58c4929-4974-4a91-aa2a-c1f575b648ed service nova] Acquiring lock "refresh_cache-332f0212-d8e4-4a99-9688-01a26ba66916" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b26856a9-3002-497e-9644-d284daa19c12 req-e58c4929-4974-4a91-aa2a-c1f575b648ed service nova] Acquired lock "refresh_cache-332f0212-d8e4-4a99-9688-01a26ba66916" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG nova.network.neutron [req-b26856a9-3002-497e-9644-d284daa19c12 req-e58c4929-4974-4a91-aa2a-c1f575b648ed service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Refreshing network info cache for port cbe4b036-1cc2-4514-8a71-4709d97cc4a7 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbgGOBUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:19:14 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:19:14 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:19:14 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ac2e49-19c9-4807-9d43-66a0e749a381]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:19:14 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c36bde-5751-41ed-8ac3-b24b62fbb67a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec] added
Dec 05 12:19:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCYnwMIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:19:14 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[752e5bed-9216-4e3e-9cdb-69844f380e18]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[148f20eb-bd13-4254-8195-95038cec40b6]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jbgGOBUr {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG nova.network.neutron [req-b26856a9-3002-497e-9644-d284daa19c12 req-e58c4929-4974-4a91-aa2a-c1f575b648ed service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Updated VIF entry in instance network info cache for port cbe4b036-1cc2-4514-8a71-4709d97cc4a7. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG nova.network.neutron [req-b26856a9-3002-497e-9644-d284daa19c12 req-e58c4929-4974-4a91-aa2a-c1f575b648ed service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Updating instance_info_cache with network_info: [{"id": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "address": "fa:16:3e:79:0d:f2", "network": {"id": "4c4be769-0b96-4b02-b391-b523b458e179", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460819884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ee1f941e7214607a1997d44cb9c93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe4b036-1c", "ovs_interfaceid": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jbgGOBUr" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c427cd08-2bae-4012-b853-2e47a9d04e59]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jbgGOBUr'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b26856a9-3002-497e-9644-d284daa19c12 req-e58c4929-4974-4a91-aa2a-c1f575b648ed service nova] Releasing lock "refresh_cache-332f0212-d8e4-4a99-9688-01a26ba66916" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f730b7b-3129-44d1-983a-9df8f46c1d80]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Acquiring lock "332f0212-d8e4-4a99-9688-01a26ba66916" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Lock "332f0212-d8e4-4a99-9688-01a26ba66916" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Lazy-loading 'flavor' on Instance uuid 332f0212-d8e4-4a99-9688-01a26ba66916 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d12dacb-5c51-4b97-a054-b3e84043e92c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Lock "332f0212-d8e4-4a99-9688-01a26ba66916" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.149s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --login" returned: 0 in 0.113s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fcdb0f-a541-477f-8d85-be07d1f2b2c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec, portal: 172.16.0.220,3260]
Dec 05 12:19:14 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec, portal: 172.16.0.220,3260] successful.
Dec 05 12:19:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb28bc2-8e20-4eb0-9274-082307b4810e]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf2bbb6-42ae-4161-8174-c59926df238a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:14 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:19:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.033s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[494406f1-4ca6-467a-84c6-6c399f5e5d4c]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsPxzpIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:19:15 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:19:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Acquiring lock "332f0212-d8e4-4a99-9688-01a26ba66916" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Lock "332f0212-d8e4-4a99-9688-01a26ba66916" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:15 user nova-compute[75071]: INFO nova.compute.manager [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Attaching volume e46fef52-7f34-41a4-94a3-36c840458af5 to /dev/vdb
Dec 05 12:19:15 user nova-compute[75071]: DEBUG os_brick.utils [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.056s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3de9c6-5b22-4ff3-aeab-81c449c8b7b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.055s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[72acff3a-13ab-448a-b59a-1c36ec4aa758]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9d330a-c5e5-4d57-9a76-82e7f197b318]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffc1208-1e70-4994-a479-084da7f877f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbgGOBUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.494s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] <== connect_volume: return (1496ms) {'type': 'block', 'scsi_wwn': '23635616135663161', 'path': '/dev/sdj'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635616135663161', 'path': '/dev/sdj'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.433s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:19:15 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:19:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:19:15 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:19:15 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[30352cdd-ccd1-478d-930a-0a87d96ce8a3]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG os_brick.utils [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] <== get_connector_properties: return (235ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Updating existing volume attachment record: 1fc8f2c1-16fc-433a-b7d8-13fa7613f07a {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80f427e-d200-4cac-a4ef-9fecf135e6a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG nova.objects.instance [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lazy-loading 'flavor' on Instance uuid 0d640cf7-170a-4d3e-8983-6165aab46bae {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:19:15 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b59661c-3c6f-4928-b5e9-f3e5b99db73f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829] added
Dec 05 12:19:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:19:16 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:19:16 user nova-compute[75071]:   <source dev="/dev/sdj"/>
Dec 05 12:19:16 user nova-compute[75071]:   <target dev="sdc" bus="scsi"/>
Dec 05 12:19:16 user nova-compute[75071]:   <serial>ac667f29-b7c2-40df-a9c6-3786ab7848ec</serial>
Dec 05 12:19:16 user nova-compute[75071]:   <address type="drive" controller="0" unit="2"/>
Dec 05 12:19:16 user nova-compute[75071]: </disk>
Dec 05 12:19:16 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2c15b7-71bb-4d05-9e3a-16a5e89c7b35]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b667b9-3238-4f88-9e46-91c2d7941278]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UCYnwMIG {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UCYnwMIG" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a232f96c-5ee9-4212-b956-344a5df56e9f]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UCYnwMIG'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[490d0c1f-2d1a-4324-a5e0-bb954c868745]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[284860eb-d133-4621-bebc-10dd1414d9f2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e939ed-7a71-4ed2-b8e6-8e250c97052f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829, portal: 172.16.0.220,3260]
Dec 05 12:19:16 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829, portal: 172.16.0.220,3260] successful.
Dec 05 12:19:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b583adfa-79dd-4f1e-b96c-30a48a4c4b0e]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d9d3e3-1ee5-4ce2-920b-b80a4da7d492]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:16 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.405s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[173cda28-9730-4519-87af-6df3666087cb]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCYnwMIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] No BDM found with device name sda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] No VIF found with MAC fa:16:3e:5a:b3:91, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:19:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-928fe864-635a-41a7-8846-c123104e72fa tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.650s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] <== connect_volume: return (2878ms) {'type': 'block', 'scsi_wwn': '23936663134346438', 'path': '/dev/sdk'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936663134346438', 'path': '/dev/sdk'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.088s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:19:17 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:19:17 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG nova.objects.instance [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lazy-loading 'flavor' on Instance uuid 854ee980-5c0b-4c4f-b9fd-609720e693be {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1317fc-112c-4276-95ad-ca4f7830e2be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:19:17 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:19:17 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:19:17 user nova-compute[75071]:   <source dev="/dev/sdk"/>
Dec 05 12:19:17 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:19:17 user nova-compute[75071]:   <serial>d2d477f6-bcc5-4fa7-b93d-fcd32423a829</serial>
Dec 05 12:19:17 user nova-compute[75071]: </disk>
Dec 05 12:19:17 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c285078-586e-4c1c-b98b-6ed98c16d882]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08] added
Dec 05 12:19:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7225010a-995a-4127-a15b-1d53e22ef532]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3e7ba2-3de6-4ad1-8771-061e476ae89f]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bsPxzpIH {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bsPxzpIH" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef99c43-e071-4cb3-8b7a-a2b8954ccc17]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bsPxzpIH'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ea281b-fb28-4287-8165-b5eebc193188]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[586ffe4e-d324-4171-81d3-a4aa65ab3a4d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --login" returned: 0 in 0.112s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e069a4-e78e-403e-ac95-827f8f6be5e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08, portal: 172.16.0.220,3260]
Dec 05 12:19:17 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08, portal: 172.16.0.220,3260] successful.
Dec 05 12:19:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dd73fc-d47e-4b28-a18d-602bb6fe75e8]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1d82f0-b0ea-4a87-bbbf-37402e716ad6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:17 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.372s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] HCTL ('43', '-', '-', 0) found on session 12 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f010e833-2e0d-44e5-aa06-2956b0fe0195]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Searching for a device in session 12 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsPxzpIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:19:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] No VIF found with MAC fa:16:3e:85:5c:09, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:19:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59b5378c-b917-49ab-aae5-f30414c114ea tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.130s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Acquiring lock "0d640cf7-170a-4d3e-8983-6165aab46bae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:18 user nova-compute[75071]: INFO nova.compute.manager [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Detaching volume ac667f29-b7c2-40df-a9c6-3786ab7848ec
Dec 05 12:19:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "46d74901-9224-4575-956b-de5c92580f8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "46d74901-9224-4575-956b-de5c92580f8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:19:18 user nova-compute[75071]: INFO nova.virt.block_device [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Attempting to driver detach volume ac667f29-b7c2-40df-a9c6-3786ab7848ec from mountpoint /dev/sdc
Dec 05 12:19:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Attempting to detach device sdc from instance 0d640cf7-170a-4d3e-8983-6165aab46bae from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:19:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:19:18 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:19:18 user nova-compute[75071]:   <source dev="/dev/sdj"/>
Dec 05 12:19:18 user nova-compute[75071]:   <target dev="sdc" bus="scsi"/>
Dec 05 12:19:18 user nova-compute[75071]:   <serial>ac667f29-b7c2-40df-a9c6-3786ab7848ec</serial>
Dec 05 12:19:18 user nova-compute[75071]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Dec 05 12:19:18 user nova-compute[75071]: </disk>
Dec 05 12:19:18 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:19:18 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Successfully detached device sdc from instance 0d640cf7-170a-4d3e-8983-6165aab46bae from the persistent domain config.
Dec 05 12:19:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 0d640cf7-170a-4d3e-8983-6165aab46bae from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:19:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:19:18 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:19:18 user nova-compute[75071]:   <source dev="/dev/sdj"/>
Dec 05 12:19:18 user nova-compute[75071]:   <target dev="sdc" bus="scsi"/>
Dec 05 12:19:18 user nova-compute[75071]:   <serial>ac667f29-b7c2-40df-a9c6-3786ab7848ec</serial>
Dec 05 12:19:18 user nova-compute[75071]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Dec 05 12:19:18 user nova-compute[75071]: </disk>
Dec 05 12:19:18 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:19:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:18 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:19:18 user nova-compute[75071]: INFO nova.compute.claims [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Claim successful on node user
Dec 05 12:19:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:19:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] <== connect_volume: return (3508ms) {'type': 'block', 'scsi_wwn': '26336616362393733', 'path': '/dev/sdl'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:19:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336616362393733', 'path': '/dev/sdl'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:19:18 user nova-compute[75071]: DEBUG nova.objects.instance [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lazy-loading 'flavor' on Instance uuid 2625dd24-5c50-4911-9515-57c9483bafa1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:19:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:19:18 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:19:18 user nova-compute[75071]:   <source dev="/dev/sdl"/>
Dec 05 12:19:18 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:19:18 user nova-compute[75071]:   <serial>f6a93afd-a98e-4a7e-876f-98b4c4fd2d08</serial>
Dec 05 12:19:18 user nova-compute[75071]: </disk>
Dec 05 12:19:18 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 0d640cf7-170a-4d3e-8983-6165aab46bae {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.644s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG nova.network.neutron [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:19:19 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:19:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG nova.policy [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d78c212de2e426fad0cba51a2e7bf52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c1a038a4eb45508b7f5aa3eb435229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] No VIF found with MAC fa:16:3e:fd:56:66, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:19:19 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Creating image(s)
Dec 05 12:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "/opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "/opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "/opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-944f115d-22c5-48ac-85b5-c757a29a596c tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "2625dd24-5c50-4911-9515-57c9483bafa1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.179s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.270s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "854ee980-5c0b-4c4f-b9fd-609720e693be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:20 user nova-compute[75071]: INFO nova.compute.manager [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Detaching volume d2d477f6-bcc5-4fa7-b93d-fcd32423a829
Dec 05 12:19:20 user nova-compute[75071]: INFO nova.virt.block_device [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Attempting to driver detach volume d2d477f6-bcc5-4fa7-b93d-fcd32423a829 from mountpoint /dev/vdb
Dec 05 12:19:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Attempting to detach device vdb from instance 854ee980-5c0b-4c4f-b9fd-609720e693be from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:19:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:19:20 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:19:20 user nova-compute[75071]:   <source dev="/dev/sdk"/>
Dec 05 12:19:20 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:19:20 user nova-compute[75071]:   <serial>d2d477f6-bcc5-4fa7-b93d-fcd32423a829</serial>
Dec 05 12:19:20 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:19:20 user nova-compute[75071]: </disk>
Dec 05 12:19:20 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:19:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Successfully detached device vdb from instance 854ee980-5c0b-4c4f-b9fd-609720e693be from the persistent domain config.
Dec 05 12:19:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 854ee980-5c0b-4c4f-b9fd-609720e693be from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:19:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:19:20 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:19:20 user nova-compute[75071]:   <source dev="/dev/sdk"/>
Dec 05 12:19:20 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:19:20 user nova-compute[75071]:   <serial>d2d477f6-bcc5-4fa7-b93d-fcd32423a829</serial>
Dec 05 12:19:20 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:19:20 user nova-compute[75071]: </disk>
Dec 05 12:19:20 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:19:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.216s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/disk 1073741824" returned: 0 in 0.057s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:20 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:19:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:20 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Cannot resize image /opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:19:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:19:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Ensure instance console log exists: /opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:19:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 854ee980-5c0b-4c4f-b9fd-609720e693be {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Acquiring lock "2625dd24-5c50-4911-9515-57c9483bafa1" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Lock "2625dd24-5c50-4911-9515-57c9483bafa1" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG os_brick.utils [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Successfully created port: bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae30daa-4972-43ff-869f-0b3bbecfe0c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4af9a3a-94ba-4f53-b944-30aaed1efc89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c4cb6f-0f87-43d7-9ebc-45f3edfd2ead]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[792dd6a6-8fb3-4240-9d50-62f531940c60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:19:21 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:19:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31a5f64-c520-476a-8819-bee6126bdc0d]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:19:21 user nova-compute[75071]: DEBUG os_brick.utils [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:19:21 user nova-compute[75071]: INFO nova.compute.manager [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Swapping volume f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 for 9fa329a2-4b09-4394-971a-7daf24992112
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Successfully updated port: bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "refresh_cache-46d74901-9224-4575-956b-de5c92580f8a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquired lock "refresh_cache-46d74901-9224-4575-956b-de5c92580f8a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-d4abbe13-2ad5-472d-a96d-de78d2e3b830 req-ab8d917a-a41b-4301-8fe0-bbcbdcc34ec3 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Received event network-changed-bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-d4abbe13-2ad5-472d-a96d-de78d2e3b830 req-ab8d917a-a41b-4301-8fe0-bbcbdcc34ec3 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Refreshing instance network info cache due to event network-changed-bc3ba814-a825-4145-be46-f4028df2a727. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d4abbe13-2ad5-472d-a96d-de78d2e3b830 req-ab8d917a-a41b-4301-8fe0-bbcbdcc34ec3 service nova] Acquiring lock "refresh_cache-46d74901-9224-4575-956b-de5c92580f8a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Updating instance_info_cache with network_info: [{"id": "bc3ba814-a825-4145-be46-f4028df2a727", "address": "fa:16:3e:1b:64:fe", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc3ba814-a8", "ovs_interfaceid": "bc3ba814-a825-4145-be46-f4028df2a727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Releasing lock "refresh_cache-46d74901-9224-4575-956b-de5c92580f8a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Instance network_info: |[{"id": "bc3ba814-a825-4145-be46-f4028df2a727", "address": "fa:16:3e:1b:64:fe", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc3ba814-a8", "ovs_interfaceid": "bc3ba814-a825-4145-be46-f4028df2a727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d4abbe13-2ad5-472d-a96d-de78d2e3b830 req-ab8d917a-a41b-4301-8fe0-bbcbdcc34ec3 service nova] Acquired lock "refresh_cache-46d74901-9224-4575-956b-de5c92580f8a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.network.neutron [req-d4abbe13-2ad5-472d-a96d-de78d2e3b830 req-ab8d917a-a41b-4301-8fe0-bbcbdcc34ec3 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Refreshing network info cache for port bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Start _get_guest_xml network_info=[{"id": "bc3ba814-a825-4145-be46-f4028df2a727", "address": "fa:16:3e:1b:64:fe", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc3ba814-a8", "ovs_interfaceid": "bc3ba814-a825-4145-be46-f4028df2a727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:19:22 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:19:22 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:19:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-665384170',display_name='tempest-AttachVolumeNegativeTest-server-665384170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-665384170',id=12,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTXJNRhtXvf06pYQe1AwgAEnItggWXAYgOYJvff5jyqmqxcfAPRPeADAxWp2J19bhqnZEmc+zWfdwvuC4Kfcpy1H72ejQbYVKZw1gwwQAYhToCRTWWhX/+OpHvyMDb44g==',key_name='tempest-keypair-631342850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5c1a038a4eb45508b7f5aa3eb435229',ramdisk_id='',reservation_id='r-wvacgiea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1152460930',owner_user_name='tempest-AttachVolumeNegativeTest-1152460930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:19:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d78c212de2e426fad0cba51a2e7bf52',uuid=46d74901-9224-4575-956b-de5c92580f8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc3ba814-a825-4145-be46-f4028df2a727", "address": "fa:16:3e:1b:64:fe", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc3ba814-a8", "ovs_interfaceid": "bc3ba814-a825-4145-be46-f4028df2a727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converting VIF {"id": "bc3ba814-a825-4145-be46-f4028df2a727", "address": "fa:16:3e:1b:64:fe", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc3ba814-a8", "ovs_interfaceid": "bc3ba814-a825-4145-be46-f4028df2a727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=bc3ba814-a825-4145-be46-f4028df2a727,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc3ba814-a8') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.objects.instance [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lazy-loading 'pci_devices' on Instance uuid 46d74901-9224-4575-956b-de5c92580f8a {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:19:22 user nova-compute[75071]:   <uuid>46d74901-9224-4575-956b-de5c92580f8a</uuid>
Dec 05 12:19:22 user nova-compute[75071]:   <name>instance-0000000c</name>
Dec 05 12:19:22 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:19:22 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:19:22 user nova-compute[75071]:   <metadata>
Dec 05 12:19:22 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:19:22 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:19:22 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeNegativeTest-server-665384170</nova:name>
Dec 05 12:19:22 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:19:22</nova:creationTime>
Dec 05 12:19:22 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:19:22 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:19:22 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:19:22 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:19:22 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:19:22 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:19:22 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:19:22 user nova-compute[75071]:       <nova:owner>
Dec 05 12:19:22 user nova-compute[75071]:         <nova:user uuid="7d78c212de2e426fad0cba51a2e7bf52">tempest-AttachVolumeNegativeTest-1152460930-project-member</nova:user>
Dec 05 12:19:22 user nova-compute[75071]:         <nova:project uuid="d5c1a038a4eb45508b7f5aa3eb435229">tempest-AttachVolumeNegativeTest-1152460930</nova:project>
Dec 05 12:19:22 user nova-compute[75071]:       </nova:owner>
Dec 05 12:19:22 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:19:22 user nova-compute[75071]:       <nova:ports>
Dec 05 12:19:22 user nova-compute[75071]:         <nova:port uuid="bc3ba814-a825-4145-be46-f4028df2a727">
Dec 05 12:19:22 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 05 12:19:22 user nova-compute[75071]:         </nova:port>
Dec 05 12:19:22 user nova-compute[75071]:       </nova:ports>
Dec 05 12:19:22 user nova-compute[75071]:     </nova:instance>
Dec 05 12:19:22 user nova-compute[75071]:   </metadata>
Dec 05 12:19:22 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:19:22 user nova-compute[75071]:     <system>
Dec 05 12:19:22 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:19:22 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:19:22 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:19:22 user nova-compute[75071]:       <entry name="serial">46d74901-9224-4575-956b-de5c92580f8a</entry>
Dec 05 12:19:22 user nova-compute[75071]:       <entry name="uuid">46d74901-9224-4575-956b-de5c92580f8a</entry>
Dec 05 12:19:22 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:19:22 user nova-compute[75071]:     </system>
Dec 05 12:19:22 user nova-compute[75071]:   </sysinfo>
Dec 05 12:19:22 user nova-compute[75071]:   <os>
Dec 05 12:19:22 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:19:22 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:19:22 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:19:22 user nova-compute[75071]:   </os>
Dec 05 12:19:22 user nova-compute[75071]:   <features>
Dec 05 12:19:22 user nova-compute[75071]:     <acpi/>
Dec 05 12:19:22 user nova-compute[75071]:     <apic/>
Dec 05 12:19:22 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:19:22 user nova-compute[75071]:   </features>
Dec 05 12:19:22 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:19:22 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:19:22 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:19:22 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:19:22 user nova-compute[75071]:   </clock>
Dec 05 12:19:22 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:19:22 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:19:22 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:19:22 user nova-compute[75071]:   </cpu>
Dec 05 12:19:22 user nova-compute[75071]:   <devices>
Dec 05 12:19:22 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:19:22 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:19:22 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/disk"/>
Dec 05 12:19:22 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:19:22 user nova-compute[75071]:     </disk>
Dec 05 12:19:22 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:19:22 user nova-compute[75071]:       <mac address="fa:16:3e:1b:64:fe"/>
Dec 05 12:19:22 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:19:22 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:19:22 user nova-compute[75071]:       <target dev="tapbc3ba814-a8"/>
Dec 05 12:19:22 user nova-compute[75071]:     </interface>
Dec 05 12:19:22 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:19:22 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/console.log" append="off"/>
Dec 05 12:19:22 user nova-compute[75071]:     </serial>
Dec 05 12:19:22 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:19:22 user nova-compute[75071]:     <video>
Dec 05 12:19:22 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:19:22 user nova-compute[75071]:     </video>
Dec 05 12:19:22 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:19:22 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:19:22 user nova-compute[75071]:     </rng>
Dec 05 12:19:22 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:19:22 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:19:22 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:19:22 user nova-compute[75071]:     </memballoon>
Dec 05 12:19:22 user nova-compute[75071]:   </devices>
Dec 05 12:19:22 user nova-compute[75071]: </domain>
Dec 05 12:19:22 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:19:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-665384170',display_name='tempest-AttachVolumeNegativeTest-server-665384170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-665384170',id=12,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTXJNRhtXvf06pYQe1AwgAEnItggWXAYgOYJvff5jyqmqxcfAPRPeADAxWp2J19bhqnZEmc+zWfdwvuC4Kfcpy1H72ejQbYVKZw1gwwQAYhToCRTWWhX/+OpHvyMDb44g==',key_name='tempest-keypair-631342850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5c1a038a4eb45508b7f5aa3eb435229',ramdisk_id='',reservation_id='r-wvacgiea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1152460930',owner_user_name='tempest-AttachVolumeNegativeTest-1152460930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:19:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d78c212de2e426fad0cba51a2e7bf52',uuid=46d74901-9224-4575-956b-de5c92580f8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc3ba814-a825-4145-be46-f4028df2a727", "address": "fa:16:3e:1b:64:fe", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc3ba814-a8", "ovs_interfaceid": "bc3ba814-a825-4145-be46-f4028df2a727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converting VIF {"id": "bc3ba814-a825-4145-be46-f4028df2a727", "address": "fa:16:3e:1b:64:fe", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc3ba814-a8", "ovs_interfaceid": "bc3ba814-a825-4145-be46-f4028df2a727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=bc3ba814-a825-4145-be46-f4028df2a727,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc3ba814-a8') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG os_vif [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=bc3ba814-a825-4145-be46-f4028df2a727,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc3ba814-a8') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8444a2a1-1f8a-5cbe-8446-c6be314047d7', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc3ba814-a8, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc3ba814-a8, col_values=(('qos', UUID('6dfec64a-cf90-46cd-9504-6a037bb74c34')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc3ba814-a8, col_values=(('external_ids', {'iface-id': 'bc3ba814-a825-4145-be46-f4028df2a727', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:64:fe', 'vm-uuid': '46d74901-9224-4575-956b-de5c92580f8a'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:22 user nova-compute[75071]: INFO os_vif [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=bc3ba814-a825-4145-be46-f4028df2a727,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc3ba814-a8')
Dec 05 12:19:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:19:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] No VIF found with MAC fa:16:3e:1b:64:fe, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:19:23 user nova-compute[75071]: DEBUG nova.network.neutron [req-d4abbe13-2ad5-472d-a96d-de78d2e3b830 req-ab8d917a-a41b-4301-8fe0-bbcbdcc34ec3 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Updated VIF entry in instance network info cache for port bc3ba814-a825-4145-be46-f4028df2a727. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:19:23 user nova-compute[75071]: DEBUG nova.network.neutron [req-d4abbe13-2ad5-472d-a96d-de78d2e3b830 req-ab8d917a-a41b-4301-8fe0-bbcbdcc34ec3 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Updating instance_info_cache with network_info: [{"id": "bc3ba814-a825-4145-be46-f4028df2a727", "address": "fa:16:3e:1b:64:fe", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc3ba814-a8", "ovs_interfaceid": "bc3ba814-a825-4145-be46-f4028df2a727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:19:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d4abbe13-2ad5-472d-a96d-de78d2e3b830 req-ab8d917a-a41b-4301-8fe0-bbcbdcc34ec3 service nova] Releasing lock "refresh_cache-46d74901-9224-4575-956b-de5c92580f8a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:19:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-7aad4319-cfdd-418f-b6d2-bb6dfb036db3 req-ef117c0c-67da-46ce-b3ea-063d37a8a352 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Received event network-vif-plugged-bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:19:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7aad4319-cfdd-418f-b6d2-bb6dfb036db3 req-ef117c0c-67da-46ce-b3ea-063d37a8a352 service nova] Acquiring lock "46d74901-9224-4575-956b-de5c92580f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7aad4319-cfdd-418f-b6d2-bb6dfb036db3 req-ef117c0c-67da-46ce-b3ea-063d37a8a352 service nova] Lock "46d74901-9224-4575-956b-de5c92580f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7aad4319-cfdd-418f-b6d2-bb6dfb036db3 req-ef117c0c-67da-46ce-b3ea-063d37a8a352 service nova] Lock "46d74901-9224-4575-956b-de5c92580f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-7aad4319-cfdd-418f-b6d2-bb6dfb036db3 req-ef117c0c-67da-46ce-b3ea-063d37a8a352 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] No waiting events found dispatching network-vif-plugged-bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:19:24 user nova-compute[75071]: WARNING nova.compute.manager [req-7aad4319-cfdd-418f-b6d2-bb6dfb036db3 req-ef117c0c-67da-46ce-b3ea-063d37a8a352 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Received unexpected event network-vif-plugged-bc3ba814-a825-4145-be46-f4028df2a727 for instance with vm_state building and task_state spawning.
Dec 05 12:19:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-54a2f0f7-6a2f-410f-99ac-9b78bd339dc7 req-4e5b008a-e219-4e3e-b489-7f6e8d4219c1 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Received event network-vif-plugged-bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:19:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-54a2f0f7-6a2f-410f-99ac-9b78bd339dc7 req-4e5b008a-e219-4e3e-b489-7f6e8d4219c1 service nova] Acquiring lock "46d74901-9224-4575-956b-de5c92580f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-54a2f0f7-6a2f-410f-99ac-9b78bd339dc7 req-4e5b008a-e219-4e3e-b489-7f6e8d4219c1 service nova] Lock "46d74901-9224-4575-956b-de5c92580f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-54a2f0f7-6a2f-410f-99ac-9b78bd339dc7 req-4e5b008a-e219-4e3e-b489-7f6e8d4219c1 service nova] Lock "46d74901-9224-4575-956b-de5c92580f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-54a2f0f7-6a2f-410f-99ac-9b78bd339dc7 req-4e5b008a-e219-4e3e-b489-7f6e8d4219c1 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] No waiting events found dispatching network-vif-plugged-bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:19:26 user nova-compute[75071]: WARNING nova.compute.manager [req-54a2f0f7-6a2f-410f-99ac-9b78bd339dc7 req-4e5b008a-e219-4e3e-b489-7f6e8d4219c1 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Received unexpected event network-vif-plugged-bc3ba814-a825-4145-be46-f4028df2a727 for instance with vm_state building and task_state spawning.
Dec 05 12:19:26 user nova-compute[75071]: DEBUG nova.compute.manager [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:19:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:19:26 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Instance spawned successfully.
Dec 05 12:19:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:19:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:19:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:19:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:19:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:19:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:19:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:19:26 user nova-compute[75071]: INFO nova.compute.manager [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Took 6.98 seconds to spawn the instance on the hypervisor.
Dec 05 12:19:26 user nova-compute[75071]: DEBUG nova.compute.manager [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:19:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-238ddec3-129f-4e99-8e21-f6d424ae3bd6 req-aa58adb8-91ff-4a08-ae9d-3bb84b062827 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Received event network-changed-e148c36d-f01c-41e2-8e2e-082e023af6fb {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:19:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-238ddec3-129f-4e99-8e21-f6d424ae3bd6 req-aa58adb8-91ff-4a08-ae9d-3bb84b062827 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Refreshing instance network info cache due to event network-changed-e148c36d-f01c-41e2-8e2e-082e023af6fb. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:19:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-238ddec3-129f-4e99-8e21-f6d424ae3bd6 req-aa58adb8-91ff-4a08-ae9d-3bb84b062827 service nova] Acquiring lock "refresh_cache-c9e37746-57e8-4053-9f52-2c60bab457fa" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:19:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-238ddec3-129f-4e99-8e21-f6d424ae3bd6 req-aa58adb8-91ff-4a08-ae9d-3bb84b062827 service nova] Acquired lock "refresh_cache-c9e37746-57e8-4053-9f52-2c60bab457fa" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:19:26 user nova-compute[75071]: DEBUG nova.network.neutron [req-238ddec3-129f-4e99-8e21-f6d424ae3bd6 req-aa58adb8-91ff-4a08-ae9d-3bb84b062827 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Refreshing network info cache for port e148c36d-f01c-41e2-8e2e-082e023af6fb {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:19:26 user nova-compute[75071]: INFO nova.compute.manager [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Took 8.11 seconds to build instance.
Dec 05 12:19:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-631ab3ff-a1f6-4452-b502-0c72cf0c0ce4 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "46d74901-9224-4575-956b-de5c92580f8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.271s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:27 user nova-compute[75071]: DEBUG nova.network.neutron [req-238ddec3-129f-4e99-8e21-f6d424ae3bd6 req-aa58adb8-91ff-4a08-ae9d-3bb84b062827 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Updated VIF entry in instance network info cache for port e148c36d-f01c-41e2-8e2e-082e023af6fb. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:19:27 user nova-compute[75071]: DEBUG nova.network.neutron [req-238ddec3-129f-4e99-8e21-f6d424ae3bd6 req-aa58adb8-91ff-4a08-ae9d-3bb84b062827 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Updating instance_info_cache with network_info: [{"id": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "address": "fa:16:3e:7b:99:8a", "network": {"id": "8f9b3ec7-df46-410f-8603-4e4ce082275b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-988513444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a14095bd354df1b0be6e89cd2e0b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c36d-f0", "ovs_interfaceid": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:19:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-238ddec3-129f-4e99-8e21-f6d424ae3bd6 req-aa58adb8-91ff-4a08-ae9d-3bb84b062827 service nova] Releasing lock "refresh_cache-c9e37746-57e8-4053-9f52-2c60bab457fa" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:19:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:27 user nova-compute[75071]: INFO nova.compute.manager [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Rebuilding instance
Dec 05 12:19:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-63443e5e-8410-4758-a0e9-9355bfa3f735 req-2daea0c5-8fd3-41f1-adf0-39661d15660a service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Received event network-vif-unplugged-e148c36d-f01c-41e2-8e2e-082e023af6fb {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-63443e5e-8410-4758-a0e9-9355bfa3f735 req-2daea0c5-8fd3-41f1-adf0-39661d15660a service nova] Acquiring lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-63443e5e-8410-4758-a0e9-9355bfa3f735 req-2daea0c5-8fd3-41f1-adf0-39661d15660a service nova] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-63443e5e-8410-4758-a0e9-9355bfa3f735 req-2daea0c5-8fd3-41f1-adf0-39661d15660a service nova] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-63443e5e-8410-4758-a0e9-9355bfa3f735 req-2daea0c5-8fd3-41f1-adf0-39661d15660a service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] No waiting events found dispatching network-vif-unplugged-e148c36d-f01c-41e2-8e2e-082e023af6fb {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:19:28 user nova-compute[75071]: WARNING nova.compute.manager [req-63443e5e-8410-4758-a0e9-9355bfa3f735 req-2daea0c5-8fd3-41f1-adf0-39661d15660a service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Received unexpected event network-vif-unplugged-e148c36d-f01c-41e2-8e2e-082e023af6fb for instance with vm_state active and task_state rebuilding.
Dec 05 12:19:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBTDsZSc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:19:28 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.009s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:19:28 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:19:28 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4f3e6b-3e5c-4902-baf7-4efa470b181d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:19:28 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c0c7aa-8f81-4797-8109-e2f597181721]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5] added
Dec 05 12:19:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9713764e-268c-4bf6-bc5c-5e3a20942f4f]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[25db4aeb-1690-4e78-b7c5-4ad2ba93c8b6]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBTDsZSc {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBTDsZSc" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dfe4f7-d49e-475a-a930-d2c8a1e3d09a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lBTDsZSc'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb11cd8-bd8b-4c8a-bd29-1efb4677440c]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[70361fa6-8135-43f6-aee9-3bb65ae8c523]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:28 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:28 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Instance destroyed successfully.
Dec 05 12:19:28 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Instance destroyed successfully.
Dec 05 12:19:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1647147359',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1669594796',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJ6xZ5XBcUwxREIE7hpriVQZ0cMhVgvH0PlAMEkl0iPK+uJVd0fd5PCbz5I6L/042zo6fYM5B8tUUzAdxDa0FSOpcGykYLgtM0hDjxMaWQcHYNldfHmf9IbWnr2VIyMRg==',key_name='tempest-keypair-106536343',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:17:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d6a14095bd354df1b0be6e89cd2e0b5a',ramdisk_id='',reservation_id='r-9ic0uf1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1195759080',owner_user_name='tempest-ServerActionsV293TestJSON-1195759080-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:19:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='596a8048e44c4f5985956bba2b06aba7',uuid=c9e37746-57e8-4053-9f52-2c60bab457fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "address": "fa:16:3e:7b:99:8a", "network": {"id": "8f9b3ec7-df46-410f-8603-4e4ce082275b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-988513444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a14095bd354df1b0be6e89cd2e0b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c36d-f0", "ovs_interfaceid": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Converting VIF {"id": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "address": "fa:16:3e:7b:99:8a", "network": {"id": "8f9b3ec7-df46-410f-8603-4e4ce082275b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-988513444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a14095bd354df1b0be6e89cd2e0b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c36d-f0", "ovs_interfaceid": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=e148c36d-f01c-41e2-8e2e-082e023af6fb,network=Network(8f9b3ec7-df46-410f-8603-4e4ce082275b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c36d-f0') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG os_vif [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=e148c36d-f01c-41e2-8e2e-082e023af6fb,network=Network(8f9b3ec7-df46-410f-8603-4e4ce082275b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c36d-f0') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape148c36d-f0, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:19:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --login" returned: 0 in 0.148s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce36b47-ae02-45bd-bf4f-5f4261b2a9a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5, portal: 172.16.0.220,3260]
Dec 05 12:19:29 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5, portal: 172.16.0.220,3260] successful.
Dec 05 12:19:29 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32160bcd-f693-4c41-833a-ebdf32e1deed) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:29 user nova-compute[75071]: INFO os_vif [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=e148c36d-f01c-41e2-8e2e-082e023af6fb,network=Network(8f9b3ec7-df46-410f-8603-4e4ce082275b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c36d-f0')
Dec 05 12:19:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmdYpkry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:19:29 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 12:19:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac46b77-8385-47ed-b0c4-a453673efa1b]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a8922c-87d0-4d47-be2b-3449acc9ea91]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:29 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:29 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:29 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.446s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] HCTL ('44', '-', '-', 0) found on session 13 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Scanning host 44 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1aa0fd-3371-4c19-ac67-fc15c2c17ae0]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Searching for a device in session 13 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:19:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBTDsZSc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.498s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] <== connect_volume: return (1507ms) {'type': 'block', 'scsi_wwn': '23936366536353836', 'path': '/dev/sdm'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936366536353836', 'path': '/dev/sdm'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.113s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Lazy-loading 'flavor' on Instance uuid 332f0212-d8e4-4a99-9688-01a26ba66916 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5bdcd5-4112-4cbc-92b8-2e03b1a01bb2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:19:30 user nova-compute[75071]: No targets found.
Dec 05 12:19:30 user nova-compute[75071]: iSNS:
Dec 05 12:19:30 user nova-compute[75071]: No targets found.
Dec 05 12:19:30 user nova-compute[75071]: STATIC:
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: FIRMWARE:
Dec 05 12:19:30 user nova-compute[75071]: No targets found.
Dec 05 12:19:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:19:30 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:19:30 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] attach device xml: <disk type="block" device="disk">
Dec 05 12:19:30 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:19:30 user nova-compute[75071]:   <source dev="/dev/sdm"/>
Dec 05 12:19:30 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:19:30 user nova-compute[75071]:   <serial>e46fef52-7f34-41a4-94a3-36c840458af5</serial>
Dec 05 12:19:30 user nova-compute[75071]: </disk>
Dec 05 12:19:30 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f41a7e-60a5-412e-8398-334e621c3ba9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6a7815-8616-4560-8205-141d82cff854]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8264777400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27222a0-73bf-4aa7-b314-cf57b7ffbc21]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[007a3480-534f-40a3-8370-8d776ad64f28]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f94a98-5471-4b82-9d68-59f249a9cf2d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc7cb7d-68e3-4103-9c68-111b5b502cab]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[db268822-39f2-48aa-a99d-e36bb95816d0]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cf434a-8b60-4301-acdb-01941b698e28]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665, portal: 172.16.0.220,3260]
Dec 05 12:19:30 user nova-compute[75071]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665, portal: 172.16.0.220,3260] successful.
Dec 05 12:19:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-c2fbd58f-e7b1-47d4-91cc-cdd65aa6e607 req-1c18cdb6-3699-4bd2-a6e9-0c334783a15a service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Received event network-vif-plugged-e148c36d-f01c-41e2-8e2e-082e023af6fb {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c2fbd58f-e7b1-47d4-91cc-cdd65aa6e607 req-1c18cdb6-3699-4bd2-a6e9-0c334783a15a service nova] Acquiring lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c2fbd58f-e7b1-47d4-91cc-cdd65aa6e607 req-1c18cdb6-3699-4bd2-a6e9-0c334783a15a service nova] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c2fbd58f-e7b1-47d4-91cc-cdd65aa6e607 req-1c18cdb6-3699-4bd2-a6e9-0c334783a15a service nova] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-c2fbd58f-e7b1-47d4-91cc-cdd65aa6e607 req-1c18cdb6-3699-4bd2-a6e9-0c334783a15a service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] No waiting events found dispatching network-vif-plugged-e148c36d-f01c-41e2-8e2e-082e023af6fb {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:19:30 user nova-compute[75071]: WARNING nova.compute.manager [req-c2fbd58f-e7b1-47d4-91cc-cdd65aa6e607 req-1c18cdb6-3699-4bd2-a6e9-0c334783a15a service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Received unexpected event network-vif-plugged-e148c36d-f01c-41e2-8e2e-082e023af6fb for instance with vm_state active and task_state rebuilding.
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfc9de9-2362-454d-9d85-4e9f6ede9e0a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] <== disconnect_volume: return (1518ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:19:30 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Deleting instance files /opt/stack/data/nova/instances/c9e37746-57e8-4053-9f52-2c60bab457fa_del
Dec 05 12:19:30 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Deletion of /opt/stack/data/nova/instances/c9e37746-57e8-4053-9f52-2c60bab457fa_del complete
Dec 05 12:19:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] No VIF found with MAC fa:16:3e:79:0d:f2, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:19:30 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance c9e37746-57e8-4053-9f52-2c60bab457fa could not be found.
Dec 05 12:19:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmdYpkry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:19:30 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1c7c73b8-99c8-4fab-a61a-82d822493513 tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Lock "332f0212-d8e4-4a99-9688-01a26ba66916" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.166s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac38237-bf31-4e82-be59-05672a7e5a52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:19:30 user nova-compute[75071]: No targets found.
Dec 05 12:19:30 user nova-compute[75071]: iSNS:
Dec 05 12:19:30 user nova-compute[75071]: No targets found.
Dec 05 12:19:30 user nova-compute[75071]: STATIC:
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5
Dec 05 12:19:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:30 user nova-compute[75071]: FIRMWARE:
Dec 05 12:19:30 user nova-compute[75071]: No targets found.
Dec 05 12:19:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:19:30 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:19:30 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[02912c67-f623-4d8d-b6d7-c49db264a991]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7973c51f-0c2e-4086-9569-d245c60f1ae2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:30 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f827c2ca950>, {}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Disconnecting from: [] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.104s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] <== disconnect_volume: return (105ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:19:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:19:31 user nova-compute[75071]: DEBUG nova.compute.manager [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Preparing to wait for external event volume-reimaged-ddf5aeb1-c8f8-432d-8c49-68373bb2b665 {{(pid=75071) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Dec 05 12:19:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Acquiring lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-435be790-0808-4514-a814-2379061a30b8 tempest-VolumesAssistedSnapshotsTest-506212942 tempest-VolumesAssistedSnapshotsTest-506212942-project] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] volume_snapshot_create: create_info: {'snapshot_id': 'b07c61fd-ba37-4109-80c0-393a8923ffb6', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75071) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3572}}
Dec 05 12:19:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-435be790-0808-4514-a814-2379061a30b8 tempest-VolumesAssistedSnapshotsTest-506212942 tempest-VolumesAssistedSnapshotsTest-506212942-project] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] snap xml: <domainsnapshot>
Dec 05 12:19:31 user nova-compute[75071]:   <disks>
Dec 05 12:19:31 user nova-compute[75071]:     <disk name="/dev/sdm" snapshot="external" type="file">
Dec 05 12:19:31 user nova-compute[75071]:       <source file="/dev/new_file"/>
Dec 05 12:19:31 user nova-compute[75071]:     </disk>
Dec 05 12:19:31 user nova-compute[75071]:     <disk name="vda" snapshot="no"/>
Dec 05 12:19:31 user nova-compute[75071]:   </disks>
Dec 05 12:19:31 user nova-compute[75071]: </domainsnapshot>
Dec 05 12:19:31 user nova-compute[75071]:  {{(pid=75071) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3513}}
Dec 05 12:19:31 user nova-compute[75071]: DEBUG nova.objects.instance [None req-435be790-0808-4514-a814-2379061a30b8 tempest-VolumesAssistedSnapshotsTest-506212942 tempest-VolumesAssistedSnapshotsTest-506212942-project] Lazy-loading 'system_metadata' on Instance uuid 332f0212-d8e4-4a99-9688-01a26ba66916 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:19:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d892b0ec-8fb5-4ae4-b685-27374b858b47 tempest-VolumesAssistedSnapshotsTest-506212942 tempest-VolumesAssistedSnapshotsTest-506212942-project] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] volume_snapshot_delete: delete_info: {'volume_id': 'e46fef52-7f34-41a4-94a3-36c840458af5'} {{(pid=75071) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3673}}
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [None req-d892b0ec-8fb5-4ae4-b685-27374b858b47 tempest-VolumesAssistedSnapshotsTest-506212942 tempest-VolumesAssistedSnapshotsTest-506212942-project] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Traceback (most recent call last):
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]     self._volume_snapshot_delete(context, instance, volume_id,
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]     if delete_info['type'] != 'qcow2':
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] KeyError: 'type'
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] 
Dec 05 12:19:32 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-435be790-0808-4514-a814-2379061a30b8 tempest-VolumesAssistedSnapshotsTest-506212942 tempest-VolumesAssistedSnapshotsTest-506212942-project] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [None req-435be790-0808-4514-a814-2379061a30b8 tempest-VolumesAssistedSnapshotsTest-506212942 tempest-VolumesAssistedSnapshotsTest-506212942-project] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Traceback (most recent call last):
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]     rv = execute(f, *args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]     six.reraise(c, e, tb)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]     raise value
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]     rv = meth(*args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] 
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [None req-435be790-0808-4514-a814-2379061a30b8 tempest-VolumesAssistedSnapshotsTest-506212942 tempest-VolumesAssistedSnapshotsTest-506212942-project] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Traceback (most recent call last):
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]     self._volume_snapshot_create(context, instance, guest,
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]     rv = execute(f, *args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]     six.reraise(c, e, tb)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]     raise value
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]     rv = meth(*args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] 
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [None req-d892b0ec-8fb5-4ae4-b685-27374b858b47 tempest-VolumesAssistedSnapshotsTest-506212942 tempest-VolumesAssistedSnapshotsTest-506212942-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-92160837-2272-4528-b4c7-6f5dcb782f79)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server [None req-d892b0ec-8fb5-4ae4-b685-27374b858b47 tempest-VolumesAssistedSnapshotsTest-506212942 tempest-VolumesAssistedSnapshotsTest-506212942-project] Exception during message handling: KeyError: 'type'
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3849, in volume_snapshot_delete
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server 
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver [None req-435be790-0808-4514-a814-2379061a30b8 tempest-VolumesAssistedSnapshotsTest-506212942 tempest-VolumesAssistedSnapshotsTest-506212942-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot b07c61fd-ba37-4109-80c0-393a8923ffb6 could not be found.
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     raise value
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot b07c61fd-ba37-4109-80c0-393a8923ffb6 could not be found. (HTTP 404) (Request-ID: req-eec1c44d-a1c8-4caf-8ee1-362cc7376d92)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot b07c61fd-ba37-4109-80c0-393a8923ffb6 could not be found.
Dec 05 12:19:32 user nova-compute[75071]: ERROR nova.virt.libvirt.driver 
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server [None req-435be790-0808-4514-a814-2379061a30b8 tempest-VolumesAssistedSnapshotsTest-506212942 tempest-VolumesAssistedSnapshotsTest-506212942-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3593, in volume_snapshot_create
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     raise value
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 05 12:19:32 user nova-compute[75071]: ERROR oslo_messaging.rpc.server 
Dec 05 12:19:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Acquiring lock "332f0212-d8e4-4a99-9688-01a26ba66916" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Lock "332f0212-d8e4-4a99-9688-01a26ba66916" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:32 user nova-compute[75071]: INFO nova.compute.manager [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Detaching volume e46fef52-7f34-41a4-94a3-36c840458af5
Dec 05 12:19:32 user nova-compute[75071]: INFO nova.virt.block_device [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Attempting to driver detach volume e46fef52-7f34-41a4-94a3-36c840458af5 from mountpoint /dev/vdb
Dec 05 12:19:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Attempting to detach device vdb from instance 332f0212-d8e4-4a99-9688-01a26ba66916 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:19:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] detach device xml: <disk type="block" device="disk">
Dec 05 12:19:32 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:19:32 user nova-compute[75071]:   <source dev="/dev/sdm"/>
Dec 05 12:19:32 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:19:32 user nova-compute[75071]:   <serial>e46fef52-7f34-41a4-94a3-36c840458af5</serial>
Dec 05 12:19:32 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:19:32 user nova-compute[75071]: </disk>
Dec 05 12:19:32 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:19:32 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Successfully detached device vdb from instance 332f0212-d8e4-4a99-9688-01a26ba66916 from the persistent domain config.
Dec 05 12:19:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 332f0212-d8e4-4a99-9688-01a26ba66916 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:19:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] detach device xml: <disk type="block" device="disk">
Dec 05 12:19:32 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:19:32 user nova-compute[75071]:   <source dev="/dev/sdm"/>
Dec 05 12:19:32 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:19:32 user nova-compute[75071]:   <serial>e46fef52-7f34-41a4-94a3-36c840458af5</serial>
Dec 05 12:19:32 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:19:32 user nova-compute[75071]: </disk>
Dec 05 12:19:32 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:19:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 332f0212-d8e4-4a99-9688-01a26ba66916 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CKJRXEaj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2625dd24-5c50-4911-9515-57c9483bafa1', 'attached_at': '', 'detached_at': '', 'volume_id': '9fa329a2-4b09-4394-971a-7daf24992112', 'serial': '9fa329a2-4b09-4394-971a-7daf24992112'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsPxzpIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, 'status': 'reserved', 'instance': '2625dd24-5c50-4911-9515-57c9483bafa1', 'attached_at': '', 'detached_at': '', 'volume_id': 'f6a93afd-a98e-4a7e-876f-98b4c4fd2d08', 'serial'} {{(pid=75071) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CKJRXEaj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:19:33 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:19:33 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:19:33 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[753c7f16-98a0-4dd4-804c-c06e564ff19b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:19:33 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce9077c-32fa-4d48-abb2-6f0df93f573b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112] added
Dec 05 12:19:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84daabf-6b37-4850-9fb9-3339346e9a1d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a33c701-46a7-41bf-b3a8-5bd5b71eb6d7]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CKJRXEaj {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CKJRXEaj" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c2c0f4-8133-4217-81a4-d14fbf4507a7]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CKJRXEaj'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[780b0b7a-7e26-4ed4-a341-cc274cbf8acc]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26fab6c-468b-47ff-86df-cb76856dad6b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --login" returned: 0 in 0.111s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[46884577-c9c4-4ea5-9176-2ed200e3ed42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112, portal: 172.16.0.220,3260]
Dec 05 12:19:33 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112, portal: 172.16.0.220,3260] successful.
Dec 05 12:19:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[523564c3-f2a4-4e18-a556-54f3ab7c96fa]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3822a20-9f35-49cb-adf1-68e20fac6a7b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:33 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf91a565-df03-4d44-99ba-08a2ddfa7581]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:19:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CKJRXEaj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:19:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:19:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '26339323063653533', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:19:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339323063653533', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:19:34 user nova-compute[75071]: DEBUG nova.objects.instance [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Lazy-loading 'flavor' on Instance uuid 2625dd24-5c50-4911-9515-57c9483bafa1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:19:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:19:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 164626432 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:19:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 309329920 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:19:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 422576128 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:19:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 426770432 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:19:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 501219328 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:19:37 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:19:37 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:19:37 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:19:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:37 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:19:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 645922816 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:19:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdl (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 779091968 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:39 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 0d640cf7-170a-4d3e-8983-6165aab46bae is timed out.
Dec 05 12:19:39 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Successfully detached device sdc from instance 0d640cf7-170a-4d3e-8983-6165aab46bae from the live domain config.
Dec 05 12:19:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 977272832 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbgGOBUr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:19:39 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.038s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a32b4be-22e9-47dd-83d3-9eef176077db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:19:39 user nova-compute[75071]: No targets found.
Dec 05 12:19:39 user nova-compute[75071]: iSNS:
Dec 05 12:19:39 user nova-compute[75071]: No targets found.
Dec 05 12:19:39 user nova-compute[75071]: STATIC:
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: FIRMWARE:
Dec 05 12:19:39 user nova-compute[75071]: No targets found.
Dec 05 12:19:39 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:19:39 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:19:39 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[961d5cc1-f641-48ea-ba81-217aad09144c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb515cf-0b99-4529-a687-00bfc5a70656]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:39 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:39 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f827c1dde10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec'): ({'sdj'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Removing single pathed devices sdj {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[add84472-a6bf-4f64-a514-c48aadc94b1c]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa82d22-ff93-4b92-9945-ece6b70dce0b]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Flushing IO for device /dev/sdj {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45e0f15-1ec6-4bb1-8cc4-44178d59672d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.043s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d79e31c-76df-44c5-99e9-7f71adfe020b]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] SCSI volumes sdj have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb1cb3e-6c79-4743-b647-91bd62b40858]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d8a6d2-8473-4048-a589-da3516a6f1a7]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec, portal: 172.16.0.220,3260]
Dec 05 12:19:39 user nova-compute[75071]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec, portal: 172.16.0.220,3260] successful.
Dec 05 12:19:39 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac667f29-b7c2-40df-a9c6-3786ab7848ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d02b350-6244-41af-a6b9-4db4303977d5]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.478s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] <== disconnect_volume: return (484ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsPxzpIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:19:39 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2743c618-0936-4705-b5be-59584afadef9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:19:39 user nova-compute[75071]: No targets found.
Dec 05 12:19:39 user nova-compute[75071]: iSNS:
Dec 05 12:19:39 user nova-compute[75071]: No targets found.
Dec 05 12:19:39 user nova-compute[75071]: STATIC:
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5
Dec 05 12:19:39 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:39 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:39 user nova-compute[75071]: FIRMWARE:
Dec 05 12:19:39 user nova-compute[75071]: No targets found.
Dec 05 12:19:39 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:19:39 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:19:39 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5932a17c-db80-42a3-8ff0-dd258f0f400f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0694c223-4be7-4782-8617-2f516fe67da1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:39 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:39 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:39 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8264609360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08'): ({'sdl'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Removing single pathed devices sdl {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee902b65-6789-41b9-83f3-80549dc200ae]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d318a9-177d-467d-816e-89221bbbcc75]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Flushing IO for device /dev/sdl {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[521a13ee-249b-469e-8ba7-b19d38eec51c]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.044s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d510415-ac93-475d-ba80-8c9f7a70ff2a]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:19:39 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] SCSI volumes sdl have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a0442f-821c-4fb0-a19c-f73f8d9e73b8]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1a8893-c5cf-472c-9169-c6bf0bd5c117]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08, portal: 172.16.0.220,3260]
Dec 05 12:19:40 user nova-compute[75071]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08, portal: 172.16.0.220,3260] successful.
Dec 05 12:19:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6ae692-d7bf-44ee-8032-0aa668669c67]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] <== disconnect_volume: return (440ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CKJRXEaj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '2625dd24-5c50-4911-9515-57c9483bafa1', 'attached_at': '', 'detached_at': '', 'volume_id': '9fa329a2-4b09-4394-971a-7daf24992112', 'serial'} {{(pid=75071) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] swap_volume: removing Cinder connection for volume f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 {{(pid=75071) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG nova.objects.instance [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lazy-loading 'flavor' on Instance uuid 0d640cf7-170a-4d3e-8983-6165aab46bae {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7a50a25d-018f-4db3-ad8b-3c6d83e78922 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.306s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:40 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 854ee980-5c0b-4c4f-b9fd-609720e693be is timed out.
Dec 05 12:19:40 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Successfully detached device vdb from instance 854ee980-5c0b-4c4f-b9fd-609720e693be from the live domain config.
Dec 05 12:19:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UCYnwMIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:19:40 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:19:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb00fdb8-7f92-42be-b776-0f9d27e3a29d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:19:40 user nova-compute[75071]: No targets found.
Dec 05 12:19:40 user nova-compute[75071]: iSNS:
Dec 05 12:19:40 user nova-compute[75071]: No targets found.
Dec 05 12:19:40 user nova-compute[75071]: STATIC:
Dec 05 12:19:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829
Dec 05 12:19:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:40 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c
Dec 05 12:19:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:40 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a
Dec 05 12:19:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:40 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b
Dec 05 12:19:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:40 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e
Dec 05 12:19:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:40 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95
Dec 05 12:19:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:40 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310
Dec 05 12:19:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:40 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6
Dec 05 12:19:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:40 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112
Dec 05 12:19:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:40 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:40 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5
Dec 05 12:19:40 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:40 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:40 user nova-compute[75071]: FIRMWARE:
Dec 05 12:19:40 user nova-compute[75071]: No targets found.
Dec 05 12:19:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:19:40 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:19:40 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d042f0e-d9dc-46f5-b6cc-5b0a314c151a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[727856f4-9637-4bb7-9813-ebfd79647a40]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:40 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)
Dec 05 12:19:40 user nova-compute[75071]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)
Dec 05 12:19:40 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:40 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:40 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:40 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:40 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:40 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:40 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 (non-flash)
Dec 05 12:19:40 user nova-compute[75071]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)
Dec 05 12:19:40 user nova-compute[75071]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)
Dec 05 12:19:40 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:40 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:40 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:40 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:40 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:40 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:40 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f826460b0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829'): ({'sdk'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Removing single pathed devices sdk {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5e04b3-76c1-4cf0-b377-321d38748f80]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c458d9-f69f-4c9f-bad5-2415667745cd]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Flushing IO for device /dev/sdk {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c492a41-4d39-475b-ab26-aabce48ef7cd]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.028s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbf3f45-40be-409e-9a7a-66cb66be8743]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] SCSI volumes sdk have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ec6f18-4284-4389-9c22-c1e8906e6c21]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a479fd-e83a-467c-beed-3d1bce880dbf]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829, portal: 172.16.0.220,3260]
Dec 05 12:19:41 user nova-compute[75071]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829, portal: 172.16.0.220,3260] successful.
Dec 05 12:19:41 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2d477f6-bcc5-4fa7-b93d-fcd32423a829 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b547d0-0387-42d4-b145-801ca7b4c285]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] <== disconnect_volume: return (389ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] swap_volume: Updating volume f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "CKJRXEaj", "auth_password": "l7q6n5DxwAZYWQ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "9fa329a2-4b09-4394-971a-7daf24992112"}, "status": "reserved", "instance": "2625dd24-5c50-4911-9515-57c9483bafa1", "attached_at": "", "detached_at": "", "volume_id": "9fa329a2-4b09-4394-971a-7daf24992112", "serial": "9fa329a2-4b09-4394-971a-7daf24992112"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '9fa329a2-4b09-4394-971a-7daf24992112', 'no_device': None, 'attachment_id': '68e0a146-a099-4252-b4bd-52994ee815a3'} {{(pid=75071) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-86eeab43-f717-40eb-b8b8-6b14501222b4 tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Lock "2625dd24-5c50-4911-9515-57c9483bafa1" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.755s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Acquiring lock "0d640cf7-170a-4d3e-8983-6165aab46bae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Acquiring lock "0d640cf7-170a-4d3e-8983-6165aab46bae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:41 user nova-compute[75071]: INFO nova.compute.manager [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Terminating instance
Dec 05 12:19:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lazy-loading 'flavor' on Instance uuid 854ee980-5c0b-4c4f-b9fd-609720e693be {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-c2c75e7f-7d24-4652-9f95-c8c415d3408c req-3757e144-354a-4457-8488-f75a1cd80cc7 service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Received event network-vif-unplugged-e56ba39e-d25b-410b-ad40-c5c31f2f7ba4 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c2c75e7f-7d24-4652-9f95-c8c415d3408c req-3757e144-354a-4457-8488-f75a1cd80cc7 service nova] Acquiring lock "0d640cf7-170a-4d3e-8983-6165aab46bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c2c75e7f-7d24-4652-9f95-c8c415d3408c req-3757e144-354a-4457-8488-f75a1cd80cc7 service nova] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c2c75e7f-7d24-4652-9f95-c8c415d3408c req-3757e144-354a-4457-8488-f75a1cd80cc7 service nova] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-c2c75e7f-7d24-4652-9f95-c8c415d3408c req-3757e144-354a-4457-8488-f75a1cd80cc7 service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] No waiting events found dispatching network-vif-unplugged-e56ba39e-d25b-410b-ad40-c5c31f2f7ba4 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-c2c75e7f-7d24-4652-9f95-c8c415d3408c req-3757e144-354a-4457-8488-f75a1cd80cc7 service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Received event network-vif-unplugged-e56ba39e-d25b-410b-ad40-c5c31f2f7ba4 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:19:43 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:19:43 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=7106MB free_disk=25.389503479003906GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Acquiring lock "2625dd24-5c50-4911-9515-57c9483bafa1" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Lock "2625dd24-5c50-4911-9515-57c9483bafa1" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0c813e02-5ab4-40f3-b8a5-c7b7d5606cbf tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.391s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Instance destroyed successfully.
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.objects.instance [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lazy-loading 'resources' on Instance uuid 0d640cf7-170a-4d3e-8983-6165aab46bae {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG os_brick.utils [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1945549184',display_name='tempest-AttachSCSIVolumeTestJSON-server-1945549184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1945549184',id=5,image_ref='7b9ca46b-c5ba-47ec-9522-be2ee6a0e0af',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSjZ4yFFozaSdmyCAbBcxH9me3XDU2okjU4UeFS80MM3gBSgUdSitVqby6sxDesU9iL7tK1MNpzciqe1UF28leGl3zx2AuCozMNt9Ox9xi1ellSkt7E/qINhXZmRuqMwg==',key_name='tempest-keypair-291642649',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:17:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d309487087b4b089a63e314fd8813e6',ramdisk_id='',reservation_id='r-6n686a1q',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7b9ca46b-c5ba-47ec-9522-be2ee6a0e0af',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1502106878',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1502106878-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:17:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb4947c03acf45d5955d036352af6291',uuid=0d640cf7-170a-4d3e-8983-6165aab46bae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "address": "fa:16:3e:5a:b3:91", "network": {"id": "0aeb2212-537b-4b5a-bf1c-7db98afb29dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-443578788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d309487087b4b089a63e314fd8813e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape56ba39e-d2", "ovs_interfaceid": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Converting VIF {"id": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "address": "fa:16:3e:5a:b3:91", "network": {"id": "0aeb2212-537b-4b5a-bf1c-7db98afb29dd", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-443578788-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d309487087b4b089a63e314fd8813e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape56ba39e-d2", "ovs_interfaceid": "e56ba39e-d25b-410b-ad40-c5c31f2f7ba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:b3:91,bridge_name='br-int',has_traffic_filtering=True,id=e56ba39e-d25b-410b-ad40-c5c31f2f7ba4,network=Network(0aeb2212-537b-4b5a-bf1c-7db98afb29dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape56ba39e-d2') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG os_vif [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:b3:91,bridge_name='br-int',has_traffic_filtering=True,id=e56ba39e-d25b-410b-ad40-c5c31f2f7ba4,network=Network(0aeb2212-537b-4b5a-bf1c-7db98afb29dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape56ba39e-d2') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape56ba39e-d2, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fa7dc7-3a64-4e23-ab30-407fb910f434]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbfe2f1c-6d7a-4c6c-9acd-95b051f3d6b2) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:43 user nova-compute[75071]: INFO os_vif [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:b3:91,bridge_name='br-int',has_traffic_filtering=True,id=e56ba39e-d25b-410b-ad40-c5c31f2f7ba4,network=Network(0aeb2212-537b-4b5a-bf1c-7db98afb29dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape56ba39e-d2')
Dec 05 12:19:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Deleting instance files /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae_del
Dec 05 12:19:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Deletion of /opt/stack/data/nova/instances/0d640cf7-170a-4d3e-8983-6165aab46bae_del complete
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7402015-8a52-41df-9ec9-dc8b51fcb0ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e731986-f877-4cc9-9cea-1dc2ee1bbe8c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd370b9d-44f6-404a-8352-d73db8cf0f45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:19:43 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1763fe3d-c720-43bf-9625-e6ab2a8900a4]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG os_brick.utils [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:19:43 user nova-compute[75071]: INFO nova.compute.manager [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Took 1.87 seconds to destroy the instance on the hypervisor.
Dec 05 12:19:43 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 81333acc-8dc7-42f1-9026-e42a30e52a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e08be776-0fa9-4871-86eb-2093530c00f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 854ee980-5c0b-4c4f-b9fd-609720e693be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 0d640cf7-170a-4d3e-8983-6165aab46bae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 2625dd24-5c50-4911-9515-57c9483bafa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 332f0212-d8e4-4a99-9688-01a26ba66916 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c9e37746-57e8-4053-9f52-2c60bab457fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 58e955b6-be0c-41bc-9a39-4eeec3b694a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 94aa75f8-6097-4cba-b567-112ec59efd8f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 46d74901-9224-4575-956b-de5c92580f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:19:43 user nova-compute[75071]: INFO nova.compute.manager [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Swapping volume 9fa329a2-4b09-4394-971a-7daf24992112 for f6a93afd-a98e-4a7e-876f-98b4c4fd2d08
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:19:43 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:19:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:19:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.664s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:44 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:19:44 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Took 0.82 seconds to deallocate network for instance.
Dec 05 12:19:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-aa358f16-e911-4483-9c64-0a480af3d980 req-d3810a45-629b-4382-8e01-f735b0c1bc21 service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Received event network-vif-plugged-e56ba39e-d25b-410b-ad40-c5c31f2f7ba4 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:19:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-aa358f16-e911-4483-9c64-0a480af3d980 req-d3810a45-629b-4382-8e01-f735b0c1bc21 service nova] Acquiring lock "0d640cf7-170a-4d3e-8983-6165aab46bae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-aa358f16-e911-4483-9c64-0a480af3d980 req-d3810a45-629b-4382-8e01-f735b0c1bc21 service nova] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-aa358f16-e911-4483-9c64-0a480af3d980 req-d3810a45-629b-4382-8e01-f735b0c1bc21 service nova] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-aa358f16-e911-4483-9c64-0a480af3d980 req-d3810a45-629b-4382-8e01-f735b0c1bc21 service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] No waiting events found dispatching network-vif-plugged-e56ba39e-d25b-410b-ad40-c5c31f2f7ba4 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:19:44 user nova-compute[75071]: WARNING nova.compute.manager [req-aa358f16-e911-4483-9c64-0a480af3d980 req-d3810a45-629b-4382-8e01-f735b0c1bc21 service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Received unexpected event network-vif-plugged-e56ba39e-d25b-410b-ad40-c5c31f2f7ba4 for instance with vm_state active and task_state deleting.
Dec 05 12:19:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-1c220cdd-f6c1-4407-b7c0-8078dc764dd9 req-6df55cc3-c6f3-498b-bdba-c1fd61e7fff2 service nova] [instance: 0d640cf7-170a-4d3e-8983-6165aab46bae] Received event network-vif-deleted-e56ba39e-d25b-410b-ad40-c5c31f2f7ba4 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:19:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:44 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:19:44 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:19:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.513s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:45 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Deleted allocations for instance 0d640cf7-170a-4d3e-8983-6165aab46bae
Dec 05 12:19:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:19:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:19:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4d223a6a-6095-45ed-af0e-5c66bcdb7201 tempest-AttachSCSIVolumeTestJSON-1502106878 tempest-AttachSCSIVolumeTestJSON-1502106878-project-member] Lock "0d640cf7-170a-4d3e-8983-6165aab46bae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.434s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:19:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:19:45 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:19:45 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updating instance_info_cache with network_info: [{"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:19:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:19:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:19:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:19:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:19:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:19:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:19:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:19:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:19:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:52 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 332f0212-d8e4-4a99-9688-01a26ba66916 is timed out.
Dec 05 12:19:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Successfully detached device vdb from instance 332f0212-d8e4-4a99-9688-01a26ba66916 from the live domain config.
Dec 05 12:19:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:19:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBTDsZSc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:19:52 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:19:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:19:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dcd64a-d880-4b6a-aa6f-43e34bb0b9c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:19:52 user nova-compute[75071]: No targets found.
Dec 05 12:19:52 user nova-compute[75071]: iSNS:
Dec 05 12:19:52 user nova-compute[75071]: No targets found.
Dec 05 12:19:52 user nova-compute[75071]: STATIC:
Dec 05 12:19:52 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c
Dec 05 12:19:52 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:52 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:52 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a
Dec 05 12:19:52 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:52 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:52 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b
Dec 05 12:19:52 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:52 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:52 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e
Dec 05 12:19:52 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:52 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:52 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665
Dec 05 12:19:52 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:52 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:52 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95
Dec 05 12:19:52 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:52 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:52 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310
Dec 05 12:19:52 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:52 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:52 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6
Dec 05 12:19:52 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:52 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:52 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112
Dec 05 12:19:52 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:52 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:52 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5
Dec 05 12:19:52 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:19:52 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:19:52 user nova-compute[75071]: FIRMWARE:
Dec 05 12:19:52 user nova-compute[75071]: No targets found.
Dec 05 12:19:52 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:19:52 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:19:52 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:19:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:19:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e6cabf-74c0-4f06-9019-b63c1c3a8aba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ba2e6e-60cb-4227-bd54-a66efe98c95f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)
Dec 05 12:19:53 user nova-compute[75071]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)
Dec 05 12:19:53 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:53 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:53 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:53 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:53 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:53 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:53 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:53 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:53 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 (non-flash)
Dec 05 12:19:53 user nova-compute[75071]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)
Dec 05 12:19:53 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:53 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:53 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:53 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:53 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:53 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:53 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:53 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:53 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f827c1dd7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5'): ({'sdm'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Removing single pathed devices sdm {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[274beae6-a66c-484e-bb22-88ef1fc7ef35]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca95dc8-693b-49ed-ae50-8aab19c7318c]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Flushing IO for device /dev/sdm {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da1c324-5549-40b5-8815-3bcbd4cf5580]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.040s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca57d23-1c90-4e95-82c6-d3eadbf8838b]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Checking to see if SCSI volumes sdm have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] SCSI volumes sdm have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d86771-c2af-4fef-84ab-d4f00f576c61]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3950e7d4-16a8-48ab-85c4-1d455ed95d09]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5, portal: 172.16.0.220,3260]
Dec 05 12:19:53 user nova-compute[75071]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5, portal: 172.16.0.220,3260] successful.
Dec 05 12:19:53 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e46fef52-7f34-41a4-94a3-36c840458af5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac2234b-5110-40b7-a67e-418e76864de4]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] <== disconnect_volume: return (399ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:19:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:54 user nova-compute[75071]: DEBUG nova.objects.instance [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Lazy-loading 'flavor' on Instance uuid 332f0212-d8e4-4a99-9688-01a26ba66916 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:19:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-32ec48a5-a191-436a-8447-e8e3bf03362c tempest-VolumesAssistedSnapshotsTest-1389235902 tempest-VolumesAssistedSnapshotsTest-1389235902-project-admin] Lock "332f0212-d8e4-4a99-9688-01a26ba66916" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.881s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "62efa94c-ae01-48aa-b3d3-0d23d159801c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:19:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:19:54 user nova-compute[75071]: INFO nova.compute.claims [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Claim successful on node user
Dec 05 12:19:55 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.675s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:19:55 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:19:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG nova.policy [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7e73e24d5b1489c813f06690b12eef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b6bfae34944fcfbd49d2f18b232ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:19:55 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Creating image(s)
Dec 05 12:19:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "/opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "/opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "/opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.208s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk 1073741824" returned: 0 in 0.069s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.238s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Successfully created port: dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Cannot resize image /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Ensure instance console log exists: /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsPxzpIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2625dd24-5c50-4911-9515-57c9483bafa1', 'attached_at': '', 'detached_at': '', 'volume_id': 'f6a93afd-a98e-4a7e-876f-98b4c4fd2d08', 'serial': 'f6a93afd-a98e-4a7e-876f-98b4c4fd2d08'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CKJRXEaj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '9fa329a2-4b09-4394-971a-7daf24992112'}, 'status': 'reserved', 'instance': '2625dd24-5c50-4911-9515-57c9483bafa1', 'attached_at': '', 'detached_at': '', 'volume_id': '9fa329a2-4b09-4394-971a-7daf24992112', 'serial'} {{(pid=75071) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsPxzpIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:19:56 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:19:56 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:19:56 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8871927-f6c5-4f5b-9dd6-a28be086a964]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:19:56 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8027fd3d-cb75-4a33-84de-c84ada5feead]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08] added
Dec 05 12:19:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cdc1a7-3b64-495b-83b5-1936da203714]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[705c7253-efac-4bb8-b6f9-02e6323ed21a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bsPxzpIH {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bsPxzpIH" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f43eeca-40fa-4eab-8714-ff42cf3b616e]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bsPxzpIH'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[323d24c5-7333-4da9-9302-d4b007b1f559]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab8a327-dba7-4965-ba48-94fe7377da7d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37913e9-0c51-40c1-b764-8cd46f81944c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08, portal: 172.16.0.220,3260]
Dec 05 12:19:56 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08, portal: 172.16.0.220,3260] successful.
Dec 05 12:19:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8e6d51-4782-496c-a778-a1efd25357fc]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Successfully updated port: dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fff01b9-becf-434b-ac2c-b495239039a2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:19:56 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:19:56 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.397s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] HCTL ('42', '-', '-', 0) found on session 16 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "refresh_cache-62efa94c-ae01-48aa-b3d3-0d23d159801c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquired lock "refresh_cache-62efa94c-ae01-48aa-b3d3-0d23d159801c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e962672-37be-4ea0-89cd-754339b6be39]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Searching for a device in session 16 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsPxzpIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-7efe4909-6809-4aa4-aee5-8d76c9eb8a08 req-28209912-9a5f-4410-97b5-9b80450f0a0a service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Received event network-changed-dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-7efe4909-6809-4aa4-aee5-8d76c9eb8a08 req-28209912-9a5f-4410-97b5-9b80450f0a0a service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Refreshing instance network info cache due to event network-changed-dfd9ba38-13c3-423b-81d9-8fd813ca2acd. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7efe4909-6809-4aa4-aee5-8d76c9eb8a08 req-28209912-9a5f-4410-97b5-9b80450f0a0a service nova] Acquiring lock "refresh_cache-62efa94c-ae01-48aa-b3d3-0d23d159801c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:19:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Updating instance_info_cache with network_info: [{"id": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "address": "fa:16:3e:8f:a8:2b", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9ba38-13", "ovs_interfaceid": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Releasing lock "refresh_cache-62efa94c-ae01-48aa-b3d3-0d23d159801c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Instance network_info: |[{"id": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "address": "fa:16:3e:8f:a8:2b", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9ba38-13", "ovs_interfaceid": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7efe4909-6809-4aa4-aee5-8d76c9eb8a08 req-28209912-9a5f-4410-97b5-9b80450f0a0a service nova] Acquired lock "refresh_cache-62efa94c-ae01-48aa-b3d3-0d23d159801c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.network.neutron [req-7efe4909-6809-4aa4-aee5-8d76c9eb8a08 req-28209912-9a5f-4410-97b5-9b80450f0a0a service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Refreshing network info cache for port dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Start _get_guest_xml network_info=[{"id": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "address": "fa:16:3e:8f:a8:2b", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9ba38-13", "ovs_interfaceid": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:19:57 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:19:57 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1207590253',display_name='tempest-tempest.common.compute-instance-1207590253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1207590253',id=13,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk/2CR5ryCdFhnzY7TEoYapKL803/W+14EuHBFh/Bn1ydNJw/5MkJqSTVw47d32v20VlRqVYqCUpZ+R3KOMF8XfpJIXjWBmPbrx5vIAMBConykgFyc0rPSXZyqCSasrlQ==',key_name='tempest-keypair-858510286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59b6bfae34944fcfbd49d2f18b232ec8',ramdisk_id='',reservation_id='r-6o3c9k6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1523780015',owner_user_name='tempest-ServerActionsTestOtherA-1523780015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e73e24d5b1489c813f06690b12eef4',uuid=62efa94c-ae01-48aa-b3d3-0d23d159801c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "address": "fa:16:3e:8f:a8:2b", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9ba38-13", "ovs_interfaceid": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converting VIF {"id": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "address": "fa:16:3e:8f:a8:2b", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9ba38-13", "ovs_interfaceid": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=dfd9ba38-13c3-423b-81d9-8fd813ca2acd,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9ba38-13') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lazy-loading 'pci_devices' on Instance uuid 62efa94c-ae01-48aa-b3d3-0d23d159801c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:19:57 user nova-compute[75071]:   <uuid>62efa94c-ae01-48aa-b3d3-0d23d159801c</uuid>
Dec 05 12:19:57 user nova-compute[75071]:   <name>instance-0000000d</name>
Dec 05 12:19:57 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:19:57 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:19:57 user nova-compute[75071]:   <metadata>
Dec 05 12:19:57 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:19:57 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:19:57 user nova-compute[75071]:       <nova:name>tempest-tempest.common.compute-instance-1207590253</nova:name>
Dec 05 12:19:57 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:19:57</nova:creationTime>
Dec 05 12:19:57 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:19:57 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:19:57 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:19:57 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:19:57 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:19:57 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:19:57 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:19:57 user nova-compute[75071]:       <nova:owner>
Dec 05 12:19:57 user nova-compute[75071]:         <nova:user uuid="d7e73e24d5b1489c813f06690b12eef4">tempest-ServerActionsTestOtherA-1523780015-project-member</nova:user>
Dec 05 12:19:57 user nova-compute[75071]:         <nova:project uuid="59b6bfae34944fcfbd49d2f18b232ec8">tempest-ServerActionsTestOtherA-1523780015</nova:project>
Dec 05 12:19:57 user nova-compute[75071]:       </nova:owner>
Dec 05 12:19:57 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:19:57 user nova-compute[75071]:       <nova:ports>
Dec 05 12:19:57 user nova-compute[75071]:         <nova:port uuid="dfd9ba38-13c3-423b-81d9-8fd813ca2acd">
Dec 05 12:19:57 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 12:19:57 user nova-compute[75071]:         </nova:port>
Dec 05 12:19:57 user nova-compute[75071]:       </nova:ports>
Dec 05 12:19:57 user nova-compute[75071]:     </nova:instance>
Dec 05 12:19:57 user nova-compute[75071]:   </metadata>
Dec 05 12:19:57 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:19:57 user nova-compute[75071]:     <system>
Dec 05 12:19:57 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:19:57 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:19:57 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:19:57 user nova-compute[75071]:       <entry name="serial">62efa94c-ae01-48aa-b3d3-0d23d159801c</entry>
Dec 05 12:19:57 user nova-compute[75071]:       <entry name="uuid">62efa94c-ae01-48aa-b3d3-0d23d159801c</entry>
Dec 05 12:19:57 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:19:57 user nova-compute[75071]:     </system>
Dec 05 12:19:57 user nova-compute[75071]:   </sysinfo>
Dec 05 12:19:57 user nova-compute[75071]:   <os>
Dec 05 12:19:57 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:19:57 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:19:57 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:19:57 user nova-compute[75071]:   </os>
Dec 05 12:19:57 user nova-compute[75071]:   <features>
Dec 05 12:19:57 user nova-compute[75071]:     <acpi/>
Dec 05 12:19:57 user nova-compute[75071]:     <apic/>
Dec 05 12:19:57 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:19:57 user nova-compute[75071]:   </features>
Dec 05 12:19:57 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:19:57 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:19:57 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:19:57 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:19:57 user nova-compute[75071]:   </clock>
Dec 05 12:19:57 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:19:57 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:19:57 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:19:57 user nova-compute[75071]:   </cpu>
Dec 05 12:19:57 user nova-compute[75071]:   <devices>
Dec 05 12:19:57 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:19:57 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:19:57 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk"/>
Dec 05 12:19:57 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:19:57 user nova-compute[75071]:     </disk>
Dec 05 12:19:57 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:19:57 user nova-compute[75071]:       <mac address="fa:16:3e:8f:a8:2b"/>
Dec 05 12:19:57 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:19:57 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:19:57 user nova-compute[75071]:       <target dev="tapdfd9ba38-13"/>
Dec 05 12:19:57 user nova-compute[75071]:     </interface>
Dec 05 12:19:57 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:19:57 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/console.log" append="off"/>
Dec 05 12:19:57 user nova-compute[75071]:     </serial>
Dec 05 12:19:57 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:19:57 user nova-compute[75071]:     <video>
Dec 05 12:19:57 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:19:57 user nova-compute[75071]:     </video>
Dec 05 12:19:57 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:19:57 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:19:57 user nova-compute[75071]:     </rng>
Dec 05 12:19:57 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:19:57 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:19:57 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:19:57 user nova-compute[75071]:     </memballoon>
Dec 05 12:19:57 user nova-compute[75071]:   </devices>
Dec 05 12:19:57 user nova-compute[75071]: </domain>
Dec 05 12:19:57 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1207590253',display_name='tempest-tempest.common.compute-instance-1207590253',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1207590253',id=13,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk/2CR5ryCdFhnzY7TEoYapKL803/W+14EuHBFh/Bn1ydNJw/5MkJqSTVw47d32v20VlRqVYqCUpZ+R3KOMF8XfpJIXjWBmPbrx5vIAMBConykgFyc0rPSXZyqCSasrlQ==',key_name='tempest-keypair-858510286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59b6bfae34944fcfbd49d2f18b232ec8',ramdisk_id='',reservation_id='r-6o3c9k6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1523780015',owner_user_name='tempest-ServerActionsTestOtherA-1523780015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:19:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e73e24d5b1489c813f06690b12eef4',uuid=62efa94c-ae01-48aa-b3d3-0d23d159801c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "address": "fa:16:3e:8f:a8:2b", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9ba38-13", "ovs_interfaceid": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converting VIF {"id": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "address": "fa:16:3e:8f:a8:2b", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9ba38-13", "ovs_interfaceid": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=dfd9ba38-13c3-423b-81d9-8fd813ca2acd,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9ba38-13') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG os_vif [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=dfd9ba38-13c3-423b-81d9-8fd813ca2acd,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9ba38-13') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f117f18a-342d-53eb-9b03-2a5b47a72468', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfd9ba38-13, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfd9ba38-13, col_values=(('qos', UUID('21b5ca07-f7e6-45bd-a68c-eec7fe30c1d0')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfd9ba38-13, col_values=(('external_ids', {'iface-id': 'dfd9ba38-13c3-423b-81d9-8fd813ca2acd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:a8:2b', 'vm-uuid': '62efa94c-ae01-48aa-b3d3-0d23d159801c'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:57 user nova-compute[75071]: INFO os_vif [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=dfd9ba38-13c3-423b-81d9-8fd813ca2acd,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9ba38-13')
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] No VIF found with MAC fa:16:3e:8f:a8:2b, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.network.neutron [req-7efe4909-6809-4aa4-aee5-8d76c9eb8a08 req-28209912-9a5f-4410-97b5-9b80450f0a0a service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Updated VIF entry in instance network info cache for port dfd9ba38-13c3-423b-81d9-8fd813ca2acd. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.network.neutron [req-7efe4909-6809-4aa4-aee5-8d76c9eb8a08 req-28209912-9a5f-4410-97b5-9b80450f0a0a service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Updating instance_info_cache with network_info: [{"id": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "address": "fa:16:3e:8f:a8:2b", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9ba38-13", "ovs_interfaceid": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7efe4909-6809-4aa4-aee5-8d76c9eb8a08 req-28209912-9a5f-4410-97b5-9b80450f0a0a service nova] Releasing lock "refresh_cache-62efa94c-ae01-48aa-b3d3-0d23d159801c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '26336616362393733', 'path': '/dev/sdk'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26336616362393733', 'path': '/dev/sdk'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG nova.objects.instance [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Lazy-loading 'flavor' on Instance uuid 2625dd24-5c50-4911-9515-57c9483bafa1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:19:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 39845888 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:19:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-2a2b99e5-d620-4cdb-8a76-bf5852241a35 req-8182efd6-a61b-4d43-aeb6-e141a8cd2150 service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Received event network-vif-plugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:19:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2a2b99e5-d620-4cdb-8a76-bf5852241a35 req-8182efd6-a61b-4d43-aeb6-e141a8cd2150 service nova] Acquiring lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:19:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2a2b99e5-d620-4cdb-8a76-bf5852241a35 req-8182efd6-a61b-4d43-aeb6-e141a8cd2150 service nova] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:19:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2a2b99e5-d620-4cdb-8a76-bf5852241a35 req-8182efd6-a61b-4d43-aeb6-e141a8cd2150 service nova] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:19:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-2a2b99e5-d620-4cdb-8a76-bf5852241a35 req-8182efd6-a61b-4d43-aeb6-e141a8cd2150 service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] No waiting events found dispatching network-vif-plugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:19:59 user nova-compute[75071]: WARNING nova.compute.manager [req-2a2b99e5-d620-4cdb-8a76-bf5852241a35 req-8182efd6-a61b-4d43-aeb6-e141a8cd2150 service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Received unexpected event network-vif-plugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd for instance with vm_state building and task_state spawning.
Dec 05 12:19:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 101711872 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:20:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 147849216 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:20:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 182452224 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:20:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 222298112 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:20:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-57e01ade-d977-46b3-959a-11be58d20a5a req-dd95e009-ce0f-4d90-b3fc-23b49cc0d3da service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Received event network-vif-plugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-57e01ade-d977-46b3-959a-11be58d20a5a req-dd95e009-ce0f-4d90-b3fc-23b49cc0d3da service nova] Acquiring lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-57e01ade-d977-46b3-959a-11be58d20a5a req-dd95e009-ce0f-4d90-b3fc-23b49cc0d3da service nova] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-57e01ade-d977-46b3-959a-11be58d20a5a req-dd95e009-ce0f-4d90-b3fc-23b49cc0d3da service nova] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-57e01ade-d977-46b3-959a-11be58d20a5a req-dd95e009-ce0f-4d90-b3fc-23b49cc0d3da service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] No waiting events found dispatching network-vif-plugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:01 user nova-compute[75071]: WARNING nova.compute.manager [req-57e01ade-d977-46b3-959a-11be58d20a5a req-dd95e009-ce0f-4d90-b3fc-23b49cc0d3da service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Received unexpected event network-vif-plugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd for instance with vm_state building and task_state spawning.
Dec 05 12:20:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:20:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:20:01 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Instance spawned successfully.
Dec 05 12:20:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:20:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:20:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:20:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:20:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:20:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:20:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:20:01 user nova-compute[75071]: INFO nova.compute.manager [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Took 6.35 seconds to spawn the instance on the hypervisor.
Dec 05 12:20:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:20:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 297795584 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:20:01 user nova-compute[75071]: INFO nova.compute.manager [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Took 7.41 seconds to build instance.
Dec 05 12:20:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b762ac69-7b1b-4aa7-adcc-5e0309b3891c tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.568s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 405798912 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:20:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 552599552 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:20:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 662700032 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:20:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 736100352 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:20:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 860880896 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:20:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 943718400 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-73e72013-20d3-4a68-943a-121e34b7959b req-eb235cef-9a62-4ac8-b4f9-1f2badb12523 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Received event volume-reimaged-ddf5aeb1-c8f8-432d-8c49-68373bb2b665 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-73e72013-20d3-4a68-943a-121e34b7959b req-eb235cef-9a62-4ac8-b4f9-1f2badb12523 service nova] Acquiring lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-73e72013-20d3-4a68-943a-121e34b7959b req-eb235cef-9a62-4ac8-b4f9-1f2badb12523 service nova] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-73e72013-20d3-4a68-943a-121e34b7959b req-eb235cef-9a62-4ac8-b4f9-1f2badb12523 service nova] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-73e72013-20d3-4a68-943a-121e34b7959b req-eb235cef-9a62-4ac8-b4f9-1f2badb12523 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Processing event volume-reimaged-ddf5aeb1-c8f8-432d-8c49-68373bb2b665 {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Instance event wait completed in 33 seconds for volume-reimaged {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:20:05 user nova-compute[75071]: INFO nova.virt.block_device [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Booting with volume ddf5aeb1-c8f8-432d-8c49-68373bb2b665 at /dev/vda
Dec 05 12:20:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CKJRXEaj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '9fa329a2-4b09-4394-971a-7daf24992112'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:20:05 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d956a2-8d06-4119-92ab-1c2c23b7bf7f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:20:05 user nova-compute[75071]: No targets found.
Dec 05 12:20:05 user nova-compute[75071]: iSNS:
Dec 05 12:20:05 user nova-compute[75071]: No targets found.
Dec 05 12:20:05 user nova-compute[75071]: STATIC:
Dec 05 12:20:05 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08
Dec 05 12:20:05 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:05 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:05 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c
Dec 05 12:20:05 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:05 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:05 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a
Dec 05 12:20:05 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:05 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:05 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b
Dec 05 12:20:05 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:05 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:05 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e
Dec 05 12:20:05 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:05 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:05 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95
Dec 05 12:20:05 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:05 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:05 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310
Dec 05 12:20:05 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:05 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:05 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6
Dec 05 12:20:05 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:05 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:05 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112
Dec 05 12:20:05 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:05 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:05 user nova-compute[75071]: FIRMWARE:
Dec 05 12:20:05 user nova-compute[75071]: No targets found.
Dec 05 12:20:05 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:20:05 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:20:05 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[927e84e7-70f6-4b6f-9cc6-80f7e7b8c84f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.utils [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c77550-5d50-433a-bcf5-aa4c0cee8b2e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d003494c-cfd8-4329-aee1-d558ce46c468]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)
Dec 05 12:20:05 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:20:05 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:20:05 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:20:05 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:20:05 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:20:05 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:05 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:20:05 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:05 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 (non-flash)
Dec 05 12:20:05 user nova-compute[75071]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:20:05 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:20:05 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:20:05 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:20:05 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:20:05 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:05 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:20:05 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:05 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f826412d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8fd54f-f44c-47bc-8965-f55386ce7f1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b3dfdb-8d64-4041-aeba-1b25dfad9ed9]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd275eef-4907-452c-b508-76f6fb81d7b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d30cfe-8d11-4461-af1d-137f69630d80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e281ba7-e2b3-40e3-a1c5-483a8b81412c]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:20:05 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de8d4a7-466b-4cbf-afaa-819fefdd93c6]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.utils [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Updating existing volume attachment record: 1fc9348e-2e23-4f50-91e1-3644041c4376 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[43837448-1fbb-4c30-bfa1-df60824c6809]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[31448dcd-039d-4462-b8fb-6cf8babf32e9]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea8982e-02b9-403f-b904-c2f1d1c6157d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc941989-0249-4151-920e-09ce1ae2c502]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112, portal: 172.16.0.220,3260]
Dec 05 12:20:05 user nova-compute[75071]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112, portal: 172.16.0.220,3260] successful.
Dec 05 12:20:05 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9fa329a2-4b09-4394-971a-7daf24992112 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f69f037-c1b1-47bf-8569-0c09ba3d0542]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] <== disconnect_volume: return (431ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsPxzpIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '2625dd24-5c50-4911-9515-57c9483bafa1', 'attached_at': '', 'detached_at': '', 'volume_id': 'f6a93afd-a98e-4a7e-876f-98b4c4fd2d08', 'serial'} {{(pid=75071) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Dec 05 12:20:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] swap_volume: removing Cinder connection for volume 9fa329a2-4b09-4394-971a-7daf24992112 {{(pid=75071) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Dec 05 12:20:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] swap_volume: Updating volume 9fa329a2-4b09-4394-971a-7daf24992112 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "bsPxzpIH", "auth_password": "AXlgcQrjSBMCnR", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdk", "volume_id": "f6a93afd-a98e-4a7e-876f-98b4c4fd2d08"}, "status": "reserved", "instance": "2625dd24-5c50-4911-9515-57c9483bafa1", "attached_at": "", "detached_at": "", "volume_id": "f6a93afd-a98e-4a7e-876f-98b4c4fd2d08", "serial": "f6a93afd-a98e-4a7e-876f-98b4c4fd2d08"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'f6a93afd-a98e-4a7e-876f-98b4c4fd2d08', 'no_device': None, 'attachment_id': '05a11347-fdce-4dd7-8a40-bcdf572aaf0b'} {{(pid=75071) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Dec 05 12:20:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-71e26512-c13c-45f5-ba7b-3151a003299b tempest-TestVolumeSwap-1205038255 tempest-TestVolumeSwap-1205038255-project-admin] Lock "2625dd24-5c50-4911-9515-57c9483bafa1" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 23.496s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Acquiring lock "2625dd24-5c50-4911-9515-57c9483bafa1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "2625dd24-5c50-4911-9515-57c9483bafa1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:07 user nova-compute[75071]: INFO nova.compute.manager [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Detaching volume f6a93afd-a98e-4a7e-876f-98b4c4fd2d08
Dec 05 12:20:07 user nova-compute[75071]: INFO nova.virt.block_device [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Attempting to driver detach volume f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 from mountpoint /dev/vdb
Dec 05 12:20:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Attempting to detach device vdb from instance 2625dd24-5c50-4911-9515-57c9483bafa1 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:20:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:20:07 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:20:07 user nova-compute[75071]:   <source dev="/dev/sdk"/>
Dec 05 12:20:07 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:20:07 user nova-compute[75071]:   <serial>f6a93afd-a98e-4a7e-876f-98b4c4fd2d08</serial>
Dec 05 12:20:07 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:20:07 user nova-compute[75071]: </disk>
Dec 05 12:20:07 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:20:07 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Successfully detached device vdb from instance 2625dd24-5c50-4911-9515-57c9483bafa1 from the persistent domain config.
Dec 05 12:20:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2625dd24-5c50-4911-9515-57c9483bafa1 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:20:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:20:07 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:20:07 user nova-compute[75071]:   <source dev="/dev/sdk"/>
Dec 05 12:20:07 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:20:07 user nova-compute[75071]:   <serial>f6a93afd-a98e-4a7e-876f-98b4c4fd2d08</serial>
Dec 05 12:20:07 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:20:07 user nova-compute[75071]: </disk>
Dec 05 12:20:07 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:20:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2625dd24-5c50-4911-9515-57c9483bafa1 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:20:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "12b75ed0-0ac3-4d19-bc01-c4ab10fff348" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "12b75ed0-0ac3-4d19-bc01-c4ab10fff348" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:20:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:20:11 user nova-compute[75071]: INFO nova.compute.claims [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Claim successful on node user
Dec 05 12:20:11 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:20:11 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:20:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:20:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:20:11 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:20:11 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:20:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:20:11 user nova-compute[75071]: DEBUG nova.policy [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd5aa0fe91fac4908b24204673a6c3af1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80bbd8689228459cb4bf4e93caebbf39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:20:12 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Creating image(s)
Dec 05 12:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "/opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "/opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "/opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/disk 1073741824" returned: 0 in 0.057s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Successfully created port: 75e40851-836c-42a3-8153-b071589a4f6e {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Cannot resize image /opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Ensure instance console log exists: /opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Successfully updated port: 75e40851-836c-42a3-8153-b071589a4f6e {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "refresh_cache-12b75ed0-0ac3-4d19-bc01-c4ab10fff348" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquired lock "refresh_cache-12b75ed0-0ac3-4d19-bc01-c4ab10fff348" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-783a9418-d18c-4890-9dfe-e1c51dcd7de7 req-cb93d252-4a5f-4dac-a9dc-898a49cdae37 service nova] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Received event network-changed-75e40851-836c-42a3-8153-b071589a4f6e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-783a9418-d18c-4890-9dfe-e1c51dcd7de7 req-cb93d252-4a5f-4dac-a9dc-898a49cdae37 service nova] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Refreshing instance network info cache due to event network-changed-75e40851-836c-42a3-8153-b071589a4f6e. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-783a9418-d18c-4890-9dfe-e1c51dcd7de7 req-cb93d252-4a5f-4dac-a9dc-898a49cdae37 service nova] Acquiring lock "refresh_cache-12b75ed0-0ac3-4d19-bc01-c4ab10fff348" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Updating instance_info_cache with network_info: [{"id": "75e40851-836c-42a3-8153-b071589a4f6e", "address": "fa:16:3e:e0:76:c0", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e40851-83", "ovs_interfaceid": "75e40851-836c-42a3-8153-b071589a4f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Releasing lock "refresh_cache-12b75ed0-0ac3-4d19-bc01-c4ab10fff348" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Instance network_info: |[{"id": "75e40851-836c-42a3-8153-b071589a4f6e", "address": "fa:16:3e:e0:76:c0", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e40851-83", "ovs_interfaceid": "75e40851-836c-42a3-8153-b071589a4f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-783a9418-d18c-4890-9dfe-e1c51dcd7de7 req-cb93d252-4a5f-4dac-a9dc-898a49cdae37 service nova] Acquired lock "refresh_cache-12b75ed0-0ac3-4d19-bc01-c4ab10fff348" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.network.neutron [req-783a9418-d18c-4890-9dfe-e1c51dcd7de7 req-cb93d252-4a5f-4dac-a9dc-898a49cdae37 service nova] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Refreshing network info cache for port 75e40851-836c-42a3-8153-b071589a4f6e {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Start _get_guest_xml network_info=[{"id": "75e40851-836c-42a3-8153-b071589a4f6e", "address": "fa:16:3e:e0:76:c0", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e40851-83", "ovs_interfaceid": "75e40851-836c-42a3-8153-b071589a4f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:20:13 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:20:13 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1687301094',display_name='tempest-VolumesAdminNegativeTest-server-1687301094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1687301094',id=14,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80bbd8689228459cb4bf4e93caebbf39',ramdisk_id='',reservation_id='r-9of61e9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1655468341',owner_user_name='tempest-VolumesAdminNegativeTest-1655468341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:20:12Z,user_data=None,user_id='d5aa0fe91fac4908b24204673a6c3af1',uuid=12b75ed0-0ac3-4d19-bc01-c4ab10fff348,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75e40851-836c-42a3-8153-b071589a4f6e", "address": "fa:16:3e:e0:76:c0", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e40851-83", "ovs_interfaceid": "75e40851-836c-42a3-8153-b071589a4f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Converting VIF {"id": "75e40851-836c-42a3-8153-b071589a4f6e", "address": "fa:16:3e:e0:76:c0", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e40851-83", "ovs_interfaceid": "75e40851-836c-42a3-8153-b071589a4f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:76:c0,bridge_name='br-int',has_traffic_filtering=True,id=75e40851-836c-42a3-8153-b071589a4f6e,network=Network(30520b35-382e-42c5-8395-8dddfacb2b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e40851-83') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lazy-loading 'pci_devices' on Instance uuid 12b75ed0-0ac3-4d19-bc01-c4ab10fff348 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:20:13 user nova-compute[75071]:   <uuid>12b75ed0-0ac3-4d19-bc01-c4ab10fff348</uuid>
Dec 05 12:20:13 user nova-compute[75071]:   <name>instance-0000000e</name>
Dec 05 12:20:13 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:20:13 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:20:13 user nova-compute[75071]:   <metadata>
Dec 05 12:20:13 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:20:13 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:20:13 user nova-compute[75071]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1687301094</nova:name>
Dec 05 12:20:13 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:20:13</nova:creationTime>
Dec 05 12:20:13 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:20:13 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:20:13 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:20:13 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:20:13 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:20:13 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:20:13 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:20:13 user nova-compute[75071]:       <nova:owner>
Dec 05 12:20:13 user nova-compute[75071]:         <nova:user uuid="d5aa0fe91fac4908b24204673a6c3af1">tempest-VolumesAdminNegativeTest-1655468341-project-member</nova:user>
Dec 05 12:20:13 user nova-compute[75071]:         <nova:project uuid="80bbd8689228459cb4bf4e93caebbf39">tempest-VolumesAdminNegativeTest-1655468341</nova:project>
Dec 05 12:20:13 user nova-compute[75071]:       </nova:owner>
Dec 05 12:20:13 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:20:13 user nova-compute[75071]:       <nova:ports>
Dec 05 12:20:13 user nova-compute[75071]:         <nova:port uuid="75e40851-836c-42a3-8153-b071589a4f6e">
Dec 05 12:20:13 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 05 12:20:13 user nova-compute[75071]:         </nova:port>
Dec 05 12:20:13 user nova-compute[75071]:       </nova:ports>
Dec 05 12:20:13 user nova-compute[75071]:     </nova:instance>
Dec 05 12:20:13 user nova-compute[75071]:   </metadata>
Dec 05 12:20:13 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:20:13 user nova-compute[75071]:     <system>
Dec 05 12:20:13 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:20:13 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:20:13 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:20:13 user nova-compute[75071]:       <entry name="serial">12b75ed0-0ac3-4d19-bc01-c4ab10fff348</entry>
Dec 05 12:20:13 user nova-compute[75071]:       <entry name="uuid">12b75ed0-0ac3-4d19-bc01-c4ab10fff348</entry>
Dec 05 12:20:13 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:20:13 user nova-compute[75071]:     </system>
Dec 05 12:20:13 user nova-compute[75071]:   </sysinfo>
Dec 05 12:20:13 user nova-compute[75071]:   <os>
Dec 05 12:20:13 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:20:13 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:20:13 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:20:13 user nova-compute[75071]:   </os>
Dec 05 12:20:13 user nova-compute[75071]:   <features>
Dec 05 12:20:13 user nova-compute[75071]:     <acpi/>
Dec 05 12:20:13 user nova-compute[75071]:     <apic/>
Dec 05 12:20:13 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:20:13 user nova-compute[75071]:   </features>
Dec 05 12:20:13 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:20:13 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:20:13 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:20:13 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:20:13 user nova-compute[75071]:   </clock>
Dec 05 12:20:13 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:20:13 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:20:13 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:20:13 user nova-compute[75071]:   </cpu>
Dec 05 12:20:13 user nova-compute[75071]:   <devices>
Dec 05 12:20:13 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:20:13 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:20:13 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/disk"/>
Dec 05 12:20:13 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:20:13 user nova-compute[75071]:     </disk>
Dec 05 12:20:13 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:20:13 user nova-compute[75071]:       <mac address="fa:16:3e:e0:76:c0"/>
Dec 05 12:20:13 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:20:13 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:20:13 user nova-compute[75071]:       <target dev="tap75e40851-83"/>
Dec 05 12:20:13 user nova-compute[75071]:     </interface>
Dec 05 12:20:13 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:20:13 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/console.log" append="off"/>
Dec 05 12:20:13 user nova-compute[75071]:     </serial>
Dec 05 12:20:13 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:20:13 user nova-compute[75071]:     <video>
Dec 05 12:20:13 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:20:13 user nova-compute[75071]:     </video>
Dec 05 12:20:13 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:20:13 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:20:13 user nova-compute[75071]:     </rng>
Dec 05 12:20:13 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:20:13 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:20:13 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:20:13 user nova-compute[75071]:     </memballoon>
Dec 05 12:20:13 user nova-compute[75071]:   </devices>
Dec 05 12:20:13 user nova-compute[75071]: </domain>
Dec 05 12:20:13 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1687301094',display_name='tempest-VolumesAdminNegativeTest-server-1687301094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1687301094',id=14,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80bbd8689228459cb4bf4e93caebbf39',ramdisk_id='',reservation_id='r-9of61e9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1655468341',owner_user_name='tempest-VolumesAdminNegativeTest-1655468341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:20:12Z,user_data=None,user_id='d5aa0fe91fac4908b24204673a6c3af1',uuid=12b75ed0-0ac3-4d19-bc01-c4ab10fff348,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75e40851-836c-42a3-8153-b071589a4f6e", "address": "fa:16:3e:e0:76:c0", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e40851-83", "ovs_interfaceid": "75e40851-836c-42a3-8153-b071589a4f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Converting VIF {"id": "75e40851-836c-42a3-8153-b071589a4f6e", "address": "fa:16:3e:e0:76:c0", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e40851-83", "ovs_interfaceid": "75e40851-836c-42a3-8153-b071589a4f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:76:c0,bridge_name='br-int',has_traffic_filtering=True,id=75e40851-836c-42a3-8153-b071589a4f6e,network=Network(30520b35-382e-42c5-8395-8dddfacb2b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e40851-83') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG os_vif [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:76:c0,bridge_name='br-int',has_traffic_filtering=True,id=75e40851-836c-42a3-8153-b071589a4f6e,network=Network(30520b35-382e-42c5-8395-8dddfacb2b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e40851-83') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '87643dfc-e347-5538-a41e-cc2d03862914', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75e40851-83, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75e40851-83, col_values=(('qos', UUID('596d7860-bc52-46d6-b049-fc37b318dee1')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75e40851-83, col_values=(('external_ids', {'iface-id': '75e40851-836c-42a3-8153-b071589a4f6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:76:c0', 'vm-uuid': '12b75ed0-0ac3-4d19-bc01-c4ab10fff348'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:13 user nova-compute[75071]: INFO os_vif [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:76:c0,bridge_name='br-int',has_traffic_filtering=True,id=75e40851-836c-42a3-8153-b071589a4f6e,network=Network(30520b35-382e-42c5-8395-8dddfacb2b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e40851-83')
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] No VIF found with MAC fa:16:3e:e0:76:c0, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.network.neutron [req-783a9418-d18c-4890-9dfe-e1c51dcd7de7 req-cb93d252-4a5f-4dac-a9dc-898a49cdae37 service nova] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Updated VIF entry in instance network info cache for port 75e40851-836c-42a3-8153-b071589a4f6e. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG nova.network.neutron [req-783a9418-d18c-4890-9dfe-e1c51dcd7de7 req-cb93d252-4a5f-4dac-a9dc-898a49cdae37 service nova] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Updating instance_info_cache with network_info: [{"id": "75e40851-836c-42a3-8153-b071589a4f6e", "address": "fa:16:3e:e0:76:c0", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e40851-83", "ovs_interfaceid": "75e40851-836c-42a3-8153-b071589a4f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:20:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-783a9418-d18c-4890-9dfe-e1c51dcd7de7 req-cb93d252-4a5f-4dac-a9dc-898a49cdae37 service nova] Releasing lock "refresh_cache-12b75ed0-0ac3-4d19-bc01-c4ab10fff348" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:20:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:15 user nova-compute[75071]: DEBUG nova.compute.manager [req-926ca8e7-e0ac-4141-83fa-32a846758f65 req-7a5d143b-30db-4ca0-9e72-35ac0926771d service nova] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Received event network-vif-plugged-75e40851-836c-42a3-8153-b071589a4f6e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-926ca8e7-e0ac-4141-83fa-32a846758f65 req-7a5d143b-30db-4ca0-9e72-35ac0926771d service nova] Acquiring lock "12b75ed0-0ac3-4d19-bc01-c4ab10fff348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-926ca8e7-e0ac-4141-83fa-32a846758f65 req-7a5d143b-30db-4ca0-9e72-35ac0926771d service nova] Lock "12b75ed0-0ac3-4d19-bc01-c4ab10fff348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-926ca8e7-e0ac-4141-83fa-32a846758f65 req-7a5d143b-30db-4ca0-9e72-35ac0926771d service nova] Lock "12b75ed0-0ac3-4d19-bc01-c4ab10fff348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:15 user nova-compute[75071]: DEBUG nova.compute.manager [req-926ca8e7-e0ac-4141-83fa-32a846758f65 req-7a5d143b-30db-4ca0-9e72-35ac0926771d service nova] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] No waiting events found dispatching network-vif-plugged-75e40851-836c-42a3-8153-b071589a4f6e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:15 user nova-compute[75071]: WARNING nova.compute.manager [req-926ca8e7-e0ac-4141-83fa-32a846758f65 req-7a5d143b-30db-4ca0-9e72-35ac0926771d service nova] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Received unexpected event network-vif-plugged-75e40851-836c-42a3-8153-b071589a4f6e for instance with vm_state building and task_state spawning.
Dec 05 12:20:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:20:16 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Creating image(s)
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Ensure instance console log exists: /opt/stack/data/nova/instances/c9e37746-57e8-4053-9f52-2c60bab457fa/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Start _get_guest_xml network_info=[{"id": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "address": "fa:16:3e:7b:99:8a", "network": {"id": "8f9b3ec7-df46-410f-8603-4e4ce082275b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-988513444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a14095bd354df1b0be6e89cd2e0b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c36d-f0", "ovs_interfaceid": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '1fc9348e-2e23-4f50-91e1-3644041c4376', 'device_type': 'disk', 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmdYpkry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c9e37746-57e8-4053-9f52-2c60bab457fa', 'attached_at': '', 'detached_at': '', 'volume_id': 'ddf5aeb1-c8f8-432d-8c49-68373bb2b665', 'serial': 'ddf5aeb1-c8f8-432d-8c49-68373bb2b665'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:20:16 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 05 12:20:16 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.objects.instance [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lazy-loading 'vcpu_model' on Instance uuid c9e37746-57e8-4053-9f52-2c60bab457fa {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmdYpkry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:20:16 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:20:16 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:20:16 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ac5c09-bf78-4a6d-a5d8-303fef815e4b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:20:16 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8790f704-36c6-4f43-a298-19b060f944dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665] added
Dec 05 12:20:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fcb479-02a9-4964-9c61-78d26131c929]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e0c5d2-9649-4854-8fb1-6942c3d4eaaa]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmdYpkry {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gmdYpkry" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fe923a-d4ca-4bcb-ae0d-9b7a2bdf1ee3]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gmdYpkry'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1188102c-7c31-4de8-994f-bebcd6e39070]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9fd52c-cd98-4b59-86be-1deef4c21540]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[259f8c41-e43c-4ff9-be69-c96f818fc38a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665, portal: 172.16.0.220,3260]
Dec 05 12:20:16 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665, portal: 172.16.0.220,3260] successful.
Dec 05 12:20:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdc5532-9f7e-4dbb-a825-cabe120deca2]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[380c4491-27e5-46b6-8d31-e4d71af5fc9b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:20:16 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe00a5b-8eb7-45bb-8a30-446a42a501c1]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:20:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmdYpkry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:20:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:20:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:20:17 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Instance spawned successfully.
Dec 05 12:20:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:20:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:20:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:20:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:20:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:20:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:20:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:20:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-736d1407-e98e-4a28-be67-02bbe80dfe22 req-065e91b8-b715-4d2f-a39e-84dfcfa225ec service nova] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Received event network-vif-plugged-75e40851-836c-42a3-8153-b071589a4f6e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-736d1407-e98e-4a28-be67-02bbe80dfe22 req-065e91b8-b715-4d2f-a39e-84dfcfa225ec service nova] Acquiring lock "12b75ed0-0ac3-4d19-bc01-c4ab10fff348-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-736d1407-e98e-4a28-be67-02bbe80dfe22 req-065e91b8-b715-4d2f-a39e-84dfcfa225ec service nova] Lock "12b75ed0-0ac3-4d19-bc01-c4ab10fff348-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-736d1407-e98e-4a28-be67-02bbe80dfe22 req-065e91b8-b715-4d2f-a39e-84dfcfa225ec service nova] Lock "12b75ed0-0ac3-4d19-bc01-c4ab10fff348-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-736d1407-e98e-4a28-be67-02bbe80dfe22 req-065e91b8-b715-4d2f-a39e-84dfcfa225ec service nova] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] No waiting events found dispatching network-vif-plugged-75e40851-836c-42a3-8153-b071589a4f6e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:17 user nova-compute[75071]: WARNING nova.compute.manager [req-736d1407-e98e-4a28-be67-02bbe80dfe22 req-065e91b8-b715-4d2f-a39e-84dfcfa225ec service nova] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Received unexpected event network-vif-plugged-75e40851-836c-42a3-8153-b071589a4f6e for instance with vm_state building and task_state spawning.
Dec 05 12:20:17 user nova-compute[75071]: INFO nova.compute.manager [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Took 5.36 seconds to spawn the instance on the hypervisor.
Dec 05 12:20:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:20:17 user nova-compute[75071]: INFO nova.compute.manager [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Took 6.23 seconds to build instance.
Dec 05 12:20:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2675d53a-97a4-4124-93bf-0935c2b57771 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "12b75ed0-0ac3-4d19-bc01-c4ab10fff348" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.340s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23931393062333662', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931393062333662', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T12:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1647147359',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1669594796',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJ6xZ5XBcUwxREIE7hpriVQZ0cMhVgvH0PlAMEkl0iPK+uJVd0fd5PCbz5I6L/042zo6fYM5B8tUUzAdxDa0FSOpcGykYLgtM0hDjxMaWQcHYNldfHmf9IbWnr2VIyMRg==',key_name='tempest-keypair-106536343',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:17:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d6a14095bd354df1b0be6e89cd2e0b5a',ramdisk_id='',reservation_id='r-9ic0uf1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1195759080',owner_user_name='tempest-ServerActionsV293TestJSON-1195759080-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:20:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='596a8048e44c4f5985956bba2b06aba7',uuid=c9e37746-57e8-4053-9f52-2c60bab457fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "address": "fa:16:3e:7b:99:8a", "network": {"id": "8f9b3ec7-df46-410f-8603-4e4ce082275b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-988513444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a14095bd354df1b0be6e89cd2e0b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c36d-f0", "ovs_interfaceid": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Converting VIF {"id": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "address": "fa:16:3e:7b:99:8a", "network": {"id": "8f9b3ec7-df46-410f-8603-4e4ce082275b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-988513444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a14095bd354df1b0be6e89cd2e0b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c36d-f0", "ovs_interfaceid": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=e148c36d-f01c-41e2-8e2e-082e023af6fb,network=Network(8f9b3ec7-df46-410f-8603-4e4ce082275b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c36d-f0') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:20:18 user nova-compute[75071]:   <uuid>c9e37746-57e8-4053-9f52-2c60bab457fa</uuid>
Dec 05 12:20:18 user nova-compute[75071]:   <name>instance-00000008</name>
Dec 05 12:20:18 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:20:18 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:20:18 user nova-compute[75071]:   <metadata>
Dec 05 12:20:18 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:20:18 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:20:18 user nova-compute[75071]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1647147359</nova:name>
Dec 05 12:20:18 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:20:16</nova:creationTime>
Dec 05 12:20:18 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:20:18 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:20:18 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:20:18 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:20:18 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:20:18 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:20:18 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:20:18 user nova-compute[75071]:       <nova:owner>
Dec 05 12:20:18 user nova-compute[75071]:         <nova:user uuid="596a8048e44c4f5985956bba2b06aba7">tempest-ServerActionsV293TestJSON-1195759080-project-member</nova:user>
Dec 05 12:20:18 user nova-compute[75071]:         <nova:project uuid="d6a14095bd354df1b0be6e89cd2e0b5a">tempest-ServerActionsV293TestJSON-1195759080</nova:project>
Dec 05 12:20:18 user nova-compute[75071]:       </nova:owner>
Dec 05 12:20:18 user nova-compute[75071]:       <nova:ports>
Dec 05 12:20:18 user nova-compute[75071]:         <nova:port uuid="e148c36d-f01c-41e2-8e2e-082e023af6fb">
Dec 05 12:20:18 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 05 12:20:18 user nova-compute[75071]:         </nova:port>
Dec 05 12:20:18 user nova-compute[75071]:       </nova:ports>
Dec 05 12:20:18 user nova-compute[75071]:     </nova:instance>
Dec 05 12:20:18 user nova-compute[75071]:   </metadata>
Dec 05 12:20:18 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:20:18 user nova-compute[75071]:     <system>
Dec 05 12:20:18 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:20:18 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:20:18 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:20:18 user nova-compute[75071]:       <entry name="serial">c9e37746-57e8-4053-9f52-2c60bab457fa</entry>
Dec 05 12:20:18 user nova-compute[75071]:       <entry name="uuid">c9e37746-57e8-4053-9f52-2c60bab457fa</entry>
Dec 05 12:20:18 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:20:18 user nova-compute[75071]:     </system>
Dec 05 12:20:18 user nova-compute[75071]:   </sysinfo>
Dec 05 12:20:18 user nova-compute[75071]:   <os>
Dec 05 12:20:18 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:20:18 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:20:18 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:20:18 user nova-compute[75071]:   </os>
Dec 05 12:20:18 user nova-compute[75071]:   <features>
Dec 05 12:20:18 user nova-compute[75071]:     <acpi/>
Dec 05 12:20:18 user nova-compute[75071]:     <apic/>
Dec 05 12:20:18 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:20:18 user nova-compute[75071]:   </features>
Dec 05 12:20:18 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:20:18 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:20:18 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:20:18 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:20:18 user nova-compute[75071]:   </clock>
Dec 05 12:20:18 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:20:18 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:20:18 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:20:18 user nova-compute[75071]:   </cpu>
Dec 05 12:20:18 user nova-compute[75071]:   <devices>
Dec 05 12:20:18 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:20:18 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:20:18 user nova-compute[75071]:       <source dev="/dev/sdb"/>
Dec 05 12:20:18 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:20:18 user nova-compute[75071]:       <serial>ddf5aeb1-c8f8-432d-8c49-68373bb2b665</serial>
Dec 05 12:20:18 user nova-compute[75071]:     </disk>
Dec 05 12:20:18 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:20:18 user nova-compute[75071]:       <mac address="fa:16:3e:7b:99:8a"/>
Dec 05 12:20:18 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:20:18 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:20:18 user nova-compute[75071]:       <target dev="tape148c36d-f0"/>
Dec 05 12:20:18 user nova-compute[75071]:     </interface>
Dec 05 12:20:18 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:20:18 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/c9e37746-57e8-4053-9f52-2c60bab457fa/console.log" append="off"/>
Dec 05 12:20:18 user nova-compute[75071]:     </serial>
Dec 05 12:20:18 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:20:18 user nova-compute[75071]:     <video>
Dec 05 12:20:18 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:20:18 user nova-compute[75071]:     </video>
Dec 05 12:20:18 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:20:18 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:20:18 user nova-compute[75071]:     </rng>
Dec 05 12:20:18 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:20:18 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:20:18 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:20:18 user nova-compute[75071]:     </memballoon>
Dec 05 12:20:18 user nova-compute[75071]:   </devices>
Dec 05 12:20:18 user nova-compute[75071]: </domain>
Dec 05 12:20:18 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T12:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1647147359',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1669594796',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJ6xZ5XBcUwxREIE7hpriVQZ0cMhVgvH0PlAMEkl0iPK+uJVd0fd5PCbz5I6L/042zo6fYM5B8tUUzAdxDa0FSOpcGykYLgtM0hDjxMaWQcHYNldfHmf9IbWnr2VIyMRg==',key_name='tempest-keypair-106536343',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:17:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d6a14095bd354df1b0be6e89cd2e0b5a',ramdisk_id='',reservation_id='r-9ic0uf1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1195759080',owner_user_name='tempest-ServerActionsV293TestJSON-1195759080-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:20:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='596a8048e44c4f5985956bba2b06aba7',uuid=c9e37746-57e8-4053-9f52-2c60bab457fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "address": "fa:16:3e:7b:99:8a", "network": {"id": "8f9b3ec7-df46-410f-8603-4e4ce082275b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-988513444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a14095bd354df1b0be6e89cd2e0b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c36d-f0", "ovs_interfaceid": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Converting VIF {"id": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "address": "fa:16:3e:7b:99:8a", "network": {"id": "8f9b3ec7-df46-410f-8603-4e4ce082275b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-988513444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a14095bd354df1b0be6e89cd2e0b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c36d-f0", "ovs_interfaceid": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=e148c36d-f01c-41e2-8e2e-082e023af6fb,network=Network(8f9b3ec7-df46-410f-8603-4e4ce082275b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c36d-f0') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG os_vif [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=e148c36d-f01c-41e2-8e2e-082e023af6fb,network=Network(8f9b3ec7-df46-410f-8603-4e4ce082275b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c36d-f0') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2418ed50-54c0-5053-b066-b3d61d0027e3', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape148c36d-f0, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape148c36d-f0, col_values=(('qos', UUID('d07996ee-7e1a-41c7-baca-6674696867f9')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape148c36d-f0, col_values=(('external_ids', {'iface-id': 'e148c36d-f01c-41e2-8e2e-082e023af6fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:99:8a', 'vm-uuid': 'c9e37746-57e8-4053-9f52-2c60bab457fa'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:18 user nova-compute[75071]: INFO os_vif [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=e148c36d-f01c-41e2-8e2e-082e023af6fb,network=Network(8f9b3ec7-df46-410f-8603-4e4ce082275b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c36d-f0')
Dec 05 12:20:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:20:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] No VIF found with MAC fa:16:3e:7b:99:8a, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:20:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-1b7604b4-d0aa-47be-94c4-5a8582ee54b3 req-4c209efc-ab16-498c-9204-f55b6daf38b4 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Received event network-vif-plugged-e148c36d-f01c-41e2-8e2e-082e023af6fb {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1b7604b4-d0aa-47be-94c4-5a8582ee54b3 req-4c209efc-ab16-498c-9204-f55b6daf38b4 service nova] Acquiring lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1b7604b4-d0aa-47be-94c4-5a8582ee54b3 req-4c209efc-ab16-498c-9204-f55b6daf38b4 service nova] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1b7604b4-d0aa-47be-94c4-5a8582ee54b3 req-4c209efc-ab16-498c-9204-f55b6daf38b4 service nova] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-1b7604b4-d0aa-47be-94c4-5a8582ee54b3 req-4c209efc-ab16-498c-9204-f55b6daf38b4 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] No waiting events found dispatching network-vif-plugged-e148c36d-f01c-41e2-8e2e-082e023af6fb {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:19 user nova-compute[75071]: WARNING nova.compute.manager [req-1b7604b4-d0aa-47be-94c4-5a8582ee54b3 req-4c209efc-ab16-498c-9204-f55b6daf38b4 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Received unexpected event network-vif-plugged-e148c36d-f01c-41e2-8e2e-082e023af6fb for instance with vm_state active and task_state rebuild_spawning.
Dec 05 12:20:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:20:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:20:21 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Instance spawned successfully.
Dec 05 12:20:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:20:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:20:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:20:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:20:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:20:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:20:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:20:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-0db15c13-23ea-468b-8d59-7c25efd44320 req-0f1ae3b0-e245-45c9-9802-275b45f1937e service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Received event network-vif-plugged-e148c36d-f01c-41e2-8e2e-082e023af6fb {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0db15c13-23ea-468b-8d59-7c25efd44320 req-0f1ae3b0-e245-45c9-9802-275b45f1937e service nova] Acquiring lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0db15c13-23ea-468b-8d59-7c25efd44320 req-0f1ae3b0-e245-45c9-9802-275b45f1937e service nova] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0db15c13-23ea-468b-8d59-7c25efd44320 req-0f1ae3b0-e245-45c9-9802-275b45f1937e service nova] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-0db15c13-23ea-468b-8d59-7c25efd44320 req-0f1ae3b0-e245-45c9-9802-275b45f1937e service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] No waiting events found dispatching network-vif-plugged-e148c36d-f01c-41e2-8e2e-082e023af6fb {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:21 user nova-compute[75071]: WARNING nova.compute.manager [req-0db15c13-23ea-468b-8d59-7c25efd44320 req-0f1ae3b0-e245-45c9-9802-275b45f1937e service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Received unexpected event network-vif-plugged-e148c36d-f01c-41e2-8e2e-082e023af6fb for instance with vm_state active and task_state rebuild_spawning.
Dec 05 12:20:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:20:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:21 user nova-compute[75071]: DEBUG nova.objects.instance [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75071) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Dec 05 12:20:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-73e72013-20d3-4a68-943a-121e34b7959b tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.070s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Acquiring lock "332f0212-d8e4-4a99-9688-01a26ba66916" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Lock "332f0212-d8e4-4a99-9688-01a26ba66916" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Acquiring lock "332f0212-d8e4-4a99-9688-01a26ba66916-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Lock "332f0212-d8e4-4a99-9688-01a26ba66916-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Lock "332f0212-d8e4-4a99-9688-01a26ba66916-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:28 user nova-compute[75071]: INFO nova.compute.manager [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Terminating instance
Dec 05 12:20:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:28 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2625dd24-5c50-4911-9515-57c9483bafa1 is timed out.
Dec 05 12:20:28 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Successfully detached device vdb from instance 2625dd24-5c50-4911-9515-57c9483bafa1 from the live domain config.
Dec 05 12:20:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsPxzpIH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk', 'volume_id': 'f6a93afd-a98e-4a7e-876f-98b4c4fd2d08'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:20:28 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fba665-e160-4028-8fba-acdacdbdf61b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:20:28 user nova-compute[75071]: No targets found.
Dec 05 12:20:28 user nova-compute[75071]: iSNS:
Dec 05 12:20:28 user nova-compute[75071]: No targets found.
Dec 05 12:20:28 user nova-compute[75071]: STATIC:
Dec 05 12:20:28 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08
Dec 05 12:20:28 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:28 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:28 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c
Dec 05 12:20:28 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:28 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:28 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a
Dec 05 12:20:28 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:28 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:28 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b
Dec 05 12:20:28 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:28 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:28 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e
Dec 05 12:20:28 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:28 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:28 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665
Dec 05 12:20:28 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:28 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:28 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95
Dec 05 12:20:28 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:28 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:28 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310
Dec 05 12:20:28 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:28 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:28 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6
Dec 05 12:20:28 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:28 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:28 user nova-compute[75071]: FIRMWARE:
Dec 05 12:20:28 user nova-compute[75071]: No targets found.
Dec 05 12:20:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:20:28 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:20:28 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fbd784-426e-45a3-8779-5a7be2f8d26d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e937c2-3b6e-4c42-98cb-be4183be0907]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:20:28 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:28 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:20:28 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:20:28 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:20:28 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:20:28 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:28 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:20:28 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 (non-flash)
Dec 05 12:20:28 user nova-compute[75071]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:28 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:20:28 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:20:28 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:20:28 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:20:28 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:28 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:20:28 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82742837f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08'): ({'sdk'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Removing single pathed devices sdk {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a74f42-7502-4cb7-9772-b4b4e7ec4b45]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6661779f-3bc3-4e31-b446-a2a72b77818f]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Flushing IO for device /dev/sdk {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c527ab95-a7c7-4be9-b326-7d10c4b22d46]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.039s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a9866f-1288-496b-a2f6-232ee4028769]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] SCSI volumes sdk have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b70011-82a2-4df1-b40d-877c840a77a7]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-75215671-8340-457e-8d4a-92355300948c req-8d17aca9-baf9-4d34-ae6f-3cc2a9568efe service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Received event network-vif-unplugged-cbe4b036-1cc2-4514-8a71-4709d97cc4a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-75215671-8340-457e-8d4a-92355300948c req-8d17aca9-baf9-4d34-ae6f-3cc2a9568efe service nova] Acquiring lock "332f0212-d8e4-4a99-9688-01a26ba66916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-75215671-8340-457e-8d4a-92355300948c req-8d17aca9-baf9-4d34-ae6f-3cc2a9568efe service nova] Lock "332f0212-d8e4-4a99-9688-01a26ba66916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-75215671-8340-457e-8d4a-92355300948c req-8d17aca9-baf9-4d34-ae6f-3cc2a9568efe service nova] Lock "332f0212-d8e4-4a99-9688-01a26ba66916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-75215671-8340-457e-8d4a-92355300948c req-8d17aca9-baf9-4d34-ae6f-3cc2a9568efe service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] No waiting events found dispatching network-vif-unplugged-cbe4b036-1cc2-4514-8a71-4709d97cc4a7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-75215671-8340-457e-8d4a-92355300948c req-8d17aca9-baf9-4d34-ae6f-3cc2a9568efe service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Received event network-vif-unplugged-cbe4b036-1cc2-4514-8a71-4709d97cc4a7 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.100s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5edf96a-868a-4dde-b6bf-6178d3d9fb5e]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08, portal: 172.16.0.220,3260]
Dec 05 12:20:28 user nova-compute[75071]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08, portal: 172.16.0.220,3260] successful.
Dec 05 12:20:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6a93afd-a98e-4a7e-876f-98b4c4fd2d08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b58dea-fe7b-4301-b385-e121c85bce45]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] <== disconnect_volume: return (429ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:20:28 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Instance destroyed successfully.
Dec 05 12:20:28 user nova-compute[75071]: DEBUG nova.objects.instance [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Lazy-loading 'resources' on Instance uuid 332f0212-d8e4-4a99-9688-01a26ba66916 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:17:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1498007029',display_name='tempest-VolumesAssistedSnapshotsTest-server-1498007029',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1498007029',id=7,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwlD5wrJovxrnP8dU7IUDUiIcKfG77RPpyyBr9eDcKxS1znSdjuMbMrvFTb+M8ja+mkiq2yFa46kigBIfFAFbrlbFT4MrAfJwZjKCKfY/skdFJFB13wkw9QVW+iQ6AXEQ==',key_name='tempest-keypair-897134019',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:17:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ee1f941e7214607a1997d44cb9c93a6',ramdisk_id='',reservation_id='r-cj16wh9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2059213640',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2059213640-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:17:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8556acf84cee485bb42c245386a537b4',uuid=332f0212-d8e4-4a99-9688-01a26ba66916,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "address": "fa:16:3e:79:0d:f2", "network": {"id": "4c4be769-0b96-4b02-b391-b523b458e179", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460819884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ee1f941e7214607a1997d44cb9c93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe4b036-1c", "ovs_interfaceid": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Converting VIF {"id": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "address": "fa:16:3e:79:0d:f2", "network": {"id": "4c4be769-0b96-4b02-b391-b523b458e179", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-460819884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ee1f941e7214607a1997d44cb9c93a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe4b036-1c", "ovs_interfaceid": "cbe4b036-1cc2-4514-8a71-4709d97cc4a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:0d:f2,bridge_name='br-int',has_traffic_filtering=True,id=cbe4b036-1cc2-4514-8a71-4709d97cc4a7,network=Network(4c4be769-0b96-4b02-b391-b523b458e179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe4b036-1c') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG os_vif [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:0d:f2,bridge_name='br-int',has_traffic_filtering=True,id=cbe4b036-1cc2-4514-8a71-4709d97cc4a7,network=Network(4c4be769-0b96-4b02-b391-b523b458e179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe4b036-1c') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbe4b036-1c, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef7d16d4-ad89-48be-a678-44fec8377635) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:28 user nova-compute[75071]: INFO os_vif [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:0d:f2,bridge_name='br-int',has_traffic_filtering=True,id=cbe4b036-1cc2-4514-8a71-4709d97cc4a7,network=Network(4c4be769-0b96-4b02-b391-b523b458e179),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe4b036-1c')
Dec 05 12:20:28 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Deleting instance files /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916_del
Dec 05 12:20:28 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Deletion of /opt/stack/data/nova/instances/332f0212-d8e4-4a99-9688-01a26ba66916_del complete
Dec 05 12:20:29 user nova-compute[75071]: INFO nova.compute.manager [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Took 0.89 seconds to destroy the instance on the hypervisor.
Dec 05 12:20:29 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:20:29 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:20:29 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:20:29 user nova-compute[75071]: DEBUG nova.objects.instance [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lazy-loading 'flavor' on Instance uuid 2625dd24-5c50-4911-9515-57c9483bafa1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:20:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-25b47ede-138d-48ce-af5c-da32806eccda tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "2625dd24-5c50-4911-9515-57c9483bafa1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.007s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:30 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquiring lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquiring lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:30 user nova-compute[75071]: INFO nova.compute.manager [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Terminating instance
Dec 05 12:20:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:20:30 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Took 1.35 seconds to deallocate network for instance.
Dec 05 12:20:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-ea50a1e3-48be-4e27-9087-11d32317e912 req-f6a65f0a-49ea-4599-841e-da2602e3815c service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Received event network-vif-deleted-cbe4b036-1cc2-4514-8a71-4709d97cc4a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:30 user nova-compute[75071]: INFO nova.compute.manager [req-ea50a1e3-48be-4e27-9087-11d32317e912 req-f6a65f0a-49ea-4599-841e-da2602e3815c service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Neutron deleted interface cbe4b036-1cc2-4514-8a71-4709d97cc4a7; detaching it from the instance and deleting it from the info cache
Dec 05 12:20:30 user nova-compute[75071]: DEBUG nova.network.neutron [req-ea50a1e3-48be-4e27-9087-11d32317e912 req-f6a65f0a-49ea-4599-841e-da2602e3815c service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:20:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-ea50a1e3-48be-4e27-9087-11d32317e912 req-f6a65f0a-49ea-4599-841e-da2602e3815c service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Detach interface failed, port_id=cbe4b036-1cc2-4514-8a71-4709d97cc4a7, reason: Instance 332f0212-d8e4-4a99-9688-01a26ba66916 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-91f98547-6062-4702-9a66-1be4c53a2b2a req-446aa73a-d118-4270-aff1-1dce1945183a service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Received event network-vif-plugged-cbe4b036-1cc2-4514-8a71-4709d97cc4a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-91f98547-6062-4702-9a66-1be4c53a2b2a req-446aa73a-d118-4270-aff1-1dce1945183a service nova] Acquiring lock "332f0212-d8e4-4a99-9688-01a26ba66916-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-91f98547-6062-4702-9a66-1be4c53a2b2a req-446aa73a-d118-4270-aff1-1dce1945183a service nova] Lock "332f0212-d8e4-4a99-9688-01a26ba66916-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-91f98547-6062-4702-9a66-1be4c53a2b2a req-446aa73a-d118-4270-aff1-1dce1945183a service nova] Lock "332f0212-d8e4-4a99-9688-01a26ba66916-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-91f98547-6062-4702-9a66-1be4c53a2b2a req-446aa73a-d118-4270-aff1-1dce1945183a service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] No waiting events found dispatching network-vif-plugged-cbe4b036-1cc2-4514-8a71-4709d97cc4a7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:30 user nova-compute[75071]: WARNING nova.compute.manager [req-91f98547-6062-4702-9a66-1be4c53a2b2a req-446aa73a-d118-4270-aff1-1dce1945183a service nova] [instance: 332f0212-d8e4-4a99-9688-01a26ba66916] Received unexpected event network-vif-plugged-cbe4b036-1cc2-4514-8a71-4709d97cc4a7 for instance with vm_state deleted and task_state None.
Dec 05 12:20:31 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:20:31 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:20:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.661s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Instance destroyed successfully.
Dec 05 12:20:31 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lazy-loading 'resources' on Instance uuid 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:20:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:18:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1001798486',display_name='tempest-VolumesActionsTest-instance-1001798486',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1001798486',id=11,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:18:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dce66477a63c44ac8df4b147456f3653',ramdisk_id='',reservation_id='r-uq2udegs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-128873361',owner_user_name='tempest-VolumesActionsTest-128873361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:18:57Z,user_data=None,user_id='44a85d29f03344119f15021c037ae5e0',uuid=1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "address": "fa:16:3e:d2:a9:51", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2f8657a-3b", "ovs_interfaceid": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:20:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Converting VIF {"id": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "address": "fa:16:3e:d2:a9:51", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2f8657a-3b", "ovs_interfaceid": "b2f8657a-3b46-4736-8a9e-101e997c0b30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:31 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=b2f8657a-3b46-4736-8a9e-101e997c0b30,network=Network(a5b2962d-4c1e-40d6-adc0-ea51e41d06a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2f8657a-3b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:31 user nova-compute[75071]: DEBUG os_vif [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=b2f8657a-3b46-4736-8a9e-101e997c0b30,network=Network(a5b2962d-4c1e-40d6-adc0-ea51e41d06a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2f8657a-3b') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:20:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2f8657a-3b, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d8da690-8ff9-4901-9319-2a6ecb0837c5) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:31 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Deleted allocations for instance 332f0212-d8e4-4a99-9688-01a26ba66916
Dec 05 12:20:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:31 user nova-compute[75071]: INFO os_vif [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:a9:51,bridge_name='br-int',has_traffic_filtering=True,id=b2f8657a-3b46-4736-8a9e-101e997c0b30,network=Network(a5b2962d-4c1e-40d6-adc0-ea51e41d06a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2f8657a-3b')
Dec 05 12:20:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Deleting instance files /opt/stack/data/nova/instances/1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b_del
Dec 05 12:20:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Deletion of /opt/stack/data/nova/instances/1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b_del complete
Dec 05 12:20:31 user nova-compute[75071]: INFO nova.compute.manager [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Took 0.86 seconds to destroy the instance on the hypervisor.
Dec 05 12:20:31 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:20:31 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:20:31 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:20:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-47b17a9e-d3e2-41d9-a415-a0607ddcbce4 tempest-VolumesAssistedSnapshotsTest-2059213640 tempest-VolumesAssistedSnapshotsTest-2059213640-project-member] Lock "332f0212-d8e4-4a99-9688-01a26ba66916" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.120s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:31 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:20:31 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Took 0.60 seconds to deallocate network for instance.
Dec 05 12:20:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:32 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:20:32 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:32 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Deleted allocations for instance 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b
Dec 05 12:20:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-27fd80a6-b193-4ecd-9bc8-34d53ec59873 req-e58a9d3e-2c8e-49ae-a5f6-a86128ed28f6 service nova] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Received event network-vif-unplugged-b2f8657a-3b46-4736-8a9e-101e997c0b30 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-27fd80a6-b193-4ecd-9bc8-34d53ec59873 req-e58a9d3e-2c8e-49ae-a5f6-a86128ed28f6 service nova] Acquiring lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-27fd80a6-b193-4ecd-9bc8-34d53ec59873 req-e58a9d3e-2c8e-49ae-a5f6-a86128ed28f6 service nova] Lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-27fd80a6-b193-4ecd-9bc8-34d53ec59873 req-e58a9d3e-2c8e-49ae-a5f6-a86128ed28f6 service nova] Lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-27fd80a6-b193-4ecd-9bc8-34d53ec59873 req-e58a9d3e-2c8e-49ae-a5f6-a86128ed28f6 service nova] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] No waiting events found dispatching network-vif-unplugged-b2f8657a-3b46-4736-8a9e-101e997c0b30 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:32 user nova-compute[75071]: WARNING nova.compute.manager [req-27fd80a6-b193-4ecd-9bc8-34d53ec59873 req-e58a9d3e-2c8e-49ae-a5f6-a86128ed28f6 service nova] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Received unexpected event network-vif-unplugged-b2f8657a-3b46-4736-8a9e-101e997c0b30 for instance with vm_state deleted and task_state None.
Dec 05 12:20:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-27fd80a6-b193-4ecd-9bc8-34d53ec59873 req-e58a9d3e-2c8e-49ae-a5f6-a86128ed28f6 service nova] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Received event network-vif-plugged-b2f8657a-3b46-4736-8a9e-101e997c0b30 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-27fd80a6-b193-4ecd-9bc8-34d53ec59873 req-e58a9d3e-2c8e-49ae-a5f6-a86128ed28f6 service nova] Acquiring lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-27fd80a6-b193-4ecd-9bc8-34d53ec59873 req-e58a9d3e-2c8e-49ae-a5f6-a86128ed28f6 service nova] Lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-27fd80a6-b193-4ecd-9bc8-34d53ec59873 req-e58a9d3e-2c8e-49ae-a5f6-a86128ed28f6 service nova] Lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-27fd80a6-b193-4ecd-9bc8-34d53ec59873 req-e58a9d3e-2c8e-49ae-a5f6-a86128ed28f6 service nova] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] No waiting events found dispatching network-vif-plugged-b2f8657a-3b46-4736-8a9e-101e997c0b30 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:32 user nova-compute[75071]: WARNING nova.compute.manager [req-27fd80a6-b193-4ecd-9bc8-34d53ec59873 req-e58a9d3e-2c8e-49ae-a5f6-a86128ed28f6 service nova] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Received unexpected event network-vif-plugged-b2f8657a-3b46-4736-8a9e-101e997c0b30 for instance with vm_state deleted and task_state None.
Dec 05 12:20:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-27fd80a6-b193-4ecd-9bc8-34d53ec59873 req-e58a9d3e-2c8e-49ae-a5f6-a86128ed28f6 service nova] [instance: 1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b] Received event network-vif-deleted-b2f8657a-3b46-4736-8a9e-101e997c0b30 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b4552453-3a47-43ad-9c0e-174e0c8e017f tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "1b9f21f4-6ca9-4efa-81f0-cf0761f75a6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.117s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-087ccb7d-e36d-4636-8cb8-2f7db773ffbf req-e6c29765-114e-4548-87f8-93062c385e64 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-changed-21361178-8b0b-43fb-9381-37e603f8d993 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-087ccb7d-e36d-4636-8cb8-2f7db773ffbf req-e6c29765-114e-4548-87f8-93062c385e64 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Refreshing instance network info cache due to event network-changed-21361178-8b0b-43fb-9381-37e603f8d993. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:20:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-087ccb7d-e36d-4636-8cb8-2f7db773ffbf req-e6c29765-114e-4548-87f8-93062c385e64 service nova] Acquiring lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:20:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-087ccb7d-e36d-4636-8cb8-2f7db773ffbf req-e6c29765-114e-4548-87f8-93062c385e64 service nova] Acquired lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:20:36 user nova-compute[75071]: DEBUG nova.network.neutron [req-087ccb7d-e36d-4636-8cb8-2f7db773ffbf req-e6c29765-114e-4548-87f8-93062c385e64 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Refreshing network info cache for port 21361178-8b0b-43fb-9381-37e603f8d993 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:20:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:36 user nova-compute[75071]: DEBUG nova.network.neutron [req-087ccb7d-e36d-4636-8cb8-2f7db773ffbf req-e6c29765-114e-4548-87f8-93062c385e64 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Updated VIF entry in instance network info cache for port 21361178-8b0b-43fb-9381-37e603f8d993. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:20:36 user nova-compute[75071]: DEBUG nova.network.neutron [req-087ccb7d-e36d-4636-8cb8-2f7db773ffbf req-e6c29765-114e-4548-87f8-93062c385e64 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Updating instance_info_cache with network_info: [{"id": "21361178-8b0b-43fb-9381-37e603f8d993", "address": "fa:16:3e:86:db:af", "network": {"id": "150ec31a-5cc2-485a-8ed6-07bd26173225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-441693172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21361178-8b", "ovs_interfaceid": "21361178-8b0b-43fb-9381-37e603f8d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc837761-a388-414b-9c08-8835b4e255c7", "address": "fa:16:3e:bd:f8:40", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc837761-a3", "ovs_interfaceid": "cc837761-a388-414b-9c08-8835b4e255c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "deb82347-819f-40f5-bc84-b1562c29af71", "address": "fa:16:3e:16:d6:e0", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb82347-81", "ovs_interfaceid": "deb82347-819f-40f5-bc84-b1562c29af71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "30d569c6-052c-487b-99d8-142bed67ae7e", "address": "fa:16:3e:8f:44:7e", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d569c6-05", "ovs_interfaceid": "30d569c6-052c-487b-99d8-142bed67ae7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "address": "fa:16:3e:3f:fb:3b", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c5a6d6-90", "ovs_interfaceid": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "address": "fa:16:3e:22:b6:fc", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e645b-e3", "ovs_interfaceid": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "address": "fa:16:3e:eb:4e:30", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eadd24f-48", "ovs_interfaceid": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:20:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-087ccb7d-e36d-4636-8cb8-2f7db773ffbf req-e6c29765-114e-4548-87f8-93062c385e64 service nova] Releasing lock "refresh_cache-58e955b6-be0c-41bc-9a39-4eeec3b694a1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:20:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-5ebc9a18-3937-4aac-ab57-73a4ffbc7e76 req-242ece7c-d86b-4b8d-a8a1-d1a768a3b32c service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-changed-0d9f17d4-6b21-460d-9a8c-47270cf8a163 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-5ebc9a18-3937-4aac-ab57-73a4ffbc7e76 req-242ece7c-d86b-4b8d-a8a1-d1a768a3b32c service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Refreshing instance network info cache due to event network-changed-0d9f17d4-6b21-460d-9a8c-47270cf8a163. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:20:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5ebc9a18-3937-4aac-ab57-73a4ffbc7e76 req-242ece7c-d86b-4b8d-a8a1-d1a768a3b32c service nova] Acquiring lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:20:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5ebc9a18-3937-4aac-ab57-73a4ffbc7e76 req-242ece7c-d86b-4b8d-a8a1-d1a768a3b32c service nova] Acquired lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:20:38 user nova-compute[75071]: DEBUG nova.network.neutron [req-5ebc9a18-3937-4aac-ab57-73a4ffbc7e76 req-242ece7c-d86b-4b8d-a8a1-d1a768a3b32c service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Refreshing network info cache for port 0d9f17d4-6b21-460d-9a8c-47270cf8a163 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:20:38 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:20:38 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:20:38 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:20:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:38 user nova-compute[75071]: INFO nova.compute.manager [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Terminating instance
Dec 05 12:20:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:20:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-148e0850-5568-45d0-98d2-d6c4b2e6f5d0 req-6a32a375-0583-41d2-adc1-6c167ea0fc61 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-unplugged-deb82347-819f-40f5-bc84-b1562c29af71 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-148e0850-5568-45d0-98d2-d6c4b2e6f5d0 req-6a32a375-0583-41d2-adc1-6c167ea0fc61 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-148e0850-5568-45d0-98d2-d6c4b2e6f5d0 req-6a32a375-0583-41d2-adc1-6c167ea0fc61 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-148e0850-5568-45d0-98d2-d6c4b2e6f5d0 req-6a32a375-0583-41d2-adc1-6c167ea0fc61 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-148e0850-5568-45d0-98d2-d6c4b2e6f5d0 req-6a32a375-0583-41d2-adc1-6c167ea0fc61 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-unplugged-deb82347-819f-40f5-bc84-b1562c29af71 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-148e0850-5568-45d0-98d2-d6c4b2e6f5d0 req-6a32a375-0583-41d2-adc1-6c167ea0fc61 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-unplugged-deb82347-819f-40f5-bc84-b1562c29af71 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-8119b014-463d-4d92-97bf-38d4b89ca7e0 req-1fdf2bd0-21f9-42bf-9dd7-76d2d966246e service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-unplugged-cc837761-a388-414b-9c08-8835b4e255c7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8119b014-463d-4d92-97bf-38d4b89ca7e0 req-1fdf2bd0-21f9-42bf-9dd7-76d2d966246e service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8119b014-463d-4d92-97bf-38d4b89ca7e0 req-1fdf2bd0-21f9-42bf-9dd7-76d2d966246e service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8119b014-463d-4d92-97bf-38d4b89ca7e0 req-1fdf2bd0-21f9-42bf-9dd7-76d2d966246e service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-8119b014-463d-4d92-97bf-38d4b89ca7e0 req-1fdf2bd0-21f9-42bf-9dd7-76d2d966246e service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-unplugged-cc837761-a388-414b-9c08-8835b4e255c7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-8119b014-463d-4d92-97bf-38d4b89ca7e0 req-1fdf2bd0-21f9-42bf-9dd7-76d2d966246e service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-unplugged-cc837761-a388-414b-9c08-8835b4e255c7 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG nova.network.neutron [req-5ebc9a18-3937-4aac-ab57-73a4ffbc7e76 req-242ece7c-d86b-4b8d-a8a1-d1a768a3b32c service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Updated VIF entry in instance network info cache for port 0d9f17d4-6b21-460d-9a8c-47270cf8a163. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG nova.network.neutron [req-5ebc9a18-3937-4aac-ab57-73a4ffbc7e76 req-242ece7c-d86b-4b8d-a8a1-d1a768a3b32c service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Updating instance_info_cache with network_info: [{"id": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "address": "fa:16:3e:71:02:8a", "network": {"id": "f50e74cc-b2a2-4c93-ba7d-b11c02b457f2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2077462928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9f17d4-6b", "ovs_interfaceid": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "address": "fa:16:3e:02:bc:64", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa580be24-0d", "ovs_interfaceid": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34466bd1-f50e-4643-917f-512f81302b85", "address": "fa:16:3e:03:67:06", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34466bd1-f5", "ovs_interfaceid": "34466bd1-f50e-4643-917f-512f81302b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "address": "fa:16:3e:57:d9:ae", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443a2f48-d7", "ovs_interfaceid": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "address": "fa:16:3e:51:c5:b6", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d60ebb-51", "ovs_interfaceid": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "address": "fa:16:3e:e6:3a:a8", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5b1c1e-64", "ovs_interfaceid": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "afa68989-e42f-4b32-b4d4-319a6290df7d", "address": "fa:16:3e:c6:0a:e2", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa68989-e4", "ovs_interfaceid": "afa68989-e42f-4b32-b4d4-319a6290df7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5ebc9a18-3937-4aac-ab57-73a4ffbc7e76 req-242ece7c-d86b-4b8d-a8a1-d1a768a3b32c service nova] Releasing lock "refresh_cache-94aa75f8-6097-4cba-b567-112ec59efd8f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-b395c627-b9e9-4244-b95b-d4b5ac790790 req-87753d54-e14e-40d4-981c-ba2c1ee1927b service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-unplugged-21361178-8b0b-43fb-9381-37e603f8d993 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b395c627-b9e9-4244-b95b-d4b5ac790790 req-87753d54-e14e-40d4-981c-ba2c1ee1927b service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b395c627-b9e9-4244-b95b-d4b5ac790790 req-87753d54-e14e-40d4-981c-ba2c1ee1927b service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b395c627-b9e9-4244-b95b-d4b5ac790790 req-87753d54-e14e-40d4-981c-ba2c1ee1927b service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-b395c627-b9e9-4244-b95b-d4b5ac790790 req-87753d54-e14e-40d4-981c-ba2c1ee1927b service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-unplugged-21361178-8b0b-43fb-9381-37e603f8d993 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-b395c627-b9e9-4244-b95b-d4b5ac790790 req-87753d54-e14e-40d4-981c-ba2c1ee1927b service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-unplugged-21361178-8b0b-43fb-9381-37e603f8d993 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-b395c627-b9e9-4244-b95b-d4b5ac790790 req-87753d54-e14e-40d4-981c-ba2c1ee1927b service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-21361178-8b0b-43fb-9381-37e603f8d993 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b395c627-b9e9-4244-b95b-d4b5ac790790 req-87753d54-e14e-40d4-981c-ba2c1ee1927b service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b395c627-b9e9-4244-b95b-d4b5ac790790 req-87753d54-e14e-40d4-981c-ba2c1ee1927b service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b395c627-b9e9-4244-b95b-d4b5ac790790 req-87753d54-e14e-40d4-981c-ba2c1ee1927b service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-b395c627-b9e9-4244-b95b-d4b5ac790790 req-87753d54-e14e-40d4-981c-ba2c1ee1927b service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-21361178-8b0b-43fb-9381-37e603f8d993 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:40 user nova-compute[75071]: WARNING nova.compute.manager [req-b395c627-b9e9-4244-b95b-d4b5ac790790 req-87753d54-e14e-40d4-981c-ba2c1ee1927b service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-21361178-8b0b-43fb-9381-37e603f8d993 for instance with vm_state active and task_state deleting.
Dec 05 12:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:40 user nova-compute[75071]: INFO nova.compute.manager [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Terminating instance
Dec 05 12:20:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:20:40 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Instance destroyed successfully.
Dec 05 12:20:40 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lazy-loading 'resources' on Instance uuid 58e955b6-be0c-41bc-9a39-4eeec3b694a1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:18:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:18:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21361178-8b0b-43fb-9381-37e603f8d993", "address": "fa:16:3e:86:db:af", "network": {"id": "150ec31a-5cc2-485a-8ed6-07bd26173225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-441693172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21361178-8b", "ovs_interfaceid": "21361178-8b0b-43fb-9381-37e603f8d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "21361178-8b0b-43fb-9381-37e603f8d993", "address": "fa:16:3e:86:db:af", "network": {"id": "150ec31a-5cc2-485a-8ed6-07bd26173225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-441693172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21361178-8b", "ovs_interfaceid": "21361178-8b0b-43fb-9381-37e603f8d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:db:af,bridge_name='br-int',has_traffic_filtering=True,id=21361178-8b0b-43fb-9381-37e603f8d993,network=Network(150ec31a-5cc2-485a-8ed6-07bd26173225),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21361178-8b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG os_vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:db:af,bridge_name='br-int',has_traffic_filtering=True,id=21361178-8b0b-43fb-9381-37e603f8d993,network=Network(150ec31a-5cc2-485a-8ed6-07bd26173225),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21361178-8b') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21361178-8b, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3dd90f0-6dff-4327-a07f-ef62ba1df859) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:41 user nova-compute[75071]: INFO os_vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:db:af,bridge_name='br-int',has_traffic_filtering=True,id=21361178-8b0b-43fb-9381-37e603f8d993,network=Network(150ec31a-5cc2-485a-8ed6-07bd26173225),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21361178-8b')
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:18:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:18:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc837761-a388-414b-9c08-8835b4e255c7", "address": "fa:16:3e:bd:f8:40", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc837761-a3", "ovs_interfaceid": "cc837761-a388-414b-9c08-8835b4e255c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "cc837761-a388-414b-9c08-8835b4e255c7", "address": "fa:16:3e:bd:f8:40", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc837761-a3", "ovs_interfaceid": "cc837761-a388-414b-9c08-8835b4e255c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=cc837761-a388-414b-9c08-8835b4e255c7,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcc837761-a3') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG os_vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=cc837761-a388-414b-9c08-8835b4e255c7,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcc837761-a3') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc837761-a3, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f29a172a-f378-447f-95ac-93a716300298) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-802eecdf-d801-4807-af19-fa0b87e55c0d req-293c2445-34c7-4e6c-8176-162db915448c service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-cc837761-a388-414b-9c08-8835b4e255c7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-802eecdf-d801-4807-af19-fa0b87e55c0d req-293c2445-34c7-4e6c-8176-162db915448c service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-802eecdf-d801-4807-af19-fa0b87e55c0d req-293c2445-34c7-4e6c-8176-162db915448c service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-802eecdf-d801-4807-af19-fa0b87e55c0d req-293c2445-34c7-4e6c-8176-162db915448c service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-802eecdf-d801-4807-af19-fa0b87e55c0d req-293c2445-34c7-4e6c-8176-162db915448c service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-cc837761-a388-414b-9c08-8835b4e255c7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:41 user nova-compute[75071]: WARNING nova.compute.manager [req-802eecdf-d801-4807-af19-fa0b87e55c0d req-293c2445-34c7-4e6c-8176-162db915448c service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-cc837761-a388-414b-9c08-8835b4e255c7 for instance with vm_state active and task_state deleting.
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-802eecdf-d801-4807-af19-fa0b87e55c0d req-293c2445-34c7-4e6c-8176-162db915448c service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-unplugged-19d60ebb-5100-4ba5-9fe7-d9b246e4971d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-802eecdf-d801-4807-af19-fa0b87e55c0d req-293c2445-34c7-4e6c-8176-162db915448c service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-802eecdf-d801-4807-af19-fa0b87e55c0d req-293c2445-34c7-4e6c-8176-162db915448c service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-802eecdf-d801-4807-af19-fa0b87e55c0d req-293c2445-34c7-4e6c-8176-162db915448c service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-802eecdf-d801-4807-af19-fa0b87e55c0d req-293c2445-34c7-4e6c-8176-162db915448c service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-unplugged-19d60ebb-5100-4ba5-9fe7-d9b246e4971d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-802eecdf-d801-4807-af19-fa0b87e55c0d req-293c2445-34c7-4e6c-8176-162db915448c service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-unplugged-19d60ebb-5100-4ba5-9fe7-d9b246e4971d for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-228f1416-2626-4743-a578-9802f2781f31 req-cd54b515-c154-4c09-8478-72667c5fa771 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-deb82347-819f-40f5-bc84-b1562c29af71 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-228f1416-2626-4743-a578-9802f2781f31 req-cd54b515-c154-4c09-8478-72667c5fa771 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-228f1416-2626-4743-a578-9802f2781f31 req-cd54b515-c154-4c09-8478-72667c5fa771 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-228f1416-2626-4743-a578-9802f2781f31 req-cd54b515-c154-4c09-8478-72667c5fa771 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-228f1416-2626-4743-a578-9802f2781f31 req-cd54b515-c154-4c09-8478-72667c5fa771 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-deb82347-819f-40f5-bc84-b1562c29af71 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:41 user nova-compute[75071]: WARNING nova.compute.manager [req-228f1416-2626-4743-a578-9802f2781f31 req-cd54b515-c154-4c09-8478-72667c5fa771 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-deb82347-819f-40f5-bc84-b1562c29af71 for instance with vm_state active and task_state deleting.
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-228f1416-2626-4743-a578-9802f2781f31 req-cd54b515-c154-4c09-8478-72667c5fa771 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-unplugged-d96e645b-e317-4ac8-88b4-67e62a3c41b7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-228f1416-2626-4743-a578-9802f2781f31 req-cd54b515-c154-4c09-8478-72667c5fa771 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-228f1416-2626-4743-a578-9802f2781f31 req-cd54b515-c154-4c09-8478-72667c5fa771 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-228f1416-2626-4743-a578-9802f2781f31 req-cd54b515-c154-4c09-8478-72667c5fa771 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-228f1416-2626-4743-a578-9802f2781f31 req-cd54b515-c154-4c09-8478-72667c5fa771 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-unplugged-d96e645b-e317-4ac8-88b4-67e62a3c41b7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-228f1416-2626-4743-a578-9802f2781f31 req-cd54b515-c154-4c09-8478-72667c5fa771 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-unplugged-d96e645b-e317-4ac8-88b4-67e62a3c41b7 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-228f1416-2626-4743-a578-9802f2781f31 req-cd54b515-c154-4c09-8478-72667c5fa771 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-d96e645b-e317-4ac8-88b4-67e62a3c41b7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-228f1416-2626-4743-a578-9802f2781f31 req-cd54b515-c154-4c09-8478-72667c5fa771 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-228f1416-2626-4743-a578-9802f2781f31 req-cd54b515-c154-4c09-8478-72667c5fa771 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-228f1416-2626-4743-a578-9802f2781f31 req-cd54b515-c154-4c09-8478-72667c5fa771 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-228f1416-2626-4743-a578-9802f2781f31 req-cd54b515-c154-4c09-8478-72667c5fa771 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-d96e645b-e317-4ac8-88b4-67e62a3c41b7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:41 user nova-compute[75071]: WARNING nova.compute.manager [req-228f1416-2626-4743-a578-9802f2781f31 req-cd54b515-c154-4c09-8478-72667c5fa771 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-d96e645b-e317-4ac8-88b4-67e62a3c41b7 for instance with vm_state active and task_state deleting.
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:41 user nova-compute[75071]: INFO os_vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f8:40,bridge_name='br-int',has_traffic_filtering=True,id=cc837761-a388-414b-9c08-8835b4e255c7,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapcc837761-a3')
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:18:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:18:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "deb82347-819f-40f5-bc84-b1562c29af71", "address": "fa:16:3e:16:d6:e0", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb82347-81", "ovs_interfaceid": "deb82347-819f-40f5-bc84-b1562c29af71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "deb82347-819f-40f5-bc84-b1562c29af71", "address": "fa:16:3e:16:d6:e0", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb82347-81", "ovs_interfaceid": "deb82347-819f-40f5-bc84-b1562c29af71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:d6:e0,bridge_name='br-int',has_traffic_filtering=True,id=deb82347-819f-40f5-bc84-b1562c29af71,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdeb82347-81') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG os_vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:d6:e0,bridge_name='br-int',has_traffic_filtering=True,id=deb82347-819f-40f5-bc84-b1562c29af71,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdeb82347-81') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdeb82347-81, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:41 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Instance destroyed successfully.
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.objects.instance [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lazy-loading 'resources' on Instance uuid 94aa75f8-6097-4cba-b567-112ec59efd8f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb97bb2e-bc49-419e-a8de-cb36a57f626c) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:18:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:18:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "address": "fa:16:3e:71:02:8a", "network": {"id": "f50e74cc-b2a2-4c93-ba7d-b11c02b457f2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2077462928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9f17d4-6b", "ovs_interfaceid": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "address": "fa:16:3e:71:02:8a", "network": {"id": "f50e74cc-b2a2-4c93-ba7d-b11c02b457f2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2077462928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9f17d4-6b", "ovs_interfaceid": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:02:8a,bridge_name='br-int',has_traffic_filtering=True,id=0d9f17d4-6b21-460d-9a8c-47270cf8a163,network=Network(f50e74cc-b2a2-4c93-ba7d-b11c02b457f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9f17d4-6b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG os_vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:02:8a,bridge_name='br-int',has_traffic_filtering=True,id=0d9f17d4-6b21-460d-9a8c-47270cf8a163,network=Network(f50e74cc-b2a2-4c93-ba7d-b11c02b457f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9f17d4-6b') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lazy-loading 'flavor' on Instance uuid e0c82eba-8448-4780-b92d-62d7c60ec7ef {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d9f17d4-6b, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:42 user nova-compute[75071]: INFO os_vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:d6:e0,bridge_name='br-int',has_traffic_filtering=True,id=deb82347-819f-40f5-bc84-b1562c29af71,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdeb82347-81')
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:18:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:18:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30d569c6-052c-487b-99d8-142bed67ae7e", "address": "fa:16:3e:8f:44:7e", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d569c6-05", "ovs_interfaceid": "30d569c6-052c-487b-99d8-142bed67ae7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "30d569c6-052c-487b-99d8-142bed67ae7e", "address": "fa:16:3e:8f:44:7e", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d569c6-05", "ovs_interfaceid": "30d569c6-052c-487b-99d8-142bed67ae7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:44:7e,bridge_name='br-int',has_traffic_filtering=True,id=30d569c6-052c-487b-99d8-142bed67ae7e,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30d569c6-05') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG os_vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:44:7e,bridge_name='br-int',has_traffic_filtering=True,id=30d569c6-052c-487b-99d8-142bed67ae7e,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30d569c6-05') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-unplugged-30d569c6-052c-487b-99d8-142bed67ae7e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-unplugged-30d569c6-052c-487b-99d8-142bed67ae7e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-unplugged-30d569c6-052c-487b-99d8-142bed67ae7e for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-30d569c6-052c-487b-99d8-142bed67ae7e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-30d569c6-052c-487b-99d8-142bed67ae7e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:42 user nova-compute[75071]: WARNING nova.compute.manager [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-30d569c6-052c-487b-99d8-142bed67ae7e for instance with vm_state active and task_state deleting.
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-unplugged-26c5a6d6-9037-490d-b40b-8e0c5bb16d0b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-unplugged-26c5a6d6-9037-490d-b40b-8e0c5bb16d0b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-unplugged-26c5a6d6-9037-490d-b40b-8e0c5bb16d0b for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-26c5a6d6-9037-490d-b40b-8e0c5bb16d0b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-26c5a6d6-9037-490d-b40b-8e0c5bb16d0b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:42 user nova-compute[75071]: WARNING nova.compute.manager [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-26c5a6d6-9037-490d-b40b-8e0c5bb16d0b for instance with vm_state active and task_state deleting.
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-unplugged-7eadd24f-487c-4d19-b5eb-7d9483bf1800 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-unplugged-7eadd24f-487c-4d19-b5eb-7d9483bf1800 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-cdfdd319-3390-4b29-8a9d-5eb001d7bc54 req-60de48d4-9e05-48b9-a552-40612a2e5025 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-unplugged-7eadd24f-487c-4d19-b5eb-7d9483bf1800 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.126s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30d569c6-05, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:42 user nova-compute[75071]: INFO nova.compute.manager [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Attaching volume f4aad4b4-ae4a-421e-9dce-491dbd59a219 to /dev/vdb
Dec 05 12:20:42 user nova-compute[75071]: DEBUG os_brick.utils [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[70969079-1753-4174-bd82-e1703c06cdfb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5cb7a3-a493-460c-afd6-18f53930f182]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b52cfff7-d53e-4592-b837-d06fefc36797) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[396bda83-6ec7-41d5-8e65-50e0c1b69c89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f050752-b1d2-4b58-86d8-58fad8e9857d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9445cb2-2103-48a8-9529-9680b4b392f1) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:42 user nova-compute[75071]: INFO os_vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:02:8a,bridge_name='br-int',has_traffic_filtering=True,id=0d9f17d4-6b21-460d-9a8c-47270cf8a163,network=Network(f50e74cc-b2a2-4c93-ba7d-b11c02b457f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9f17d4-6b')
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:18:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:18:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "address": "fa:16:3e:02:bc:64", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa580be24-0d", "ovs_interfaceid": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "address": "fa:16:3e:02:bc:64", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa580be24-0d", "ovs_interfaceid": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:bc:64,bridge_name='br-int',has_traffic_filtering=True,id=a580be24-0d0f-4cf1-8abc-2b9514de0cbf,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa580be24-0d') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG os_vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:bc:64,bridge_name='br-int',has_traffic_filtering=True,id=a580be24-0d0f-4cf1-8abc-2b9514de0cbf,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa580be24-0d') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:20:42 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8131f0cc-446f-46af-a09f-3f76665653bc]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG os_brick.utils [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updating existing volume attachment record: 0d9ba6be-2b25-4881-a085-9de89bc2f5a5 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa580be24-0d, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:42 user nova-compute[75071]: INFO os_vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:44:7e,bridge_name='br-int',has_traffic_filtering=True,id=30d569c6-052c-487b-99d8-142bed67ae7e,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30d569c6-05')
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:18:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:18:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "address": "fa:16:3e:3f:fb:3b", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c5a6d6-90", "ovs_interfaceid": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "address": "fa:16:3e:3f:fb:3b", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c5a6d6-90", "ovs_interfaceid": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:fb:3b,bridge_name='br-int',has_traffic_filtering=True,id=26c5a6d6-9037-490d-b40b-8e0c5bb16d0b,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c5a6d6-90') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG os_vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:fb:3b,bridge_name='br-int',has_traffic_filtering=True,id=26c5a6d6-9037-490d-b40b-8e0c5bb16d0b,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c5a6d6-90') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26c5a6d6-90, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fce5a915-60cb-41fa-ace5-56e655cf89bb) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc8c91b4-5d25-4e79-8005-88092e795dcb) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:43 user nova-compute[75071]: INFO os_vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:bc:64,bridge_name='br-int',has_traffic_filtering=True,id=a580be24-0d0f-4cf1-8abc-2b9514de0cbf,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa580be24-0d')
Dec 05 12:20:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:18:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:18:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "34466bd1-f50e-4643-917f-512f81302b85", "address": "fa:16:3e:03:67:06", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34466bd1-f5", "ovs_interfaceid": "34466bd1-f50e-4643-917f-512f81302b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "34466bd1-f50e-4643-917f-512f81302b85", "address": "fa:16:3e:03:67:06", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34466bd1-f5", "ovs_interfaceid": "34466bd1-f50e-4643-917f-512f81302b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:67:06,bridge_name='br-int',has_traffic_filtering=True,id=34466bd1-f50e-4643-917f-512f81302b85,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34466bd1-f5') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG os_vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:67:06,bridge_name='br-int',has_traffic_filtering=True,id=34466bd1-f50e-4643-917f-512f81302b85,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34466bd1-f5') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34466bd1-f5, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:43 user nova-compute[75071]: INFO os_vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:fb:3b,bridge_name='br-int',has_traffic_filtering=True,id=26c5a6d6-9037-490d-b40b-8e0c5bb16d0b,network=Network(ddb35b54-8349-49d2-b736-0ec26a71f912),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26c5a6d6-90')
Dec 05 12:20:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:18:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:18:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "address": "fa:16:3e:22:b6:fc", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e645b-e3", "ovs_interfaceid": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "address": "fa:16:3e:22:b6:fc", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd96e645b-e3", "ovs_interfaceid": "d96e645b-e317-4ac8-88b4-67e62a3c41b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:b6:fc,bridge_name='br-int',has_traffic_filtering=True,id=d96e645b-e317-4ac8-88b4-67e62a3c41b7,network=Network(99af4e0a-7f37-4fab-9dfb-ba79dc331a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd96e645b-e3') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG os_vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:b6:fc,bridge_name='br-int',has_traffic_filtering=True,id=d96e645b-e317-4ac8-88b4-67e62a3c41b7,network=Network(99af4e0a-7f37-4fab-9dfb-ba79dc331a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd96e645b-e3') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-a1675278-ac21-4e99-a0b4-2993879313ce req-800ac828-d027-4296-8b79-70d0b32cf05b service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-19d60ebb-5100-4ba5-9fe7-d9b246e4971d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a1675278-ac21-4e99-a0b4-2993879313ce req-800ac828-d027-4296-8b79-70d0b32cf05b service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a1675278-ac21-4e99-a0b4-2993879313ce req-800ac828-d027-4296-8b79-70d0b32cf05b service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a1675278-ac21-4e99-a0b4-2993879313ce req-800ac828-d027-4296-8b79-70d0b32cf05b service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-a1675278-ac21-4e99-a0b4-2993879313ce req-800ac828-d027-4296-8b79-70d0b32cf05b service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-19d60ebb-5100-4ba5-9fe7-d9b246e4971d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:43 user nova-compute[75071]: WARNING nova.compute.manager [req-a1675278-ac21-4e99-a0b4-2993879313ce req-800ac828-d027-4296-8b79-70d0b32cf05b service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-19d60ebb-5100-4ba5-9fe7-d9b246e4971d for instance with vm_state active and task_state deleting.
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd96e645b-e3, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b779e1f1-3f3d-451f-9cd8-5ccc5366070a) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d94ab0ba-c749-4ba8-ab4b-a9c7e2b00f54) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:43 user nova-compute[75071]: INFO os_vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:67:06,bridge_name='br-int',has_traffic_filtering=True,id=34466bd1-f50e-4643-917f-512f81302b85,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap34466bd1-f5')
Dec 05 12:20:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:18:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:18:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "address": "fa:16:3e:57:d9:ae", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443a2f48-d7", "ovs_interfaceid": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "address": "fa:16:3e:57:d9:ae", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443a2f48-d7", "ovs_interfaceid": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:d9:ae,bridge_name='br-int',has_traffic_filtering=True,id=443a2f48-d7e4-4368-986d-53e5a9705d3e,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443a2f48-d7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG os_vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d9:ae,bridge_name='br-int',has_traffic_filtering=True,id=443a2f48-d7e4-4368-986d-53e5a9705d3e,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443a2f48-d7') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap443a2f48-d7, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: INFO os_vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:b6:fc,bridge_name='br-int',has_traffic_filtering=True,id=d96e645b-e317-4ac8-88b4-67e62a3c41b7,network=Network(99af4e0a-7f37-4fab-9dfb-ba79dc331a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd96e645b-e3')
Dec 05 12:20:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1934056873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1934056873',id=9,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3CbwdVkuWNPR21+Euz/6dPFNm6IXye5gSRyMaKG9Z9SmJRkWrIm3FxEnRvZlaNjfPqXRVTMGpNSRwLmdZ0F0i+dUsjzeeGRY263L/RywMUSp8vxVnp8YwZdVneRtAHWg==',key_name='tempest-keypair-1156115943',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:18:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14482277667040c3bc5c0ae2f89c4ed4',ramdisk_id='',reservation_id='r-38djjrqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-319921360',owner_user_name='tempest-TaggedBootDevicesTest_v242-319921360-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:18:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c12a1f3c2b3f46acaaf61809bb14ae22',uuid=58e955b6-be0c-41bc-9a39-4eeec3b694a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "address": "fa:16:3e:eb:4e:30", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eadd24f-48", "ovs_interfaceid": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converting VIF {"id": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "address": "fa:16:3e:eb:4e:30", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eadd24f-48", "ovs_interfaceid": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:4e:30,bridge_name='br-int',has_traffic_filtering=True,id=7eadd24f-487c-4d19-b5eb-7d9483bf1800,network=Network(99af4e0a-7f37-4fab-9dfb-ba79dc331a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eadd24f-48') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG os_vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:4e:30,bridge_name='br-int',has_traffic_filtering=True,id=7eadd24f-487c-4d19-b5eb-7d9483bf1800,network=Network(99af4e0a-7f37-4fab-9dfb-ba79dc331a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eadd24f-48') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7eadd24f-48, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ae1dcaa-6e34-498c-8052-e2456b7265a2) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=882b9441-04d5-4d0f-8498-ab3a0544ed31) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: INFO os_vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:d9:ae,bridge_name='br-int',has_traffic_filtering=True,id=443a2f48-d7e4-4368-986d-53e5a9705d3e,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap443a2f48-d7')
Dec 05 12:20:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:18:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:18:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "address": "fa:16:3e:51:c5:b6", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d60ebb-51", "ovs_interfaceid": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "address": "fa:16:3e:51:c5:b6", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d60ebb-51", "ovs_interfaceid": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:c5:b6,bridge_name='br-int',has_traffic_filtering=True,id=19d60ebb-5100-4ba5-9fe7-d9b246e4971d,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d60ebb-51') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG os_vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:c5:b6,bridge_name='br-int',has_traffic_filtering=True,id=19d60ebb-5100-4ba5-9fe7-d9b246e4971d,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d60ebb-51') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19d60ebb-51, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: INFO os_vif [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:4e:30,bridge_name='br-int',has_traffic_filtering=True,id=7eadd24f-487c-4d19-b5eb-7d9483bf1800,network=Network(99af4e0a-7f37-4fab-9dfb-ba79dc331a6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7eadd24f-48')
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VjykqYeG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:20:43 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:20:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe5636cc-dea2-4e06-9a2a-254ea0e111f8) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[47599c20-8045-488d-b4fc-982bfac962a8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:20:44 user nova-compute[75071]: No targets found.
Dec 05 12:20:44 user nova-compute[75071]: iSNS:
Dec 05 12:20:44 user nova-compute[75071]: No targets found.
Dec 05 12:20:44 user nova-compute[75071]: STATIC:
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: FIRMWARE:
Dec 05 12:20:44 user nova-compute[75071]: No targets found.
Dec 05 12:20:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:20:44 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:20:44 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:20:44 user nova-compute[75071]: INFO os_vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:c5:b6,bridge_name='br-int',has_traffic_filtering=True,id=19d60ebb-5100-4ba5-9fe7-d9b246e4971d,network=Network(f735d62c-8775-4fa3-a5eb-cdfb4e03b50b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d60ebb-51')
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:18:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:18:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "address": "fa:16:3e:e6:3a:a8", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5b1c1e-64", "ovs_interfaceid": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "address": "fa:16:3e:e6:3a:a8", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e5b1c1e-64", "ovs_interfaceid": "5e5b1c1e-64c1-4da4-ab47-d1afd13843ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:3a:a8,bridge_name='br-int',has_traffic_filtering=True,id=5e5b1c1e-64c1-4da4-ab47-d1afd13843ac,network=Network(f60d4f97-646c-4b6b-88d3-8096377d4dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5b1c1e-64') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:3a:a8,bridge_name='br-int',has_traffic_filtering=True,id=5e5b1c1e-64c1-4da4-ab47-d1afd13843ac,network=Network(f60d4f97-646c-4b6b-88d3-8096377d4dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5b1c1e-64') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e5b1c1e-64, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d18c89-57ad-4490-873e-0a8939060911]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ffc9d8ee-8489-47fb-b016-5d26a66874c6) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70137bf-e673-4dc5-8bfb-cc0d35d9db18]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8274283d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310'): ({'sdd'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Removing single pathed devices sdd {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: INFO os_vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:3a:a8,bridge_name='br-int',has_traffic_filtering=True,id=5e5b1c1e-64c1-4da4-ab47-d1afd13843ac,network=Network(f60d4f97-646c-4b6b-88d3-8096377d4dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e5b1c1e-64')
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1040881087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1040881087',id=10,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU3zEgQPYtB6GeLzLs8C8ImEkup6ga/vGy5RVvnMUDoy9Xi/ETXTOqB1XmzggL/xrhsaM3rwbt4I4MHEDlmj6q/wt3REpw++JLUL17/ymRMoN2FA2O/Uqb86fXjehFItA==',key_name='tempest-keypair-176753197',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:18:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9df1de3e82e4fcc801ea3a8dcb1455d',ramdisk_id='',reservation_id='r-c7h9lfit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2001589583',owner_user_name='tempest-TaggedBootDevicesTest-2001589583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:18:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='52bf9c24f2bb4bac8ac8a8918227708f',uuid=94aa75f8-6097-4cba-b567-112ec59efd8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "afa68989-e42f-4b32-b4d4-319a6290df7d", "address": "fa:16:3e:c6:0a:e2", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa68989-e4", "ovs_interfaceid": "afa68989-e42f-4b32-b4d4-319a6290df7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converting VIF {"id": "afa68989-e42f-4b32-b4d4-319a6290df7d", "address": "fa:16:3e:c6:0a:e2", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa68989-e4", "ovs_interfaceid": "afa68989-e42f-4b32-b4d4-319a6290df7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:0a:e2,bridge_name='br-int',has_traffic_filtering=True,id=afa68989-e42f-4b32-b4d4-319a6290df7d,network=Network(f60d4f97-646c-4b6b-88d3-8096377d4dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa68989-e4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:0a:e2,bridge_name='br-int',has_traffic_filtering=True,id=afa68989-e42f-4b32-b4d4-319a6290df7d,network=Network(f60d4f97-646c-4b6b-88d3-8096377d4dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa68989-e4') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafa68989-e4, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb24a895-46ca-47b1-903f-6bb0810d733e) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[27aa379f-9bd4-460e-b426-7fb987b26a43]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: INFO os_vif [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:0a:e2,bridge_name='br-int',has_traffic_filtering=True,id=afa68989-e42f-4b32-b4d4-319a6290df7d,network=Network(f60d4f97-646c-4b6b-88d3-8096377d4dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafa68989-e4')
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tUylKfSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:20:44 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1706d2d8-ab7f-4614-83fe-a495a9c1f14a]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Flushing IO for device /dev/sdd {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c4e395-72dc-4f56-a5e9-c4cbea46307c]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[969abe56-1964-4828-b8e4-32723bd36fc3]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[86be6407-a341-43a3-88f6-9b10b9e46fd0]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-plugged-7eadd24f-487c-4d19-b5eb-7d9483bf1800 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Acquiring lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] No waiting events found dispatching network-vif-plugged-7eadd24f-487c-4d19-b5eb-7d9483bf1800 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:44 user nova-compute[75071]: WARNING nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received unexpected event network-vif-plugged-7eadd24f-487c-4d19-b5eb-7d9483bf1800 for instance with vm_state active and task_state deleting.
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-unplugged-0d9f17d4-6b21-460d-9a8c-47270cf8a163 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-unplugged-0d9f17d4-6b21-460d-9a8c-47270cf8a163 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-unplugged-0d9f17d4-6b21-460d-9a8c-47270cf8a163 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-0d9f17d4-6b21-460d-9a8c-47270cf8a163 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-0d9f17d4-6b21-460d-9a8c-47270cf8a163 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:44 user nova-compute[75071]: WARNING nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-0d9f17d4-6b21-460d-9a8c-47270cf8a163 for instance with vm_state active and task_state deleting.
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-unplugged-a580be24-0d0f-4cf1-8abc-2b9514de0cbf {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-unplugged-a580be24-0d0f-4cf1-8abc-2b9514de0cbf {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-unplugged-a580be24-0d0f-4cf1-8abc-2b9514de0cbf for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-a580be24-0d0f-4cf1-8abc-2b9514de0cbf {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-a580be24-0d0f-4cf1-8abc-2b9514de0cbf {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:44 user nova-compute[75071]: WARNING nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-a580be24-0d0f-4cf1-8abc-2b9514de0cbf for instance with vm_state active and task_state deleting.
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-unplugged-34466bd1-f50e-4643-917f-512f81302b85 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-unplugged-34466bd1-f50e-4643-917f-512f81302b85 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-unplugged-34466bd1-f50e-4643-917f-512f81302b85 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-34466bd1-f50e-4643-917f-512f81302b85 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-34466bd1-f50e-4643-917f-512f81302b85 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:44 user nova-compute[75071]: WARNING nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-34466bd1-f50e-4643-917f-512f81302b85 for instance with vm_state active and task_state deleting.
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-unplugged-443a2f48-d7e4-4368-986d-53e5a9705d3e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-unplugged-443a2f48-d7e4-4368-986d-53e5a9705d3e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-unplugged-443a2f48-d7e4-4368-986d-53e5a9705d3e for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-443a2f48-d7e4-4368-986d-53e5a9705d3e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-443a2f48-d7e4-4368-986d-53e5a9705d3e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:44 user nova-compute[75071]: WARNING nova.compute.manager [req-ec8e3404-fb43-4ac8-872f-c75703ad395c req-8fcb211b-92a1-445e-a20b-6cd684b722ca service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-443a2f48-d7e4-4368-986d-53e5a9705d3e for instance with vm_state active and task_state deleting.
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[854ffbab-f927-49a0-a0ee-e267e0acb95f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310, portal: 172.16.0.220,3260]
Dec 05 12:20:44 user nova-compute[75071]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310, portal: 172.16.0.220,3260] successful.
Dec 05 12:20:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04025a-0b32-47ab-ab5a-75a8bd43a310 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc97bdd-222d-4fe6-895e-738378b8591e]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] <== disconnect_volume: return (458ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.280s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tQdKTCuW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:20:44 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7161f5b8-e68b-44f8-aeb2-0384547112bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:20:44 user nova-compute[75071]: No targets found.
Dec 05 12:20:44 user nova-compute[75071]: iSNS:
Dec 05 12:20:44 user nova-compute[75071]: No targets found.
Dec 05 12:20:44 user nova-compute[75071]: STATIC:
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: FIRMWARE:
Dec 05 12:20:44 user nova-compute[75071]: No targets found.
Dec 05 12:20:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:20:44 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:20:44 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[928e880d-6112-476f-b208-058155aa28b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5c581d-d2c4-4d3d-854e-3c0356aa941f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:20:44 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8264777010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5c71a7-0b66-45f2-bb3f-6dc776a44b12]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae8b214-e756-4758-8d17-86d0e9898a6b]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ab00e2-58ec-435f-aacb-ea0ed49e926b]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.077s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[267bb324-1c26-4aa7-a077-2823df1e08ab]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2c6860-e042-424b-8021-8e255100ba99]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[19252b5e-d2ed-4c3e-ada8-d8c2819166d8]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e, portal: 172.16.0.220,3260]
Dec 05 12:20:44 user nova-compute[75071]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e, portal: 172.16.0.220,3260] successful.
Dec 05 12:20:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68062df8-0269-41ba-90ac-c150b267890e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[911a127f-1e8d-436e-9929-4448b39fab9f]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.522s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] <== disconnect_volume: return (802ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.521s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kpWQFyAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:20:44 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ccb946-5c8f-4bbd-901b-83edaa81e8b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:20:44 user nova-compute[75071]: No targets found.
Dec 05 12:20:44 user nova-compute[75071]: iSNS:
Dec 05 12:20:44 user nova-compute[75071]: No targets found.
Dec 05 12:20:44 user nova-compute[75071]: STATIC:
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6
Dec 05 12:20:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:44 user nova-compute[75071]: FIRMWARE:
Dec 05 12:20:44 user nova-compute[75071]: No targets found.
Dec 05 12:20:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:20:44 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:20:44 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:20:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1009f377-c3dc-4c7d-ab77-ae55c8aa86ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[26508e0c-08fe-448b-b5e7-614098b1624e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:45 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:20:45 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:20:45 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:45 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:20:45 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:45 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:45 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:20:45 user nova-compute[75071]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b (non-flash)
Dec 05 12:20:45 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:45 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:20:45 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:45 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8264777010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b'): ({'sdf'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Removing single pathed devices sdf {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e71010f-cbf4-4d0b-a0f8-8d00e4953410]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[42df3ec9-2689-4eea-985f-69d4b232ab40]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Flushing IO for device /dev/sdf {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0e2c6f-c8d6-4e21-9772-455556b96cbc]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d415102-2c2e-4cd0-b6a8-3ddbe74976b8]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.048s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[34362a5a-1e42-4240-99d1-1d25bd9ed0e2]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e0ee75-fda8-4b89-9675-3a4129b9e058]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b, portal: 172.16.0.220,3260]
Dec 05 12:20:45 user nova-compute[75071]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b, portal: 172.16.0.220,3260] successful.
Dec 05 12:20:45 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4a92957-3718-450a-a2d7-c2057464b97b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcfb748-ab3b-4f04-81e2-6a71c2e25e9f]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] <== disconnect_volume: return (964ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.441s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcWIyLFk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:20:45 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[87551229-acc4-426b-970b-90749b3ebedc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:20:45 user nova-compute[75071]: No targets found.
Dec 05 12:20:45 user nova-compute[75071]: iSNS:
Dec 05 12:20:45 user nova-compute[75071]: No targets found.
Dec 05 12:20:45 user nova-compute[75071]: STATIC:
Dec 05 12:20:45 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c
Dec 05 12:20:45 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:45 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:45 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a
Dec 05 12:20:45 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:45 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:45 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665
Dec 05 12:20:45 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:45 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:45 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95
Dec 05 12:20:45 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:45 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:45 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6
Dec 05 12:20:45 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:45 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:45 user nova-compute[75071]: FIRMWARE:
Dec 05 12:20:45 user nova-compute[75071]: No targets found.
Dec 05 12:20:45 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:20:45 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:20:45 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daf0a67-6433-4426-b587-00e093e4203a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5111b9-85ec-4f73-977e-815b6959d239]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:45 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:20:45 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:45 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:20:45 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:45 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:45 user nova-compute[75071]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 (non-flash)
Dec 05 12:20:45 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:45 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:20:45 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:45 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f827410ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6'): ({'sde'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Removing single pathed devices sde {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a7378f-e9c0-4dab-b4ca-07a4c2ebd918]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[452132ca-f998-4499-ad17-deb136de45cd]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Flushing IO for device /dev/sde {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb14b72-f555-43e0-8c3c-f9abf61fee9d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cf7c21-87de-4518-aeab-491e7f9626e1]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.081s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[447c0838-8521-4340-aa5c-109be93544d6]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c2aba5-911e-4a17-8a28-6cf6ffbcdb20]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6, portal: 172.16.0.220,3260]
Dec 05 12:20:45 user nova-compute[75071]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6, portal: 172.16.0.220,3260] successful.
Dec 05 12:20:45 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33ff0db5-7a52-4c1f-80cd-63bc8c746bc6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97b5cbc-c7a9-4072-95aa-c9eca2a72029]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.450s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] <== disconnect_volume: return (891ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.437s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:20:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.046s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[29321405-989a-4a96-acfe-0c03bc69f40b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:20:46 user nova-compute[75071]: No targets found.
Dec 05 12:20:46 user nova-compute[75071]: iSNS:
Dec 05 12:20:46 user nova-compute[75071]: No targets found.
Dec 05 12:20:46 user nova-compute[75071]: STATIC:
Dec 05 12:20:46 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c
Dec 05 12:20:46 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:46 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:46 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a
Dec 05 12:20:46 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:46 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:46 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665
Dec 05 12:20:46 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:46 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:46 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95
Dec 05 12:20:46 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:46 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:46 user nova-compute[75071]: FIRMWARE:
Dec 05 12:20:46 user nova-compute[75071]: No targets found.
Dec 05 12:20:46 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:20:46 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:20:46 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-unplugged-5e5b1c1e-64c1-4da4-ab47-d1afd13843ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-unplugged-5e5b1c1e-64c1-4da4-ab47-d1afd13843ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-unplugged-5e5b1c1e-64c1-4da4-ab47-d1afd13843ac for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-5e5b1c1e-64c1-4da4-ab47-d1afd13843ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-5e5b1c1e-64c1-4da4-ab47-d1afd13843ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:46 user nova-compute[75071]: WARNING nova.compute.manager [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-5e5b1c1e-64c1-4da4-ab47-d1afd13843ac for instance with vm_state active and task_state deleting.
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-unplugged-afa68989-e42f-4b32-b4d4-319a6290df7d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-unplugged-afa68989-e42f-4b32-b4d4-319a6290df7d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-unplugged-afa68989-e42f-4b32-b4d4-319a6290df7d for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-plugged-afa68989-e42f-4b32-b4d4-319a6290df7d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] Acquiring lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] No waiting events found dispatching network-vif-plugged-afa68989-e42f-4b32-b4d4-319a6290df7d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:46 user nova-compute[75071]: WARNING nova.compute.manager [req-6bc58dac-d494-46f8-b35a-dc6f02066036 req-557948b8-5fe3-42c5-9382-fcc7c7c6c14b service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received unexpected event network-vif-plugged-afa68989-e42f-4b32-b4d4-319a6290df7d for instance with vm_state active and task_state deleting.
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIumDFar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:20:46 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02f3af4-8fc1-422e-ad60-7f8eeceadcb6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:46 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:20:46 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=7545MB free_disk=25.417503356933594GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[531c7f73-3294-4ba7-aa6b-5b9354272965]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:46 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:46 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:20:46 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:46 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:46 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:46 user nova-compute[75071]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a (non-flash)
Dec 05 12:20:46 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:46 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82641440d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a'): ({'sdh'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Removing single pathed devices sdh {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d27f15d-46e1-4aca-95b2-92d4afef714c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6180a92-1bca-4868-828a-fec9989d6c26]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Flushing IO for device /dev/sdh {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa87ac81-57e6-48cb-b1f6-4de41beb37be]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.085s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[688d0f1d-fc63-4307-b522-2d4247aa6ee5]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] SCSI volumes sdh have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[239ae697-8d7b-4f5b-94f5-5ab066ec30d2]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 81333acc-8dc7-42f1-9026-e42a30e52a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e08be776-0fa9-4871-86eb-2093530c00f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 854ee980-5c0b-4c4f-b9fd-609720e693be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 2625dd24-5c50-4911-9515-57c9483bafa1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c9e37746-57e8-4053-9f52-2c60bab457fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 58e955b6-be0c-41bc-9a39-4eeec3b694a1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 94aa75f8-6097-4cba-b567-112ec59efd8f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 46d74901-9224-4575-956b-de5c92580f8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 62efa94c-ae01-48aa-b3d3-0d23d159801c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 12b75ed0-0ac3-4d19-bc01-c4ab10fff348 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2544901b-e060-47e1-89df-441edae1749d]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a, portal: 172.16.0.220,3260]
Dec 05 12:20:46 user nova-compute[75071]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a, portal: 172.16.0.220,3260] successful.
Dec 05 12:20:46 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d04d142d-8f9a-4914-a89c-e2640edd770a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c8de0a-d036-4eaf-acd4-5eb2b1610db4]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] <== disconnect_volume: return (1438ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:20:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Deleting instance files /opt/stack/data/nova/instances/58e955b6-be0c-41bc-9a39-4eeec3b694a1_del
Dec 05 12:20:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Deletion of /opt/stack/data/nova/instances/58e955b6-be0c-41bc-9a39-4eeec3b694a1_del complete
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.379s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5595a854-60a2-4d3e-9ab9-292c55980a3d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:20:46 user nova-compute[75071]: No targets found.
Dec 05 12:20:46 user nova-compute[75071]: iSNS:
Dec 05 12:20:46 user nova-compute[75071]: No targets found.
Dec 05 12:20:46 user nova-compute[75071]: STATIC:
Dec 05 12:20:46 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c
Dec 05 12:20:46 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:46 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:46 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665
Dec 05 12:20:46 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:46 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:46 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95
Dec 05 12:20:46 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:20:46 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:20:46 user nova-compute[75071]: FIRMWARE:
Dec 05 12:20:46 user nova-compute[75071]: No targets found.
Dec 05 12:20:46 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:20:46 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:20:46 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[27026efa-87ef-4632-ab83-72fe5fb4533b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[83eed147-457e-4187-bc71-7df1f9078013]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:46 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:46 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:46 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:46 user nova-compute[75071]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 (non-flash)
Dec 05 12:20:46 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:46 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f827410eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95'): ({'sdg'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Removing single pathed devices sdg {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:46 user nova-compute[75071]: INFO nova.compute.manager [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Took 8.32 seconds to destroy the instance on the hypervisor.
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[09656dd3-5303-4bc8-ac9d-e627b94c414a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0296683-7869-4b86-b77e-6400253c5c96]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Flushing IO for device /dev/sdg {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bf2928-dc9d-4d32-bedf-7f82bf3ec58d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[762ee37f-0f77-4092-ab41-dc2d3193f26e]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] SCSI volumes sdg have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4c371a-6f93-41f7-932e-4c59c47b24e7]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.635s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac4f522-5547-4650-a30f-7815a9f12980]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95, portal: 172.16.0.220,3260]
Dec 05 12:20:47 user nova-compute[75071]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95, portal: 172.16.0.220,3260] successful.
Dec 05 12:20:47 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:868d4f51-285b-40ec-bcae-16f761d6bd95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9103f322-1220-417d-9789-199175766149]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] <== disconnect_volume: return (721ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:20:47 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Deleting instance files /opt/stack/data/nova/instances/94aa75f8-6097-4cba-b567-112ec59efd8f_del
Dec 05 12:20:47 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Deletion of /opt/stack/data/nova/instances/94aa75f8-6097-4cba-b567-112ec59efd8f_del complete
Dec 05 12:20:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:47 user nova-compute[75071]: INFO nova.compute.manager [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Took 7.04 seconds to destroy the instance on the hypervisor.
Dec 05 12:20:47 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:20:47 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:20:48 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:20:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:20:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-854ee980-5c0b-4c4f-b9fd-609720e693be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:20:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-854ee980-5c0b-4c4f-b9fd-609720e693be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:20:48 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:20:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:49 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Updating instance_info_cache with network_info: [{"id": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "address": "fa:16:3e:85:5c:09", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc3d793-a2", "ovs_interfaceid": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:20:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-854ee980-5c0b-4c4f-b9fd-609720e693be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:20:49 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:20:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:20:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:20:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:20:49 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:20:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-f7a4463f-250a-4a1f-8254-c41b2101020d req-fda27f43-a650-4513-8642-c836c55a242c service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-deleted-d96e645b-e317-4ac8-88b4-67e62a3c41b7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:50 user nova-compute[75071]: INFO nova.compute.manager [req-f7a4463f-250a-4a1f-8254-c41b2101020d req-fda27f43-a650-4513-8642-c836c55a242c service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Neutron deleted interface d96e645b-e317-4ac8-88b4-67e62a3c41b7; detaching it from the instance and deleting it from the info cache
Dec 05 12:20:50 user nova-compute[75071]: DEBUG nova.network.neutron [req-f7a4463f-250a-4a1f-8254-c41b2101020d req-fda27f43-a650-4513-8642-c836c55a242c service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Updating instance_info_cache with network_info: [{"id": "21361178-8b0b-43fb-9381-37e603f8d993", "address": "fa:16:3e:86:db:af", "network": {"id": "150ec31a-5cc2-485a-8ed6-07bd26173225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-441693172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21361178-8b", "ovs_interfaceid": "21361178-8b0b-43fb-9381-37e603f8d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc837761-a388-414b-9c08-8835b4e255c7", "address": "fa:16:3e:bd:f8:40", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc837761-a3", "ovs_interfaceid": "cc837761-a388-414b-9c08-8835b4e255c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "deb82347-819f-40f5-bc84-b1562c29af71", "address": "fa:16:3e:16:d6:e0", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb82347-81", "ovs_interfaceid": "deb82347-819f-40f5-bc84-b1562c29af71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "30d569c6-052c-487b-99d8-142bed67ae7e", "address": "fa:16:3e:8f:44:7e", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d569c6-05", "ovs_interfaceid": "30d569c6-052c-487b-99d8-142bed67ae7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "address": "fa:16:3e:3f:fb:3b", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c5a6d6-90", "ovs_interfaceid": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "address": "fa:16:3e:eb:4e:30", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eadd24f-48", "ovs_interfaceid": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:20:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-f7a4463f-250a-4a1f-8254-c41b2101020d req-fda27f43-a650-4513-8642-c836c55a242c service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Detach interface failed, port_id=d96e645b-e317-4ac8-88b4-67e62a3c41b7, reason: Instance 58e955b6-be0c-41bc-9a39-4eeec3b694a1 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:20:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-deleted-5e5b1c1e-64c1-4da4-ab47-d1afd13843ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:52 user nova-compute[75071]: INFO nova.compute.manager [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Neutron deleted interface 5e5b1c1e-64c1-4da4-ab47-d1afd13843ac; detaching it from the instance and deleting it from the info cache
Dec 05 12:20:52 user nova-compute[75071]: DEBUG nova.network.neutron [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Updating instance_info_cache with network_info: [{"id": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "address": "fa:16:3e:71:02:8a", "network": {"id": "f50e74cc-b2a2-4c93-ba7d-b11c02b457f2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2077462928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9f17d4-6b", "ovs_interfaceid": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "address": "fa:16:3e:02:bc:64", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa580be24-0d", "ovs_interfaceid": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34466bd1-f50e-4643-917f-512f81302b85", "address": "fa:16:3e:03:67:06", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34466bd1-f5", "ovs_interfaceid": "34466bd1-f50e-4643-917f-512f81302b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "address": "fa:16:3e:57:d9:ae", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443a2f48-d7", "ovs_interfaceid": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "address": "fa:16:3e:51:c5:b6", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d60ebb-51", "ovs_interfaceid": "19d60ebb-5100-4ba5-9fe7-d9b246e4971d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "afa68989-e42f-4b32-b4d4-319a6290df7d", "address": "fa:16:3e:c6:0a:e2", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa68989-e4", "ovs_interfaceid": "afa68989-e42f-4b32-b4d4-319a6290df7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:20:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Detach interface failed, port_id=5e5b1c1e-64c1-4da4-ab47-d1afd13843ac, reason: Instance 94aa75f8-6097-4cba-b567-112ec59efd8f could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:20:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-deleted-30d569c6-052c-487b-99d8-142bed67ae7e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:52 user nova-compute[75071]: INFO nova.compute.manager [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Neutron deleted interface 30d569c6-052c-487b-99d8-142bed67ae7e; detaching it from the instance and deleting it from the info cache
Dec 05 12:20:52 user nova-compute[75071]: DEBUG nova.network.neutron [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Updating instance_info_cache with network_info: [{"id": "21361178-8b0b-43fb-9381-37e603f8d993", "address": "fa:16:3e:86:db:af", "network": {"id": "150ec31a-5cc2-485a-8ed6-07bd26173225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-441693172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21361178-8b", "ovs_interfaceid": "21361178-8b0b-43fb-9381-37e603f8d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc837761-a388-414b-9c08-8835b4e255c7", "address": "fa:16:3e:bd:f8:40", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc837761-a3", "ovs_interfaceid": "cc837761-a388-414b-9c08-8835b4e255c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "deb82347-819f-40f5-bc84-b1562c29af71", "address": "fa:16:3e:16:d6:e0", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb82347-81", "ovs_interfaceid": "deb82347-819f-40f5-bc84-b1562c29af71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "address": "fa:16:3e:3f:fb:3b", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c5a6d6-90", "ovs_interfaceid": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "address": "fa:16:3e:eb:4e:30", "network": {"id": "99af4e0a-7f37-4fab-9dfb-ba79dc331a6d", "bridge": "br-int", "label": "tempest-device-tagging-net2-161754094", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7eadd24f-48", "ovs_interfaceid": "7eadd24f-487c-4d19-b5eb-7d9483bf1800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:20:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Detach interface failed, port_id=30d569c6-052c-487b-99d8-142bed67ae7e, reason: Instance 58e955b6-be0c-41bc-9a39-4eeec3b694a1 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:20:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-deleted-19d60ebb-5100-4ba5-9fe7-d9b246e4971d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:52 user nova-compute[75071]: INFO nova.compute.manager [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Neutron deleted interface 19d60ebb-5100-4ba5-9fe7-d9b246e4971d; detaching it from the instance and deleting it from the info cache
Dec 05 12:20:52 user nova-compute[75071]: DEBUG nova.network.neutron [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Updating instance_info_cache with network_info: [{"id": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "address": "fa:16:3e:71:02:8a", "network": {"id": "f50e74cc-b2a2-4c93-ba7d-b11c02b457f2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2077462928-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9f17d4-6b", "ovs_interfaceid": "0d9f17d4-6b21-460d-9a8c-47270cf8a163", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "address": "fa:16:3e:02:bc:64", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa580be24-0d", "ovs_interfaceid": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34466bd1-f50e-4643-917f-512f81302b85", "address": "fa:16:3e:03:67:06", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34466bd1-f5", "ovs_interfaceid": "34466bd1-f50e-4643-917f-512f81302b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "address": "fa:16:3e:57:d9:ae", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443a2f48-d7", "ovs_interfaceid": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "afa68989-e42f-4b32-b4d4-319a6290df7d", "address": "fa:16:3e:c6:0a:e2", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa68989-e4", "ovs_interfaceid": "afa68989-e42f-4b32-b4d4-319a6290df7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:20:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Detach interface failed, port_id=19d60ebb-5100-4ba5-9fe7-d9b246e4971d, reason: Instance 94aa75f8-6097-4cba-b567-112ec59efd8f could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:20:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-deleted-7eadd24f-487c-4d19-b5eb-7d9483bf1800 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:52 user nova-compute[75071]: INFO nova.compute.manager [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Neutron deleted interface 7eadd24f-487c-4d19-b5eb-7d9483bf1800; detaching it from the instance and deleting it from the info cache
Dec 05 12:20:52 user nova-compute[75071]: DEBUG nova.network.neutron [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Updating instance_info_cache with network_info: [{"id": "21361178-8b0b-43fb-9381-37e603f8d993", "address": "fa:16:3e:86:db:af", "network": {"id": "150ec31a-5cc2-485a-8ed6-07bd26173225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-441693172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21361178-8b", "ovs_interfaceid": "21361178-8b0b-43fb-9381-37e603f8d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc837761-a388-414b-9c08-8835b4e255c7", "address": "fa:16:3e:bd:f8:40", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc837761-a3", "ovs_interfaceid": "cc837761-a388-414b-9c08-8835b4e255c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "deb82347-819f-40f5-bc84-b1562c29af71", "address": "fa:16:3e:16:d6:e0", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb82347-81", "ovs_interfaceid": "deb82347-819f-40f5-bc84-b1562c29af71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "address": "fa:16:3e:3f:fb:3b", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26c5a6d6-90", "ovs_interfaceid": "26c5a6d6-9037-490d-b40b-8e0c5bb16d0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:20:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Detach interface failed, port_id=7eadd24f-487c-4d19-b5eb-7d9483bf1800, reason: Instance 58e955b6-be0c-41bc-9a39-4eeec3b694a1 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:20:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-deleted-26c5a6d6-9037-490d-b40b-8e0c5bb16d0b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:52 user nova-compute[75071]: INFO nova.compute.manager [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Neutron deleted interface 26c5a6d6-9037-490d-b40b-8e0c5bb16d0b; detaching it from the instance and deleting it from the info cache
Dec 05 12:20:52 user nova-compute[75071]: DEBUG nova.network.neutron [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Updating instance_info_cache with network_info: [{"id": "21361178-8b0b-43fb-9381-37e603f8d993", "address": "fa:16:3e:86:db:af", "network": {"id": "150ec31a-5cc2-485a-8ed6-07bd26173225", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-441693172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21361178-8b", "ovs_interfaceid": "21361178-8b0b-43fb-9381-37e603f8d993", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cc837761-a388-414b-9c08-8835b4e255c7", "address": "fa:16:3e:bd:f8:40", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc837761-a3", "ovs_interfaceid": "cc837761-a388-414b-9c08-8835b4e255c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "deb82347-819f-40f5-bc84-b1562c29af71", "address": "fa:16:3e:16:d6:e0", "network": {"id": "ddb35b54-8349-49d2-b736-0ec26a71f912", "bridge": "br-int", "label": "tempest-device-tagging-net1-1993780461", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14482277667040c3bc5c0ae2f89c4ed4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdeb82347-81", "ovs_interfaceid": "deb82347-819f-40f5-bc84-b1562c29af71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:20:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Detach interface failed, port_id=26c5a6d6-9037-490d-b40b-8e0c5bb16d0b, reason: Instance 58e955b6-be0c-41bc-9a39-4eeec3b694a1 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:20:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-deleted-0d9f17d4-6b21-460d-9a8c-47270cf8a163 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:52 user nova-compute[75071]: INFO nova.compute.manager [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Neutron deleted interface 0d9f17d4-6b21-460d-9a8c-47270cf8a163; detaching it from the instance and deleting it from the info cache
Dec 05 12:20:52 user nova-compute[75071]: DEBUG nova.network.neutron [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Updating instance_info_cache with network_info: [{"id": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "address": "fa:16:3e:02:bc:64", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa580be24-0d", "ovs_interfaceid": "a580be24-0d0f-4cf1-8abc-2b9514de0cbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "34466bd1-f50e-4643-917f-512f81302b85", "address": "fa:16:3e:03:67:06", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34466bd1-f5", "ovs_interfaceid": "34466bd1-f50e-4643-917f-512f81302b85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "address": "fa:16:3e:57:d9:ae", "network": {"id": "f735d62c-8775-4fa3-a5eb-cdfb4e03b50b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1329649094", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.242", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap443a2f48-d7", "ovs_interfaceid": "443a2f48-d7e4-4368-986d-53e5a9705d3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "afa68989-e42f-4b32-b4d4-319a6290df7d", "address": "fa:16:3e:c6:0a:e2", "network": {"id": "f60d4f97-646c-4b6b-88d3-8096377d4dcb", "bridge": "br-int", "label": "tempest-device-tagging-net2-232542259", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d9df1de3e82e4fcc801ea3a8dcb1455d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafa68989-e4", "ovs_interfaceid": "afa68989-e42f-4b32-b4d4-319a6290df7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:20:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-0fad040e-f7ce-46a5-991d-a90be46a2223 req-2db50608-f724-48fd-a682-9d9f1a413b8a service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Detach interface failed, port_id=0d9f17d4-6b21-460d-9a8c-47270cf8a163, reason: Instance 94aa75f8-6097-4cba-b567-112ec59efd8f could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:20:52 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:20:52 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Took 5.85 seconds to deallocate network for instance.
Dec 05 12:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:20:53 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Took 5.99 seconds to deallocate network for instance.
Dec 05 12:20:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oAHbNekR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:20:53 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:20:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:20:53 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:20:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:20:53 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cfcc94-1dc4-45db-b08a-10b41eef233f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:20:53 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f7426a-0666-4e60-875e-06693f94b78a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219] added
Dec 05 12:20:53 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4789965-75e5-437d-8610-bf9aae0828ee]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e497f72b-d854-494c-9e47-691340f0e1dd]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oAHbNekR {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oAHbNekR" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8d379b-2f83-4665-bdd5-3f5c35e7267e]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oAHbNekR'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43e20aa-b819-4382-9247-feea5d815d19]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1691f14-21d7-4e58-80d1-f1feec8fe8bb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:54 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:54 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c7b7db-d992-48c6-b6ca-9ff5fded4990]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219, portal: 172.16.0.220,3260]
Dec 05 12:20:54 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219, portal: 172.16.0.220,3260] successful.
Dec 05 12:20:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[37142a52-fa51-46ed-a086-6c0b03a192b7]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8378c4-5a90-470e-b624-64f9d29ae190]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:54 user nova-compute[75071]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:20:54 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:20:54 user nova-compute[75071]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:20:54 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:20:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d642bae-ca7d-4bab-a7c6-e7bf6f811c7f]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-52213d05-25b2-455f-bdb7-3f3f1fc61493 req-c5ceeb07-e091-450d-9f7b-a93691a59f21 service nova] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Received event network-vif-deleted-21361178-8b0b-43fb-9381-37e603f8d993 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-52213d05-25b2-455f-bdb7-3f3f1fc61493 req-c5ceeb07-e091-450d-9f7b-a93691a59f21 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-deleted-afa68989-e42f-4b32-b4d4-319a6290df7d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-52213d05-25b2-455f-bdb7-3f3f1fc61493 req-c5ceeb07-e091-450d-9f7b-a93691a59f21 service nova] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Received event network-vif-deleted-443a2f48-d7e4-4368-986d-53e5a9705d3e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oAHbNekR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:20:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23139333634626138', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:20:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139333634626138', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:20:55 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lazy-loading 'flavor' on Instance uuid e0c82eba-8448-4780-b92d-62d7c60ec7ef {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:20:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:20:55 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:20:55 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Dec 05 12:20:55 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:20:55 user nova-compute[75071]:   <serial>f4aad4b4-ae4a-421e-9dce-491dbd59a219</serial>
Dec 05 12:20:55 user nova-compute[75071]: </disk>
Dec 05 12:20:55 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:20:55 user nova-compute[75071]: INFO nova.compute.manager [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] [instance: 58e955b6-be0c-41bc-9a39-4eeec3b694a1] Took 2.80 seconds to detach 3 volumes for instance.
Dec 05 12:20:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:20:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:20:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] No VIF found with MAC fa:16:3e:65:08:02, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f0134b96-6ed6-4960-95f9-88061b24ed28 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.332s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:56 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:20:56 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:56 user nova-compute[75071]: INFO nova.compute.manager [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] [instance: 94aa75f8-6097-4cba-b567-112ec59efd8f] Took 2.83 seconds to detach 3 volumes for instance.
Dec 05 12:20:56 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Deleted allocations for instance 58e955b6-be0c-41bc-9a39-4eeec3b694a1
Dec 05 12:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f67c0b2b-d004-43c5-ace6-054297dd845e tempest-TaggedBootDevicesTest_v242-319921360 tempest-TaggedBootDevicesTest_v242-319921360-project-member] Lock "58e955b6-be0c-41bc-9a39-4eeec3b694a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.593s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:56 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:20:56 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:56 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Deleted allocations for instance 94aa75f8-6097-4cba-b567-112ec59efd8f
Dec 05 12:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-15dcc913-019a-461d-8be0-afef6c278cb7 tempest-TaggedBootDevicesTest-2001589583 tempest-TaggedBootDevicesTest-2001589583-project-member] Lock "94aa75f8-6097-4cba-b567-112ec59efd8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.477s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:56 user nova-compute[75071]: INFO nova.compute.manager [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Rescuing
Dec 05 12:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:20:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquired lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:20:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:20:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updating instance_info_cache with network_info: [{"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:20:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Releasing lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:20:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Acquiring lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:20:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:20:57 user nova-compute[75071]: INFO nova.compute.claims [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Claim successful on node user
Dec 05 12:20:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Acquiring lock "2625dd24-5c50-4911-9515-57c9483bafa1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "2625dd24-5c50-4911-9515-57c9483bafa1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Acquiring lock "2625dd24-5c50-4911-9515-57c9483bafa1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "2625dd24-5c50-4911-9515-57c9483bafa1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "2625dd24-5c50-4911-9515-57c9483bafa1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:57 user nova-compute[75071]: INFO nova.compute.manager [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Terminating instance
Dec 05 12:20:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:20:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Instance destroyed successfully.
Dec 05 12:20:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Attempting a stable device rescue
Dec 05 12:20:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75071) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Instance directory exists: not creating {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 05 12:20:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Creating image(s)
Dec 05 12:20:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "/opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "/opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lazy-loading 'trusted_certs' on Instance uuid e0c82eba-8448-4780-b92d-62d7c60ec7ef {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:20:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:20:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "d5f3fb99c27e4a4ef08367348f4ce741dacc741f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "d5f3fb99c27e4a4ef08367348f4ce741dacc741f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG nova.policy [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8329e945f94544ef849d35de4726bad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '896fedb155fd4942baf7dd1b9b074eba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:20:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Creating image(s)
Dec 05 12:20:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Acquiring lock "/opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "/opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "/opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-b45bc97c-5021-4312-91e8-4054d3f66787 req-851717e8-d689-4176-96d9-071b9f926e30 service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Received event network-vif-unplugged-eb24fe21-798a-4e87-97e8-5e355a77257f {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b45bc97c-5021-4312-91e8-4054d3f66787 req-851717e8-d689-4176-96d9-071b9f926e30 service nova] Acquiring lock "2625dd24-5c50-4911-9515-57c9483bafa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b45bc97c-5021-4312-91e8-4054d3f66787 req-851717e8-d689-4176-96d9-071b9f926e30 service nova] Lock "2625dd24-5c50-4911-9515-57c9483bafa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b45bc97c-5021-4312-91e8-4054d3f66787 req-851717e8-d689-4176-96d9-071b9f926e30 service nova] Lock "2625dd24-5c50-4911-9515-57c9483bafa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-b45bc97c-5021-4312-91e8-4054d3f66787 req-851717e8-d689-4176-96d9-071b9f926e30 service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] No waiting events found dispatching network-vif-unplugged-eb24fe21-798a-4e87-97e8-5e355a77257f {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:20:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-b45bc97c-5021-4312-91e8-4054d3f66787 req-851717e8-d689-4176-96d9-071b9f926e30 service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Received event network-vif-unplugged-eb24fe21-798a-4e87-97e8-5e355a77257f for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5f3fb99c27e4a4ef08367348f4ce741dacc741f.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG nova.network.neutron [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Successfully created port: 50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 1.077s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Instance destroyed successfully.
Dec 05 12:20:59 user nova-compute[75071]: DEBUG nova.objects.instance [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lazy-loading 'resources' on Instance uuid 2625dd24-5c50-4911-9515-57c9483bafa1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1988255748',display_name='tempest-TestVolumeSwap-server-1988255748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1988255748',id=6,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtOA9OUhUuqttZPGvfQDytd9iTTbijprV8hnKNlNGmLZ30Exux+N8/w/h/zwzC0tq40rF0VQxCTGLUGEUfISJHD0owINVPsy9mUGuaoIDiavYhpFQF8xVgbrGAC1EuhdQ==',key_name='tempest-keypair-391523231',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:17:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='522698b61d514357b9ea490cbfa828ad',ramdisk_id='',reservation_id='r-vgdjic1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-583774926',owner_user_name='tempest-TestVolumeSwap-583774926-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:17:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7532107e512b448e919f08713d60f84f',uuid=2625dd24-5c50-4911-9515-57c9483bafa1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb24fe21-798a-4e87-97e8-5e355a77257f", "address": "fa:16:3e:fd:56:66", "network": {"id": "466db5e3-5c09-4319-9cee-3b0c44e1c718", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1639720127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "522698b61d514357b9ea490cbfa828ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb24fe21-79", "ovs_interfaceid": "eb24fe21-798a-4e87-97e8-5e355a77257f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Converting VIF {"id": "eb24fe21-798a-4e87-97e8-5e355a77257f", "address": "fa:16:3e:fd:56:66", "network": {"id": "466db5e3-5c09-4319-9cee-3b0c44e1c718", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1639720127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "522698b61d514357b9ea490cbfa828ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb24fe21-79", "ovs_interfaceid": "eb24fe21-798a-4e87-97e8-5e355a77257f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:56:66,bridge_name='br-int',has_traffic_filtering=True,id=eb24fe21-798a-4e87-97e8-5e355a77257f,network=Network(466db5e3-5c09-4319-9cee-3b0c44e1c718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb24fe21-79') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG os_vif [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:56:66,bridge_name='br-int',has_traffic_filtering=True,id=eb24fe21-798a-4e87-97e8-5e355a77257f,network=Network(466db5e3-5c09-4319-9cee-3b0c44e1c718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb24fe21-79') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb24fe21-79, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f2b1b2c-8dad-4602-81f4-54100815abf5) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:20:59 user nova-compute[75071]: INFO os_vif [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:56:66,bridge_name='br-int',has_traffic_filtering=True,id=eb24fe21-798a-4e87-97e8-5e355a77257f,network=Network(466db5e3-5c09-4319-9cee-3b0c44e1c718),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb24fe21-79')
Dec 05 12:20:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Deleting instance files /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1_del
Dec 05 12:20:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Deletion of /opt/stack/data/nova/instances/2625dd24-5c50-4911-9515-57c9483bafa1_del complete
Dec 05 12:20:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5f3fb99c27e4a4ef08367348f4ce741dacc741f.part --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG nova.virt.images [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] 1ecc19fa-f9ba-447e-b608-aaefef469d04 was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d5f3fb99c27e4a4ef08367348f4ce741dacc741f.part /opt/stack/data/nova/instances/_base/d5f3fb99c27e4a4ef08367348f4ce741dacc741f.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:59 user nova-compute[75071]: INFO nova.compute.manager [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Took 1.75 seconds to destroy the instance on the hypervisor.
Dec 05 12:20:59 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.211s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/disk 1073741824" returned: 0 in 0.077s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:20:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d5f3fb99c27e4a4ef08367348f4ce741dacc741f.part /opt/stack/data/nova/instances/_base/d5f3fb99c27e4a4ef08367348f4ce741dacc741f.converted" returned: 0 in 0.319s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5f3fb99c27e4a4ef08367348f4ce741dacc741f.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.203s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5f3fb99c27e4a4ef08367348f4ce741dacc741f.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "d5f3fb99c27e4a4ef08367348f4ce741dacc741f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.854s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "d5f3fb99c27e4a4ef08367348f4ce741dacc741f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "d5f3fb99c27e4a4ef08367348f4ce741dacc741f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5f3fb99c27e4a4ef08367348f4ce741dacc741f --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Cannot resize image /opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Ensure instance console log exists: /opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d5f3fb99c27e4a4ef08367348f4ce741dacc741f --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d5f3fb99c27e4a4ef08367348f4ce741dacc741f,backing_fmt=raw /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk.rescue {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d5f3fb99c27e4a4ef08367348f4ce741dacc741f,backing_fmt=raw /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk.rescue" returned: 0 in 0.048s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "d5f3fb99c27e4a4ef08367348f4ce741dacc741f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lazy-loading 'migration_context' on Instance uuid e0c82eba-8448-4780-b92d-62d7c60ec7ef {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.objects.base [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Object Instance<e0c82eba-8448-4780-b92d-62d7c60ec7ef> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Start _get_guest_xml network_info=[{"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "vif_mac": "fa:16:3e:65:08:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1ecc19fa-f9ba-447e-b608-aaefef469d04', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '0d9ba6be-2b25-4881-a085-9de89bc2f5a5', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oAHbNekR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'e0c82eba-8448-4780-b92d-62d7c60ec7ef', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4aad4b4-ae4a-421e-9dce-491dbd59a219', 'serial': 'f4aad4b4-ae4a-421e-9dce-491dbd59a219'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lazy-loading 'resources' on Instance uuid e0c82eba-8448-4780-b92d-62d7c60ec7ef {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.objects.base [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Object Instance<e0c82eba-8448-4780-b92d-62d7c60ec7ef> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lazy-loading 'numa_topology' on Instance uuid e0c82eba-8448-4780-b92d-62d7c60ec7ef {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.objects.base [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Object Instance<e0c82eba-8448-4780-b92d-62d7c60ec7ef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:21:00 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:21:00 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lazy-loading 'vcpu_model' on Instance uuid e0c82eba-8448-4780-b92d-62d7c60ec7ef {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.objects.base [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Object Instance<e0c82eba-8448-4780-b92d-62d7c60ec7ef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oAHbNekR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:21:00 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:21:00 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:21:00 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-c83c2f07-3c96-4bce-9a95-0620c4186fd8 req-5a4ed46e-1085-4ab4-9212-10d1bd513a91 service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Received event network-vif-plugged-eb24fe21-798a-4e87-97e8-5e355a77257f {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c83c2f07-3c96-4bce-9a95-0620c4186fd8 req-5a4ed46e-1085-4ab4-9212-10d1bd513a91 service nova] Acquiring lock "2625dd24-5c50-4911-9515-57c9483bafa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c83c2f07-3c96-4bce-9a95-0620c4186fd8 req-5a4ed46e-1085-4ab4-9212-10d1bd513a91 service nova] Lock "2625dd24-5c50-4911-9515-57c9483bafa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c83c2f07-3c96-4bce-9a95-0620c4186fd8 req-5a4ed46e-1085-4ab4-9212-10d1bd513a91 service nova] Lock "2625dd24-5c50-4911-9515-57c9483bafa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-c83c2f07-3c96-4bce-9a95-0620c4186fd8 req-5a4ed46e-1085-4ab4-9212-10d1bd513a91 service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] No waiting events found dispatching network-vif-plugged-eb24fe21-798a-4e87-97e8-5e355a77257f {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:21:00 user nova-compute[75071]: WARNING nova.compute.manager [req-c83c2f07-3c96-4bce-9a95-0620c4186fd8 req-5a4ed46e-1085-4ab4-9212-10d1bd513a91 service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Received unexpected event network-vif-plugged-eb24fe21-798a-4e87-97e8-5e355a77257f for instance with vm_state active and task_state deleting.
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e709418c-550a-459c-8788-59d52587de61]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = oAHbNekR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 05 12:21:00 user nova-compute[75071]: node.name = iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:21:00 user nova-compute[75071]: node.tpgt = -1
Dec 05 12:21:00 user nova-compute[75071]: node.startup = automatic
Dec 05 12:21:00 user nova-compute[75071]: node.leading_login = No
Dec 05 12:21:00 user nova-compute[75071]: iface.iscsi_ifacename = default
Dec 05 12:21:00 user nova-compute[75071]: iface.net_ifacename = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.ipaddress = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.prefix_len = 0
Dec 05 12:21:00 user nova-compute[75071]: iface.hwaddress = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.transport_name = tcp
Dec 05 12:21:00 user nova-compute[75071]: iface.initiatorname = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.state = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.vlan_id = 0
Dec 05 12:21:00 user nova-compute[75071]: iface.vlan_priority = 0
Dec 05 12:21:00 user nova-compute[75071]: iface.vlan_state = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.iface_num = 0
Dec 05 12:21:00 user nova-compute[75071]: iface.mtu = 0
Dec 05 12:21:00 user nova-compute[75071]: iface.port = 0
Dec 05 12:21:00 user nova-compute[75071]: iface.bootproto = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.subnet_mask = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.gateway = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.dhcp_alt_client_id_state = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.dhcp_alt_client_id = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.dhcp_dns = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.dhcp_learn_iqn = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.dhcp_req_vendor_id_state = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.dhcp_vendor_id_state = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.dhcp_vendor_id = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.dhcp_slp_da = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.fragmentation = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.gratuitous_arp = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.incoming_forwarding = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.tos_state = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.tos = 0
Dec 05 12:21:00 user nova-compute[75071]: iface.ttl = 0
Dec 05 12:21:00 user nova-compute[75071]: iface.delayed_ack = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.tcp_nagle = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.tcp_wsf_state = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.tcp_wsf = 0
Dec 05 12:21:00 user nova-compute[75071]: iface.tcp_timer_scale = 0
Dec 05 12:21:00 user nova-compute[75071]: iface.tcp_timestamp = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.redirect = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.def_task_mgmt_timeout = 0
Dec 05 12:21:00 user nova-compute[75071]: iface.header_digest = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.data_digest = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.immediate_data = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.initial_r2t = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.data_seq_inorder = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.data_pdu_inorder = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.erl = 0
Dec 05 12:21:00 user nova-compute[75071]: iface.max_receive_data_len = 0
Dec 05 12:21:00 user nova-compute[75071]: iface.first_burst_len = 0
Dec 05 12:21:00 user nova-compute[75071]: iface.max_outstanding_r2t = 0
Dec 05 12:21:00 user nova-compute[75071]: iface.max_burst_len = 0
Dec 05 12:21:00 user nova-compute[75071]: iface.chap_auth = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.bidi_chap = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.strict_login_compliance = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.discovery_auth = <empty>
Dec 05 12:21:00 user nova-compute[75071]: iface.discovery_logout = <empty>
Dec 05 12:21:00 user nova-compute[75071]: node.discovery_address = <empty>
Dec 05 12:21:00 user nova-compute[75071]: node.discovery_port = 0
Dec 05 12:21:00 user nova-compute[75071]: node.discovery_type = static
Dec 05 12:21:00 user nova-compute[75071]: node.session.initial_cmdsn = 0
Dec 05 12:21:00 user nova-compute[75071]: node.session.initial_login_retry_max = 8
Dec 05 12:21:00 user nova-compute[75071]: node.session.xmit_thread_priority = -20
Dec 05 12:21:00 user nova-compute[75071]: node.session.cmds_max = 128
Dec 05 12:21:00 user nova-compute[75071]: node.session.queue_depth = 32
Dec 05 12:21:00 user nova-compute[75071]: node.session.nr_sessions = 1
Dec 05 12:21:00 user nova-compute[75071]: node.session.auth.authmethod = CHAP
Dec 05 12:21:00 user nova-compute[75071]: node.session.auth.username = oAHbNekR
Dec 05 12:21:00 user nova-compute[75071]: node.session.auth.password = ***
Dec 05 12:21:00 user nova-compute[75071]: node.session.auth.username_in = <empty>
Dec 05 12:21:00 user nova-compute[75071]: node.session.auth.password_in = <empty>
Dec 05 12:21:00 user nova-compute[75071]: node.session.auth.chap_algs = MD5
Dec 05 12:21:00 user nova-compute[75071]: node.session.timeo.replacement_timeout = 120
Dec 05 12:21:00 user nova-compute[75071]: node.session.err_timeo.abort_timeout = 15
Dec 05 12:21:00 user nova-compute[75071]: node.session.err_timeo.lu_reset_timeout = 30
Dec 05 12:21:00 user nova-compute[75071]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 05 12:21:00 user nova-compute[75071]: node.session.err_timeo.host_reset_timeout = 60
Dec 05 12:21:00 user nova-compute[75071]: node.session.iscsi.FastAbort = Yes
Dec 05 12:21:00 user nova-compute[75071]: node.session.iscsi.InitialR2T = No
Dec 05 12:21:00 user nova-compute[75071]: node.session.iscsi.ImmediateData = Yes
Dec 05 12:21:00 user nova-compute[75071]: node.session.iscsi.FirstBurstLength = 262144
Dec 05 12:21:00 user nova-compute[75071]: node.session.iscsi.MaxBurstLength = 16776192
Dec 05 12:21:00 user nova-compute[75071]: node.session.iscsi.DefaultTime2Retain = 0
Dec 05 12:21:00 user nova-compute[75071]: node.session.iscsi.DefaultTime2Wait = 2
Dec 05 12:21:00 user nova-compute[75071]: node.session.iscsi.MaxConnections = 1
Dec 05 12:21:00 user nova-compute[75071]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 05 12:21:00 user nova-compute[75071]: node.session.iscsi.ERL = 0
Dec 05 12:21:00 user nova-compute[75071]: node.session.scan = manual
Dec 05 12:21:00 user nova-compute[75071]: node.session.reopen_max = 0
Dec 05 12:21:00 user nova-compute[75071]: node.conn[0].address = 172.16.0.220
Dec 05 12:21:00 user nova-compute[75071]: node.conn[0].port = 3260
Dec 05 12:21:00 user nova-compute[75071]: node.conn[0].startup = manual
Dec 05 12:21:00 user nova-compute[75071]: node.conn[0].tcp.window_size = 524288
Dec 05 12:21:00 user nova-compute[75071]: node.conn[0].tcp.type_of_service = 0
Dec 05 12:21:00 user nova-compute[75071]: node.conn[0].timeo.logout_timeout = 15
Dec 05 12:21:00 user nova-compute[75071]: node.conn[0].timeo.login_timeout = 15
Dec 05 12:21:00 user nova-compute[75071]: node.conn[0].timeo.auth_timeout = 45
Dec 05 12:21:00 user nova-compute[75071]: node.conn[0].timeo.noop_out_interval = 5
Dec 05 12:21:00 user nova-compute[75071]: node.conn[0].timeo.noop_out_timeout = 5
Dec 05 12:21:00 user nova-compute[75071]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 05 12:21:00 user nova-compute[75071]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 05 12:21:00 user nova-compute[75071]: node.conn[0].iscsi.HeaderDigest = None
Dec 05 12:21:00 user nova-compute[75071]: node.conn[0].iscsi.DataDigest = None
Dec 05 12:21:00 user nova-compute[75071]: node.conn[0].iscsi.IFMarker = No
Dec 05 12:21:00 user nova-compute[75071]: node.conn[0].iscsi.OFMarker = No
Dec 05 12:21:00 user nova-compute[75071]: # END RECORD
Dec 05 12:21:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a4d04d-9a37-4ee7-a215-11cd75f7ef53]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45f195b-92a0-49d2-a80b-095702cb6ade]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oAHbNekR {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oAHbNekR" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c11d2ea-a019-43c4-9294-165df5f5948a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oAHbNekR'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d361bc9f-39b9-42e3-9511-ba079b055d79]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8c7b01-49a3-4011-9393-fbba597caa20]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:21:00 user nova-compute[75071]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:21:00 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:21:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:21:00 user nova-compute[75071]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:21:00 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:21:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] HCTL ('34', '0', '0', 0) found on session 18 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc36fb3f-e5ab-4bc8-a198-5e23f7296d6a]: (4, ('0 0 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Searching for a device in session 18 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oAHbNekR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.175s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] <== connect_volume: return (176ms) {'type': 'block', 'scsi_wwn': '23139333634626138', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139333634626138', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Successfully updated port: 50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:16:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-614681634',display_name='tempest-ServerStableDeviceRescueTest-server-614681634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-614681634',id=3,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBND8W1Zybd+g0C1dD78+dtozfG5vmhl919CuxP9SZzLTJGFsxhQvcxXPbGJgPQvvH3zGP+Wa5JPpC8q2E+mX0mftBd0gOdevPIVnDM93JeHOz80YSlDkAH90qcFoDmdGHg==',key_name='tempest-keypair-1105909075',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:17:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e4d6230093b414ea5528dc2f9788a78',ramdisk_id='',reservation_id='r-jnssfdf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-639129617',owner_user_name='tempest-ServerStableDeviceRescueTest-639129617-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:19:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1da411f6b242492ab5f67a8d21766f6d',uuid=e0c82eba-8448-4780-b92d-62d7c60ec7ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "vif_mac": "fa:16:3e:65:08:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Converting VIF {"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "vif_mac": "fa:16:3e:65:08:02"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:08:02,bridge_name='br-int',has_traffic_filtering=True,id=30895720-729f-445d-b49a-d843f1cb23a8,network=Network(44eba32b-49a9-4087-b09b-fb9ebfe41506),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30895720-72') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lazy-loading 'pci_devices' on Instance uuid e0c82eba-8448-4780-b92d-62d7c60ec7ef {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Acquiring lock "refresh_cache-22a59c32-0b4a-4f5a-92bb-79c2882b515a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Acquired lock "refresh_cache-22a59c32-0b4a-4f5a-92bb-79c2882b515a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.objects.base [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Object Instance<e0c82eba-8448-4780-b92d-62d7c60ec7ef> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:21:00 user nova-compute[75071]:   <uuid>e0c82eba-8448-4780-b92d-62d7c60ec7ef</uuid>
Dec 05 12:21:00 user nova-compute[75071]:   <name>instance-00000003</name>
Dec 05 12:21:00 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:21:00 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:21:00 user nova-compute[75071]:   <metadata>
Dec 05 12:21:00 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:21:00 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:21:00 user nova-compute[75071]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-614681634</nova:name>
Dec 05 12:21:00 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:21:00</nova:creationTime>
Dec 05 12:21:00 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:21:00 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:21:00 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:21:00 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:21:00 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:21:00 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:21:00 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:21:00 user nova-compute[75071]:       <nova:owner>
Dec 05 12:21:00 user nova-compute[75071]:         <nova:user uuid="1da411f6b242492ab5f67a8d21766f6d">tempest-ServerStableDeviceRescueTest-639129617-project-member</nova:user>
Dec 05 12:21:00 user nova-compute[75071]:         <nova:project uuid="9e4d6230093b414ea5528dc2f9788a78">tempest-ServerStableDeviceRescueTest-639129617</nova:project>
Dec 05 12:21:00 user nova-compute[75071]:       </nova:owner>
Dec 05 12:21:00 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:21:00 user nova-compute[75071]:       <nova:ports>
Dec 05 12:21:00 user nova-compute[75071]:         <nova:port uuid="30895720-729f-445d-b49a-d843f1cb23a8">
Dec 05 12:21:00 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 05 12:21:00 user nova-compute[75071]:         </nova:port>
Dec 05 12:21:00 user nova-compute[75071]:       </nova:ports>
Dec 05 12:21:00 user nova-compute[75071]:     </nova:instance>
Dec 05 12:21:00 user nova-compute[75071]:   </metadata>
Dec 05 12:21:00 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:21:00 user nova-compute[75071]:     <system>
Dec 05 12:21:00 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:21:00 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:21:00 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:21:00 user nova-compute[75071]:       <entry name="serial">e0c82eba-8448-4780-b92d-62d7c60ec7ef</entry>
Dec 05 12:21:00 user nova-compute[75071]:       <entry name="uuid">e0c82eba-8448-4780-b92d-62d7c60ec7ef</entry>
Dec 05 12:21:00 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:21:00 user nova-compute[75071]:     </system>
Dec 05 12:21:00 user nova-compute[75071]:   </sysinfo>
Dec 05 12:21:00 user nova-compute[75071]:   <os>
Dec 05 12:21:00 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:21:00 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:21:00 user nova-compute[75071]:   </os>
Dec 05 12:21:00 user nova-compute[75071]:   <features>
Dec 05 12:21:00 user nova-compute[75071]:     <acpi/>
Dec 05 12:21:00 user nova-compute[75071]:     <apic/>
Dec 05 12:21:00 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:21:00 user nova-compute[75071]:   </features>
Dec 05 12:21:00 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:21:00 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:21:00 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:21:00 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:21:00 user nova-compute[75071]:   </clock>
Dec 05 12:21:00 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:21:00 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:21:00 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:21:00 user nova-compute[75071]:   </cpu>
Dec 05 12:21:00 user nova-compute[75071]:   <devices>
Dec 05 12:21:00 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:21:00 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:21:00 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk"/>
Dec 05 12:21:00 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:21:00 user nova-compute[75071]:     </disk>
Dec 05 12:21:00 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:21:00 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:21:00 user nova-compute[75071]:       <source dev="/dev/sdc"/>
Dec 05 12:21:00 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Dec 05 12:21:00 user nova-compute[75071]:       <serial>f4aad4b4-ae4a-421e-9dce-491dbd59a219</serial>
Dec 05 12:21:00 user nova-compute[75071]:     </disk>
Dec 05 12:21:00 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:21:00 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:21:00 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk.rescue"/>
Dec 05 12:21:00 user nova-compute[75071]:       <target dev="vdc" bus="virtio"/>
Dec 05 12:21:00 user nova-compute[75071]:       <boot order="1"/>
Dec 05 12:21:00 user nova-compute[75071]:     </disk>
Dec 05 12:21:00 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:21:00 user nova-compute[75071]:       <mac address="fa:16:3e:65:08:02"/>
Dec 05 12:21:00 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:21:00 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:21:00 user nova-compute[75071]:       <target dev="tap30895720-72"/>
Dec 05 12:21:00 user nova-compute[75071]:     </interface>
Dec 05 12:21:00 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:21:00 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/console.log" append="off"/>
Dec 05 12:21:00 user nova-compute[75071]:     </serial>
Dec 05 12:21:00 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:21:00 user nova-compute[75071]:     <video>
Dec 05 12:21:00 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:21:00 user nova-compute[75071]:     </video>
Dec 05 12:21:00 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:21:00 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:21:00 user nova-compute[75071]:     </rng>
Dec 05 12:21:00 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:21:00 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:21:00 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:21:00 user nova-compute[75071]:     </memballoon>
Dec 05 12:21:00 user nova-compute[75071]:   </devices>
Dec 05 12:21:00 user nova-compute[75071]: </domain>
Dec 05 12:21:00 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:21:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Instance destroyed successfully.
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-9754c46e-e3a3-46c0-a995-45cd198e0f71 req-c9adb136-a508-4a99-a0fd-5d1b4c6bdfac service nova] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Received event network-changed-50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-9754c46e-e3a3-46c0-a995-45cd198e0f71 req-c9adb136-a508-4a99-a0fd-5d1b4c6bdfac service nova] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Refreshing instance network info cache due to event network-changed-50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9754c46e-e3a3-46c0-a995-45cd198e0f71 req-c9adb136-a508-4a99-a0fd-5d1b4c6bdfac service nova] Acquiring lock "refresh_cache-22a59c32-0b4a-4f5a-92bb-79c2882b515a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] No VIF found with MAC fa:16:3e:65:08:02, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:21:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:21:01 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Took 1.51 seconds to deallocate network for instance.
Dec 05 12:21:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Updating instance_info_cache with network_info: [{"id": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "address": "fa:16:3e:09:64:8c", "network": {"id": "242fcf8b-eac4-4ad5-915c-3dcf23b9d522", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-57708078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "896fedb155fd4942baf7dd1b9b074eba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ffdfa4-c4", "ovs_interfaceid": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Releasing lock "refresh_cache-22a59c32-0b4a-4f5a-92bb-79c2882b515a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Instance network_info: |[{"id": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "address": "fa:16:3e:09:64:8c", "network": {"id": "242fcf8b-eac4-4ad5-915c-3dcf23b9d522", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-57708078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "896fedb155fd4942baf7dd1b9b074eba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ffdfa4-c4", "ovs_interfaceid": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9754c46e-e3a3-46c0-a995-45cd198e0f71 req-c9adb136-a508-4a99-a0fd-5d1b4c6bdfac service nova] Acquired lock "refresh_cache-22a59c32-0b4a-4f5a-92bb-79c2882b515a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.network.neutron [req-9754c46e-e3a3-46c0-a995-45cd198e0f71 req-c9adb136-a508-4a99-a0fd-5d1b4c6bdfac service nova] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Refreshing network info cache for port 50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Start _get_guest_xml network_info=[{"id": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "address": "fa:16:3e:09:64:8c", "network": {"id": "242fcf8b-eac4-4ad5-915c-3dcf23b9d522", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-57708078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "896fedb155fd4942baf7dd1b9b074eba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ffdfa4-c4", "ovs_interfaceid": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:21:01 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:21:01 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-712981727',display_name='tempest-DeleteServersTestJSON-server-712981727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-712981727',id=15,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='896fedb155fd4942baf7dd1b9b074eba',ramdisk_id='',reservation_id='r-hgnlbhhx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-178107000',owner_user_name='tempest-DeleteServersTestJSON-178107000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:20:58Z,user_data=None,user_id='8329e945f94544ef849d35de4726bad8',uuid=22a59c32-0b4a-4f5a-92bb-79c2882b515a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "address": "fa:16:3e:09:64:8c", "network": {"id": "242fcf8b-eac4-4ad5-915c-3dcf23b9d522", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-57708078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "896fedb155fd4942baf7dd1b9b074eba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ffdfa4-c4", "ovs_interfaceid": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Converting VIF {"id": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "address": "fa:16:3e:09:64:8c", "network": {"id": "242fcf8b-eac4-4ad5-915c-3dcf23b9d522", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-57708078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "896fedb155fd4942baf7dd1b9b074eba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ffdfa4-c4", "ovs_interfaceid": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:64:8c,bridge_name='br-int',has_traffic_filtering=True,id=50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c,network=Network(242fcf8b-eac4-4ad5-915c-3dcf23b9d522),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50ffdfa4-c4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.objects.instance [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lazy-loading 'pci_devices' on Instance uuid 22a59c32-0b4a-4f5a-92bb-79c2882b515a {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:21:01 user nova-compute[75071]:   <uuid>22a59c32-0b4a-4f5a-92bb-79c2882b515a</uuid>
Dec 05 12:21:01 user nova-compute[75071]:   <name>instance-0000000f</name>
Dec 05 12:21:01 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:21:01 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:21:01 user nova-compute[75071]:   <metadata>
Dec 05 12:21:01 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:21:01 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:21:01 user nova-compute[75071]:       <nova:name>tempest-DeleteServersTestJSON-server-712981727</nova:name>
Dec 05 12:21:01 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:21:01</nova:creationTime>
Dec 05 12:21:01 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:21:01 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:21:01 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:21:01 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:21:01 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:21:01 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:21:01 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:21:01 user nova-compute[75071]:       <nova:owner>
Dec 05 12:21:01 user nova-compute[75071]:         <nova:user uuid="8329e945f94544ef849d35de4726bad8">tempest-DeleteServersTestJSON-178107000-project-member</nova:user>
Dec 05 12:21:01 user nova-compute[75071]:         <nova:project uuid="896fedb155fd4942baf7dd1b9b074eba">tempest-DeleteServersTestJSON-178107000</nova:project>
Dec 05 12:21:01 user nova-compute[75071]:       </nova:owner>
Dec 05 12:21:01 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:21:01 user nova-compute[75071]:       <nova:ports>
Dec 05 12:21:01 user nova-compute[75071]:         <nova:port uuid="50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c">
Dec 05 12:21:01 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 05 12:21:01 user nova-compute[75071]:         </nova:port>
Dec 05 12:21:01 user nova-compute[75071]:       </nova:ports>
Dec 05 12:21:01 user nova-compute[75071]:     </nova:instance>
Dec 05 12:21:01 user nova-compute[75071]:   </metadata>
Dec 05 12:21:01 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:21:01 user nova-compute[75071]:     <system>
Dec 05 12:21:01 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:21:01 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:21:01 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:21:01 user nova-compute[75071]:       <entry name="serial">22a59c32-0b4a-4f5a-92bb-79c2882b515a</entry>
Dec 05 12:21:01 user nova-compute[75071]:       <entry name="uuid">22a59c32-0b4a-4f5a-92bb-79c2882b515a</entry>
Dec 05 12:21:01 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:21:01 user nova-compute[75071]:     </system>
Dec 05 12:21:01 user nova-compute[75071]:   </sysinfo>
Dec 05 12:21:01 user nova-compute[75071]:   <os>
Dec 05 12:21:01 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:21:01 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:21:01 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:21:01 user nova-compute[75071]:   </os>
Dec 05 12:21:01 user nova-compute[75071]:   <features>
Dec 05 12:21:01 user nova-compute[75071]:     <acpi/>
Dec 05 12:21:01 user nova-compute[75071]:     <apic/>
Dec 05 12:21:01 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:21:01 user nova-compute[75071]:   </features>
Dec 05 12:21:01 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:21:01 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:21:01 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:21:01 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:21:01 user nova-compute[75071]:   </clock>
Dec 05 12:21:01 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:21:01 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:21:01 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:21:01 user nova-compute[75071]:   </cpu>
Dec 05 12:21:01 user nova-compute[75071]:   <devices>
Dec 05 12:21:01 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:21:01 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:21:01 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/disk"/>
Dec 05 12:21:01 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:21:01 user nova-compute[75071]:     </disk>
Dec 05 12:21:01 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:21:01 user nova-compute[75071]:       <mac address="fa:16:3e:09:64:8c"/>
Dec 05 12:21:01 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:21:01 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:21:01 user nova-compute[75071]:       <target dev="tap50ffdfa4-c4"/>
Dec 05 12:21:01 user nova-compute[75071]:     </interface>
Dec 05 12:21:01 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:21:01 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/console.log" append="off"/>
Dec 05 12:21:01 user nova-compute[75071]:     </serial>
Dec 05 12:21:01 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:21:01 user nova-compute[75071]:     <video>
Dec 05 12:21:01 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:21:01 user nova-compute[75071]:     </video>
Dec 05 12:21:01 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:21:01 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:21:01 user nova-compute[75071]:     </rng>
Dec 05 12:21:01 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:21:01 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:21:01 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:21:01 user nova-compute[75071]:     </memballoon>
Dec 05 12:21:01 user nova-compute[75071]:   </devices>
Dec 05 12:21:01 user nova-compute[75071]: </domain>
Dec 05 12:21:01 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-712981727',display_name='tempest-DeleteServersTestJSON-server-712981727',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-712981727',id=15,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='896fedb155fd4942baf7dd1b9b074eba',ramdisk_id='',reservation_id='r-hgnlbhhx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-178107000',owner_user_name='tempest-DeleteServersTestJSON-178107000-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:20:58Z,user_data=None,user_id='8329e945f94544ef849d35de4726bad8',uuid=22a59c32-0b4a-4f5a-92bb-79c2882b515a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "address": "fa:16:3e:09:64:8c", "network": {"id": "242fcf8b-eac4-4ad5-915c-3dcf23b9d522", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-57708078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "896fedb155fd4942baf7dd1b9b074eba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ffdfa4-c4", "ovs_interfaceid": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Converting VIF {"id": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "address": "fa:16:3e:09:64:8c", "network": {"id": "242fcf8b-eac4-4ad5-915c-3dcf23b9d522", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-57708078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "896fedb155fd4942baf7dd1b9b074eba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ffdfa4-c4", "ovs_interfaceid": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:64:8c,bridge_name='br-int',has_traffic_filtering=True,id=50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c,network=Network(242fcf8b-eac4-4ad5-915c-3dcf23b9d522),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50ffdfa4-c4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG os_vif [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:64:8c,bridge_name='br-int',has_traffic_filtering=True,id=50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c,network=Network(242fcf8b-eac4-4ad5-915c-3dcf23b9d522),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50ffdfa4-c4') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d917de8-0785-5e17-a6e6-fd741c92a3b3', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50ffdfa4-c4, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50ffdfa4-c4, col_values=(('qos', UUID('c7b81730-38fc-443b-990c-e1ba1e0590b7')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50ffdfa4-c4, col_values=(('external_ids', {'iface-id': '50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:64:8c', 'vm-uuid': '22a59c32-0b4a-4f5a-92bb-79c2882b515a'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:01 user nova-compute[75071]: INFO os_vif [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:64:8c,bridge_name='br-int',has_traffic_filtering=True,id=50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c,network=Network(242fcf8b-eac4-4ad5-915c-3dcf23b9d522),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50ffdfa4-c4')
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] No VIF found with MAC fa:16:3e:09:64:8c, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.network.neutron [req-9754c46e-e3a3-46c0-a995-45cd198e0f71 req-c9adb136-a508-4a99-a0fd-5d1b4c6bdfac service nova] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Updated VIF entry in instance network info cache for port 50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.network.neutron [req-9754c46e-e3a3-46c0-a995-45cd198e0f71 req-c9adb136-a508-4a99-a0fd-5d1b4c6bdfac service nova] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Updating instance_info_cache with network_info: [{"id": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "address": "fa:16:3e:09:64:8c", "network": {"id": "242fcf8b-eac4-4ad5-915c-3dcf23b9d522", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-57708078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "896fedb155fd4942baf7dd1b9b074eba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ffdfa4-c4", "ovs_interfaceid": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:21:01 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Deleted allocations for instance 2625dd24-5c50-4911-9515-57c9483bafa1
Dec 05 12:21:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9754c46e-e3a3-46c0-a995-45cd198e0f71 req-c9adb136-a508-4a99-a0fd-5d1b4c6bdfac service nova] Releasing lock "refresh_cache-22a59c32-0b4a-4f5a-92bb-79c2882b515a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fe144a83-6584-4b2e-90ff-395d5b15d8aa tempest-TestVolumeSwap-583774926 tempest-TestVolumeSwap-583774926-project-member] Lock "2625dd24-5c50-4911-9515-57c9483bafa1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.897s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-64bc9398-13ac-46eb-9cbd-e006229c8302 req-16296072-0cec-4dff-82a9-3280a8a6ffbe service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received event network-vif-unplugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64bc9398-13ac-46eb-9cbd-e006229c8302 req-16296072-0cec-4dff-82a9-3280a8a6ffbe service nova] Acquiring lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64bc9398-13ac-46eb-9cbd-e006229c8302 req-16296072-0cec-4dff-82a9-3280a8a6ffbe service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-64bc9398-13ac-46eb-9cbd-e006229c8302 req-16296072-0cec-4dff-82a9-3280a8a6ffbe service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-64bc9398-13ac-46eb-9cbd-e006229c8302 req-16296072-0cec-4dff-82a9-3280a8a6ffbe service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] No waiting events found dispatching network-vif-unplugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:21:01 user nova-compute[75071]: WARNING nova.compute.manager [req-64bc9398-13ac-46eb-9cbd-e006229c8302 req-16296072-0cec-4dff-82a9-3280a8a6ffbe service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received unexpected event network-vif-unplugged-30895720-729f-445d-b49a-d843f1cb23a8 for instance with vm_state active and task_state rescuing.
Dec 05 12:21:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-a209ff60-3f4e-4e59-a0b8-05f86225d6dc req-271920f6-23f9-4200-bd7b-56b7a86ea3bc service nova] [instance: 2625dd24-5c50-4911-9515-57c9483bafa1] Received event network-vif-deleted-eb24fe21-798a-4e87-97e8-5e355a77257f {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-ef65d332-c4d8-4380-ae73-a9db39109db3 req-04a35a2a-2432-49f2-ab10-dd2e6bc40a44 service nova] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Received event network-vif-plugged-50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ef65d332-c4d8-4380-ae73-a9db39109db3 req-04a35a2a-2432-49f2-ab10-dd2e6bc40a44 service nova] Acquiring lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ef65d332-c4d8-4380-ae73-a9db39109db3 req-04a35a2a-2432-49f2-ab10-dd2e6bc40a44 service nova] Lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ef65d332-c4d8-4380-ae73-a9db39109db3 req-04a35a2a-2432-49f2-ab10-dd2e6bc40a44 service nova] Lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-ef65d332-c4d8-4380-ae73-a9db39109db3 req-04a35a2a-2432-49f2-ab10-dd2e6bc40a44 service nova] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] No waiting events found dispatching network-vif-plugged-50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:21:03 user nova-compute[75071]: WARNING nova.compute.manager [req-ef65d332-c4d8-4380-ae73-a9db39109db3 req-04a35a2a-2432-49f2-ab10-dd2e6bc40a44 service nova] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Received unexpected event network-vif-plugged-50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c for instance with vm_state building and task_state spawning.
Dec 05 12:21:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-e99b28be-94ce-4965-8413-3c3841d454a3 req-84014a89-b194-4814-9764-2dd69868dfcb service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received event network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e99b28be-94ce-4965-8413-3c3841d454a3 req-84014a89-b194-4814-9764-2dd69868dfcb service nova] Acquiring lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e99b28be-94ce-4965-8413-3c3841d454a3 req-84014a89-b194-4814-9764-2dd69868dfcb service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e99b28be-94ce-4965-8413-3c3841d454a3 req-84014a89-b194-4814-9764-2dd69868dfcb service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-e99b28be-94ce-4965-8413-3c3841d454a3 req-84014a89-b194-4814-9764-2dd69868dfcb service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] No waiting events found dispatching network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:21:04 user nova-compute[75071]: WARNING nova.compute.manager [req-e99b28be-94ce-4965-8413-3c3841d454a3 req-84014a89-b194-4814-9764-2dd69868dfcb service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received unexpected event network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 for instance with vm_state active and task_state rescuing.
Dec 05 12:21:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-e99b28be-94ce-4965-8413-3c3841d454a3 req-84014a89-b194-4814-9764-2dd69868dfcb service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received event network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e99b28be-94ce-4965-8413-3c3841d454a3 req-84014a89-b194-4814-9764-2dd69868dfcb service nova] Acquiring lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e99b28be-94ce-4965-8413-3c3841d454a3 req-84014a89-b194-4814-9764-2dd69868dfcb service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e99b28be-94ce-4965-8413-3c3841d454a3 req-84014a89-b194-4814-9764-2dd69868dfcb service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-e99b28be-94ce-4965-8413-3c3841d454a3 req-84014a89-b194-4814-9764-2dd69868dfcb service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] No waiting events found dispatching network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:21:04 user nova-compute[75071]: WARNING nova.compute.manager [req-e99b28be-94ce-4965-8413-3c3841d454a3 req-84014a89-b194-4814-9764-2dd69868dfcb service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received unexpected event network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 for instance with vm_state active and task_state rescuing.
Dec 05 12:21:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-e99b28be-94ce-4965-8413-3c3841d454a3 req-84014a89-b194-4814-9764-2dd69868dfcb service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received event network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e99b28be-94ce-4965-8413-3c3841d454a3 req-84014a89-b194-4814-9764-2dd69868dfcb service nova] Acquiring lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e99b28be-94ce-4965-8413-3c3841d454a3 req-84014a89-b194-4814-9764-2dd69868dfcb service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e99b28be-94ce-4965-8413-3c3841d454a3 req-84014a89-b194-4814-9764-2dd69868dfcb service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-e99b28be-94ce-4965-8413-3c3841d454a3 req-84014a89-b194-4814-9764-2dd69868dfcb service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] No waiting events found dispatching network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:21:04 user nova-compute[75071]: WARNING nova.compute.manager [req-e99b28be-94ce-4965-8413-3c3841d454a3 req-84014a89-b194-4814-9764-2dd69868dfcb service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received unexpected event network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 for instance with vm_state active and task_state rescuing.
Dec 05 12:21:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-2829076b-c2c1-4e11-9f69-c8dfa97da639 req-654b85f6-d274-496b-861c-41b8104d393e service nova] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Received event network-vif-plugged-50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2829076b-c2c1-4e11-9f69-c8dfa97da639 req-654b85f6-d274-496b-861c-41b8104d393e service nova] Acquiring lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2829076b-c2c1-4e11-9f69-c8dfa97da639 req-654b85f6-d274-496b-861c-41b8104d393e service nova] Lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2829076b-c2c1-4e11-9f69-c8dfa97da639 req-654b85f6-d274-496b-861c-41b8104d393e service nova] Lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-2829076b-c2c1-4e11-9f69-c8dfa97da639 req-654b85f6-d274-496b-861c-41b8104d393e service nova] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] No waiting events found dispatching network-vif-plugged-50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:21:05 user nova-compute[75071]: WARNING nova.compute.manager [req-2829076b-c2c1-4e11-9f69-c8dfa97da639 req-654b85f6-d274-496b-861c-41b8104d393e service nova] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Received unexpected event network-vif-plugged-50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c for instance with vm_state building and task_state spawning.
Dec 05 12:21:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:21:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:21:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Instance spawned successfully.
Dec 05 12:21:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:21:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:21:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:21:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:21:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:21:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:21:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:21:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2e025a41-ba91-465f-82e8-c5e2f8b503f1 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:21:06 user nova-compute[75071]: INFO nova.compute.manager [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Took 7.90 seconds to spawn the instance on the hypervisor.
Dec 05 12:21:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:21:06 user nova-compute[75071]: INFO nova.compute.manager [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Took 8.70 seconds to build instance.
Dec 05 12:21:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-aea3ce57-fde2-4667-925b-51dd6baed73d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.842s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-15f53274-b90e-4475-82d4-4aaafcc74303 req-0aa8d1ed-ac8e-4683-b712-e9065646de33 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Received event network-changed-bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-15f53274-b90e-4475-82d4-4aaafcc74303 req-0aa8d1ed-ac8e-4683-b712-e9065646de33 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Refreshing instance network info cache due to event network-changed-bc3ba814-a825-4145-be46-f4028df2a727. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-15f53274-b90e-4475-82d4-4aaafcc74303 req-0aa8d1ed-ac8e-4683-b712-e9065646de33 service nova] Acquiring lock "refresh_cache-46d74901-9224-4575-956b-de5c92580f8a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-15f53274-b90e-4475-82d4-4aaafcc74303 req-0aa8d1ed-ac8e-4683-b712-e9065646de33 service nova] Acquired lock "refresh_cache-46d74901-9224-4575-956b-de5c92580f8a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:21:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-15f53274-b90e-4475-82d4-4aaafcc74303 req-0aa8d1ed-ac8e-4683-b712-e9065646de33 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Refreshing network info cache for port bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:21:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-15f53274-b90e-4475-82d4-4aaafcc74303 req-0aa8d1ed-ac8e-4683-b712-e9065646de33 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Updated VIF entry in instance network info cache for port bc3ba814-a825-4145-be46-f4028df2a727. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:21:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-15f53274-b90e-4475-82d4-4aaafcc74303 req-0aa8d1ed-ac8e-4683-b712-e9065646de33 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Updating instance_info_cache with network_info: [{"id": "bc3ba814-a825-4145-be46-f4028df2a727", "address": "fa:16:3e:1b:64:fe", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc3ba814-a8", "ovs_interfaceid": "bc3ba814-a825-4145-be46-f4028df2a727", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-15f53274-b90e-4475-82d4-4aaafcc74303 req-0aa8d1ed-ac8e-4683-b712-e9065646de33 service nova] Releasing lock "refresh_cache-46d74901-9224-4575-956b-de5c92580f8a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "46d74901-9224-4575-956b-de5c92580f8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "46d74901-9224-4575-956b-de5c92580f8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "46d74901-9224-4575-956b-de5c92580f8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "46d74901-9224-4575-956b-de5c92580f8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "46d74901-9224-4575-956b-de5c92580f8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:09 user nova-compute[75071]: INFO nova.compute.manager [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Terminating instance
Dec 05 12:21:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:21:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-a0a17eaa-3eee-43d6-82e7-4a817379ebd1 req-6671dad7-80aa-4606-ad99-9229d1e12857 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Received event network-vif-unplugged-bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a0a17eaa-3eee-43d6-82e7-4a817379ebd1 req-6671dad7-80aa-4606-ad99-9229d1e12857 service nova] Acquiring lock "46d74901-9224-4575-956b-de5c92580f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a0a17eaa-3eee-43d6-82e7-4a817379ebd1 req-6671dad7-80aa-4606-ad99-9229d1e12857 service nova] Lock "46d74901-9224-4575-956b-de5c92580f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a0a17eaa-3eee-43d6-82e7-4a817379ebd1 req-6671dad7-80aa-4606-ad99-9229d1e12857 service nova] Lock "46d74901-9224-4575-956b-de5c92580f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-a0a17eaa-3eee-43d6-82e7-4a817379ebd1 req-6671dad7-80aa-4606-ad99-9229d1e12857 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] No waiting events found dispatching network-vif-unplugged-bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-a0a17eaa-3eee-43d6-82e7-4a817379ebd1 req-6671dad7-80aa-4606-ad99-9229d1e12857 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Received event network-vif-unplugged-bc3ba814-a825-4145-be46-f4028df2a727 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Instance destroyed successfully.
Dec 05 12:21:10 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lazy-loading 'resources' on Instance uuid 46d74901-9224-4575-956b-de5c92580f8a {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:19:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-665384170',display_name='tempest-AttachVolumeNegativeTest-server-665384170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-665384170',id=12,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTXJNRhtXvf06pYQe1AwgAEnItggWXAYgOYJvff5jyqmqxcfAPRPeADAxWp2J19bhqnZEmc+zWfdwvuC4Kfcpy1H72ejQbYVKZw1gwwQAYhToCRTWWhX/+OpHvyMDb44g==',key_name='tempest-keypair-631342850',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:19:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5c1a038a4eb45508b7f5aa3eb435229',ramdisk_id='',reservation_id='r-wvacgiea',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1152460930',owner_user_name='tempest-AttachVolumeNegativeTest-1152460930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:19:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d78c212de2e426fad0cba51a2e7bf52',uuid=46d74901-9224-4575-956b-de5c92580f8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc3ba814-a825-4145-be46-f4028df2a727", "address": "fa:16:3e:1b:64:fe", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc3ba814-a8", "ovs_interfaceid": "bc3ba814-a825-4145-be46-f4028df2a727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converting VIF {"id": "bc3ba814-a825-4145-be46-f4028df2a727", "address": "fa:16:3e:1b:64:fe", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc3ba814-a8", "ovs_interfaceid": "bc3ba814-a825-4145-be46-f4028df2a727", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=bc3ba814-a825-4145-be46-f4028df2a727,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc3ba814-a8') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG os_vif [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=bc3ba814-a825-4145-be46-f4028df2a727,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc3ba814-a8') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc3ba814-a8, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6dfec64a-cf90-46cd-9504-6a037bb74c34) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:21:10 user nova-compute[75071]: INFO os_vif [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=bc3ba814-a825-4145-be46-f4028df2a727,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc3ba814-a8')
Dec 05 12:21:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Deleting instance files /opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a_del
Dec 05 12:21:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Deletion of /opt/stack/data/nova/instances/46d74901-9224-4575-956b-de5c92580f8a_del complete
Dec 05 12:21:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:10 user nova-compute[75071]: INFO nova.compute.manager [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Took 1.04 seconds to destroy the instance on the hypervisor.
Dec 05 12:21:10 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 46d74901-9224-4575-956b-de5c92580f8a] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:21:12 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Took 1.29 seconds to deallocate network for instance.
Dec 05 12:21:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Received event network-vif-plugged-bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] Acquiring lock "46d74901-9224-4575-956b-de5c92580f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] Lock "46d74901-9224-4575-956b-de5c92580f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] Lock "46d74901-9224-4575-956b-de5c92580f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] No waiting events found dispatching network-vif-plugged-bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:21:12 user nova-compute[75071]: WARNING nova.compute.manager [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Received unexpected event network-vif-plugged-bc3ba814-a825-4145-be46-f4028df2a727 for instance with vm_state deleted and task_state None.
Dec 05 12:21:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Received event network-vif-plugged-bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] Acquiring lock "46d74901-9224-4575-956b-de5c92580f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] Lock "46d74901-9224-4575-956b-de5c92580f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] Lock "46d74901-9224-4575-956b-de5c92580f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] No waiting events found dispatching network-vif-plugged-bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:21:12 user nova-compute[75071]: WARNING nova.compute.manager [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Received unexpected event network-vif-plugged-bc3ba814-a825-4145-be46-f4028df2a727 for instance with vm_state deleted and task_state None.
Dec 05 12:21:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Received event network-vif-plugged-bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] Acquiring lock "46d74901-9224-4575-956b-de5c92580f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] Lock "46d74901-9224-4575-956b-de5c92580f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] Lock "46d74901-9224-4575-956b-de5c92580f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] No waiting events found dispatching network-vif-plugged-bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:21:12 user nova-compute[75071]: WARNING nova.compute.manager [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Received unexpected event network-vif-plugged-bc3ba814-a825-4145-be46-f4028df2a727 for instance with vm_state deleted and task_state None.
Dec 05 12:21:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Received event network-vif-unplugged-bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] Acquiring lock "46d74901-9224-4575-956b-de5c92580f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] Lock "46d74901-9224-4575-956b-de5c92580f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] Lock "46d74901-9224-4575-956b-de5c92580f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] No waiting events found dispatching network-vif-unplugged-bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:21:12 user nova-compute[75071]: WARNING nova.compute.manager [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Received unexpected event network-vif-unplugged-bc3ba814-a825-4145-be46-f4028df2a727 for instance with vm_state deleted and task_state None.
Dec 05 12:21:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Received event network-vif-plugged-bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] Acquiring lock "46d74901-9224-4575-956b-de5c92580f8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] Lock "46d74901-9224-4575-956b-de5c92580f8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] Lock "46d74901-9224-4575-956b-de5c92580f8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] No waiting events found dispatching network-vif-plugged-bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:21:12 user nova-compute[75071]: WARNING nova.compute.manager [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Received unexpected event network-vif-plugged-bc3ba814-a825-4145-be46-f4028df2a727 for instance with vm_state deleted and task_state None.
Dec 05 12:21:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-44908214-852d-46f0-9387-6ee148a3191d req-3ff95a92-e3f5-4c14-a4f1-a78f2e4d0090 service nova] [instance: 46d74901-9224-4575-956b-de5c92580f8a] Received event network-vif-deleted-bc3ba814-a825-4145-be46-f4028df2a727 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:21:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:12 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Deleted allocations for instance 46d74901-9224-4575-956b-de5c92580f8a
Dec 05 12:21:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1840ddd5-4aa1-4c95-8fae-1df0260dc9c1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "46d74901-9224-4575-956b-de5c92580f8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.904s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquiring lock "10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:21:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:21:22 user nova-compute[75071]: INFO nova.compute.claims [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Claim successful on node user
Dec 05 12:21:22 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:21:22 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:21:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:21:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:21:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:21:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:21:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:21:22 user nova-compute[75071]: DEBUG nova.policy [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '44a85d29f03344119f15021c037ae5e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dce66477a63c44ac8df4b147456f3653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:21:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:21:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:21:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Creating image(s)
Dec 05 12:21:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquiring lock "/opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "/opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "/opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Successfully created port: cc59b402-1e5e-42ad-baf9-ab91fc3b0055 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.218s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/disk 1073741824" returned: 0 in 0.054s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Cannot resize image /opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Ensure instance console log exists: /opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Successfully updated port: cc59b402-1e5e-42ad-baf9-ab91fc3b0055 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquiring lock "refresh_cache-10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquired lock "refresh_cache-10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-6e4fedb0-0f79-48c5-a4b5-fc3ece69dac0 req-7b0295b1-bbe2-4aea-983b-65e4a469dc41 service nova] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Received event network-changed-cc59b402-1e5e-42ad-baf9-ab91fc3b0055 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-6e4fedb0-0f79-48c5-a4b5-fc3ece69dac0 req-7b0295b1-bbe2-4aea-983b-65e4a469dc41 service nova] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Refreshing instance network info cache due to event network-changed-cc59b402-1e5e-42ad-baf9-ab91fc3b0055. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6e4fedb0-0f79-48c5-a4b5-fc3ece69dac0 req-7b0295b1-bbe2-4aea-983b-65e4a469dc41 service nova] Acquiring lock "refresh_cache-10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Updating instance_info_cache with network_info: [{"id": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "address": "fa:16:3e:34:0f:1d", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc59b402-1e", "ovs_interfaceid": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Releasing lock "refresh_cache-10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Instance network_info: |[{"id": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "address": "fa:16:3e:34:0f:1d", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc59b402-1e", "ovs_interfaceid": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6e4fedb0-0f79-48c5-a4b5-fc3ece69dac0 req-7b0295b1-bbe2-4aea-983b-65e4a469dc41 service nova] Acquired lock "refresh_cache-10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.network.neutron [req-6e4fedb0-0f79-48c5-a4b5-fc3ece69dac0 req-7b0295b1-bbe2-4aea-983b-65e4a469dc41 service nova] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Refreshing network info cache for port cc59b402-1e5e-42ad-baf9-ab91fc3b0055 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Start _get_guest_xml network_info=[{"id": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "address": "fa:16:3e:34:0f:1d", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc59b402-1e", "ovs_interfaceid": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:21:24 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:21:24 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:21:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1362406998',display_name='tempest-VolumesActionsTest-instance-1362406998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1362406998',id=16,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dce66477a63c44ac8df4b147456f3653',ramdisk_id='',reservation_id='r-tibipm47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-128873361',owner_user_name='tempest-VolumesActionsTest-128873361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:21:23Z,user_data=None,user_id='44a85d29f03344119f15021c037ae5e0',uuid=10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "address": "fa:16:3e:34:0f:1d", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc59b402-1e", "ovs_interfaceid": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Converting VIF {"id": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "address": "fa:16:3e:34:0f:1d", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc59b402-1e", "ovs_interfaceid": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:0f:1d,bridge_name='br-int',has_traffic_filtering=True,id=cc59b402-1e5e-42ad-baf9-ab91fc3b0055,network=Network(a5b2962d-4c1e-40d6-adc0-ea51e41d06a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc59b402-1e') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lazy-loading 'pci_devices' on Instance uuid 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:21:24 user nova-compute[75071]:   <uuid>10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9</uuid>
Dec 05 12:21:24 user nova-compute[75071]:   <name>instance-00000010</name>
Dec 05 12:21:24 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:21:24 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:21:24 user nova-compute[75071]:   <metadata>
Dec 05 12:21:24 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:21:24 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:21:24 user nova-compute[75071]:       <nova:name>tempest-VolumesActionsTest-instance-1362406998</nova:name>
Dec 05 12:21:24 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:21:24</nova:creationTime>
Dec 05 12:21:24 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:21:24 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:21:24 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:21:24 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:21:24 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:21:24 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:21:24 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:21:24 user nova-compute[75071]:       <nova:owner>
Dec 05 12:21:24 user nova-compute[75071]:         <nova:user uuid="44a85d29f03344119f15021c037ae5e0">tempest-VolumesActionsTest-128873361-project-member</nova:user>
Dec 05 12:21:24 user nova-compute[75071]:         <nova:project uuid="dce66477a63c44ac8df4b147456f3653">tempest-VolumesActionsTest-128873361</nova:project>
Dec 05 12:21:24 user nova-compute[75071]:       </nova:owner>
Dec 05 12:21:24 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:21:24 user nova-compute[75071]:       <nova:ports>
Dec 05 12:21:24 user nova-compute[75071]:         <nova:port uuid="cc59b402-1e5e-42ad-baf9-ab91fc3b0055">
Dec 05 12:21:24 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 12:21:24 user nova-compute[75071]:         </nova:port>
Dec 05 12:21:24 user nova-compute[75071]:       </nova:ports>
Dec 05 12:21:24 user nova-compute[75071]:     </nova:instance>
Dec 05 12:21:24 user nova-compute[75071]:   </metadata>
Dec 05 12:21:24 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:21:24 user nova-compute[75071]:     <system>
Dec 05 12:21:24 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:21:24 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:21:24 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:21:24 user nova-compute[75071]:       <entry name="serial">10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9</entry>
Dec 05 12:21:24 user nova-compute[75071]:       <entry name="uuid">10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9</entry>
Dec 05 12:21:24 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:21:24 user nova-compute[75071]:     </system>
Dec 05 12:21:24 user nova-compute[75071]:   </sysinfo>
Dec 05 12:21:24 user nova-compute[75071]:   <os>
Dec 05 12:21:24 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:21:24 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:21:24 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:21:24 user nova-compute[75071]:   </os>
Dec 05 12:21:24 user nova-compute[75071]:   <features>
Dec 05 12:21:24 user nova-compute[75071]:     <acpi/>
Dec 05 12:21:24 user nova-compute[75071]:     <apic/>
Dec 05 12:21:24 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:21:24 user nova-compute[75071]:   </features>
Dec 05 12:21:24 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:21:24 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:21:24 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:21:24 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:21:24 user nova-compute[75071]:   </clock>
Dec 05 12:21:24 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:21:24 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:21:24 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:21:24 user nova-compute[75071]:   </cpu>
Dec 05 12:21:24 user nova-compute[75071]:   <devices>
Dec 05 12:21:24 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:21:24 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:21:24 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/disk"/>
Dec 05 12:21:24 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:21:24 user nova-compute[75071]:     </disk>
Dec 05 12:21:24 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:21:24 user nova-compute[75071]:       <mac address="fa:16:3e:34:0f:1d"/>
Dec 05 12:21:24 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:21:24 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:21:24 user nova-compute[75071]:       <target dev="tapcc59b402-1e"/>
Dec 05 12:21:24 user nova-compute[75071]:     </interface>
Dec 05 12:21:24 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:21:24 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/console.log" append="off"/>
Dec 05 12:21:24 user nova-compute[75071]:     </serial>
Dec 05 12:21:24 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:21:24 user nova-compute[75071]:     <video>
Dec 05 12:21:24 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:21:24 user nova-compute[75071]:     </video>
Dec 05 12:21:24 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:21:24 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:21:24 user nova-compute[75071]:     </rng>
Dec 05 12:21:24 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:21:24 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:21:24 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:21:24 user nova-compute[75071]:     </memballoon>
Dec 05 12:21:24 user nova-compute[75071]:   </devices>
Dec 05 12:21:24 user nova-compute[75071]: </domain>
Dec 05 12:21:24 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:21:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1362406998',display_name='tempest-VolumesActionsTest-instance-1362406998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1362406998',id=16,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dce66477a63c44ac8df4b147456f3653',ramdisk_id='',reservation_id='r-tibipm47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-128873361',owner_user_name='tempest-VolumesActionsTest-128873361-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:21:23Z,user_data=None,user_id='44a85d29f03344119f15021c037ae5e0',uuid=10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "address": "fa:16:3e:34:0f:1d", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc59b402-1e", "ovs_interfaceid": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Converting VIF {"id": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "address": "fa:16:3e:34:0f:1d", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc59b402-1e", "ovs_interfaceid": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:0f:1d,bridge_name='br-int',has_traffic_filtering=True,id=cc59b402-1e5e-42ad-baf9-ab91fc3b0055,network=Network(a5b2962d-4c1e-40d6-adc0-ea51e41d06a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc59b402-1e') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG os_vif [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:0f:1d,bridge_name='br-int',has_traffic_filtering=True,id=cc59b402-1e5e-42ad-baf9-ab91fc3b0055,network=Network(a5b2962d-4c1e-40d6-adc0-ea51e41d06a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc59b402-1e') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f5c19c6-ed6a-5c81-a6e5-d6c9bc59e71f', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc59b402-1e, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc59b402-1e, col_values=(('qos', UUID('a63c9b22-fe19-4523-a8af-a1cc2acb0d73')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc59b402-1e, col_values=(('external_ids', {'iface-id': 'cc59b402-1e5e-42ad-baf9-ab91fc3b0055', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:0f:1d', 'vm-uuid': '10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:24 user nova-compute[75071]: INFO os_vif [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:0f:1d,bridge_name='br-int',has_traffic_filtering=True,id=cc59b402-1e5e-42ad-baf9-ab91fc3b0055,network=Network(a5b2962d-4c1e-40d6-adc0-ea51e41d06a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc59b402-1e')
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:21:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] No VIF found with MAC fa:16:3e:34:0f:1d, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:21:25 user nova-compute[75071]: DEBUG nova.network.neutron [req-6e4fedb0-0f79-48c5-a4b5-fc3ece69dac0 req-7b0295b1-bbe2-4aea-983b-65e4a469dc41 service nova] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Updated VIF entry in instance network info cache for port cc59b402-1e5e-42ad-baf9-ab91fc3b0055. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:21:25 user nova-compute[75071]: DEBUG nova.network.neutron [req-6e4fedb0-0f79-48c5-a4b5-fc3ece69dac0 req-7b0295b1-bbe2-4aea-983b-65e4a469dc41 service nova] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Updating instance_info_cache with network_info: [{"id": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "address": "fa:16:3e:34:0f:1d", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc59b402-1e", "ovs_interfaceid": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:21:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6e4fedb0-0f79-48c5-a4b5-fc3ece69dac0 req-7b0295b1-bbe2-4aea-983b-65e4a469dc41 service nova] Releasing lock "refresh_cache-10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:21:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-8aa7bd1d-340a-4186-a956-119d6ca023cd req-cbb967a6-19c6-4c62-9d49-49055c43047c service nova] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Received event network-vif-plugged-cc59b402-1e5e-42ad-baf9-ab91fc3b0055 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8aa7bd1d-340a-4186-a956-119d6ca023cd req-cbb967a6-19c6-4c62-9d49-49055c43047c service nova] Acquiring lock "10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8aa7bd1d-340a-4186-a956-119d6ca023cd req-cbb967a6-19c6-4c62-9d49-49055c43047c service nova] Lock "10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8aa7bd1d-340a-4186-a956-119d6ca023cd req-cbb967a6-19c6-4c62-9d49-49055c43047c service nova] Lock "10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-8aa7bd1d-340a-4186-a956-119d6ca023cd req-cbb967a6-19c6-4c62-9d49-49055c43047c service nova] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] No waiting events found dispatching network-vif-plugged-cc59b402-1e5e-42ad-baf9-ab91fc3b0055 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:21:26 user nova-compute[75071]: WARNING nova.compute.manager [req-8aa7bd1d-340a-4186-a956-119d6ca023cd req-cbb967a6-19c6-4c62-9d49-49055c43047c service nova] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Received unexpected event network-vif-plugged-cc59b402-1e5e-42ad-baf9-ab91fc3b0055 for instance with vm_state building and task_state spawning.
Dec 05 12:21:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:21:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:21:28 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Instance spawned successfully.
Dec 05 12:21:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:21:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:21:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:21:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:21:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:21:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:21:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:21:28 user nova-compute[75071]: INFO nova.compute.manager [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Took 5.57 seconds to spawn the instance on the hypervisor.
Dec 05 12:21:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:21:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec76c6b1-b4e8-4547-a177-769ed1e62696 req-fc8add51-2321-417a-b2b5-3470148b1241 service nova] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Received event network-vif-plugged-cc59b402-1e5e-42ad-baf9-ab91fc3b0055 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec76c6b1-b4e8-4547-a177-769ed1e62696 req-fc8add51-2321-417a-b2b5-3470148b1241 service nova] Acquiring lock "10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec76c6b1-b4e8-4547-a177-769ed1e62696 req-fc8add51-2321-417a-b2b5-3470148b1241 service nova] Lock "10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec76c6b1-b4e8-4547-a177-769ed1e62696 req-fc8add51-2321-417a-b2b5-3470148b1241 service nova] Lock "10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec76c6b1-b4e8-4547-a177-769ed1e62696 req-fc8add51-2321-417a-b2b5-3470148b1241 service nova] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] No waiting events found dispatching network-vif-plugged-cc59b402-1e5e-42ad-baf9-ab91fc3b0055 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:21:28 user nova-compute[75071]: WARNING nova.compute.manager [req-ec76c6b1-b4e8-4547-a177-769ed1e62696 req-fc8add51-2321-417a-b2b5-3470148b1241 service nova] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Received unexpected event network-vif-plugged-cc59b402-1e5e-42ad-baf9-ab91fc3b0055 for instance with vm_state active and task_state None.
Dec 05 12:21:28 user nova-compute[75071]: INFO nova.compute.manager [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Took 6.50 seconds to build instance.
Dec 05 12:21:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b0aa28d3-8529-4ef8-b996-ac11a3e146f4 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.660s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:21:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:39 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:21:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:44 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:21:44 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:21:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=7597MB free_disk=25.325149536132812GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:21:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 81333acc-8dc7-42f1-9026-e42a30e52a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:21:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e08be776-0fa9-4871-86eb-2093530c00f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:21:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:21:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 854ee980-5c0b-4c4f-b9fd-609720e693be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:21:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c9e37746-57e8-4053-9f52-2c60bab457fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:21:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 62efa94c-ae01-48aa-b3d3-0d23d159801c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:21:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 12b75ed0-0ac3-4d19-bc01-c4ab10fff348 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:21:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 22a59c32-0b4a-4f5a-92bb-79c2882b515a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:21:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:21:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:21:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:21:44 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:21:44 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:21:44 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:21:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.520s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-0e077d37-7417-4fe2-833c-797b8470f784 req-8b0ab2cf-cf09-4a09-96fe-97741f52624c service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Received event network-changed-dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:21:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-0e077d37-7417-4fe2-833c-797b8470f784 req-8b0ab2cf-cf09-4a09-96fe-97741f52624c service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Refreshing instance network info cache due to event network-changed-dfd9ba38-13c3-423b-81d9-8fd813ca2acd. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0e077d37-7417-4fe2-833c-797b8470f784 req-8b0ab2cf-cf09-4a09-96fe-97741f52624c service nova] Acquiring lock "refresh_cache-62efa94c-ae01-48aa-b3d3-0d23d159801c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:21:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0e077d37-7417-4fe2-833c-797b8470f784 req-8b0ab2cf-cf09-4a09-96fe-97741f52624c service nova] Acquired lock "refresh_cache-62efa94c-ae01-48aa-b3d3-0d23d159801c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:21:45 user nova-compute[75071]: DEBUG nova.network.neutron [req-0e077d37-7417-4fe2-833c-797b8470f784 req-8b0ab2cf-cf09-4a09-96fe-97741f52624c service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Refreshing network info cache for port dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:21:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:21:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:21:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 12:21:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:21:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:21:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:21:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:21:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:21:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:21:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG nova.network.neutron [req-0e077d37-7417-4fe2-833c-797b8470f784 req-8b0ab2cf-cf09-4a09-96fe-97741f52624c service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Updated VIF entry in instance network info cache for port dfd9ba38-13c3-423b-81d9-8fd813ca2acd. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG nova.network.neutron [req-0e077d37-7417-4fe2-833c-797b8470f784 req-8b0ab2cf-cf09-4a09-96fe-97741f52624c service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Updating instance_info_cache with network_info: [{"id": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "address": "fa:16:3e:8f:a8:2b", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9ba38-13", "ovs_interfaceid": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0e077d37-7417-4fe2-833c-797b8470f784 req-8b0ab2cf-cf09-4a09-96fe-97741f52624c service nova] Releasing lock "refresh_cache-62efa94c-ae01-48aa-b3d3-0d23d159801c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "62efa94c-ae01-48aa-b3d3-0d23d159801c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG nova.objects.instance [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lazy-loading 'flavor' on Instance uuid 62efa94c-ae01-48aa-b3d3-0d23d159801c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "62efa94c-ae01-48aa-b3d3-0d23d159801c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:21:46 user nova-compute[75071]: INFO nova.compute.manager [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Attaching volume cc309cdc-014c-42c9-b515-3a094b0638be to /dev/vdb
Dec 05 12:21:46 user nova-compute[75071]: DEBUG os_brick.utils [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d97f8e-eeb8-46b4-9fbc-9b3b4fd0f0eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[35731d70-1ffe-499a-bc5b-63e25d13bf1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a98a021-2d3b-412e-940e-9f0b903079f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2cb368-0b62-4789-86d1-32848de315b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:21:46 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:21:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b52cf3-2b3f-43fd-b291-295e1c3e66b6]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG os_brick.utils [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:21:46 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Updating existing volume attachment record: b9fb4e09-aa95-45e5-9acd-79e77aa0428d {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:21:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:21:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoTiarDB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:22:00 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:22:00 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:22:00 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b742253-921d-4848-90db-25f95b9e03a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:22:00 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46dc19c-67f8-4faa-b533-553e01f3f296]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be] added
Dec 05 12:22:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[667dd692-b834-45f4-b01d-0853d2cb11a2]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa55f1ba-60cb-49c9-ac30-5d99a9017083]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hoTiarDB {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hoTiarDB" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e97326-9829-4b90-a256-747eded4ef8b]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hoTiarDB'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb254755-3277-45c6-ad4d-1c57623c10f1]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a4cd6e-5cc9-428f-a241-30ec5fbc1782]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:22:00 user nova-compute[75071]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:22:00 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:22:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:22:00 user nova-compute[75071]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:22:00 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:22:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8396f0f-9e21-4f2d-b0ab-bd62f5c4d224]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be, portal: 172.16.0.220,3260]
Dec 05 12:22:00 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be, portal: 172.16.0.220,3260] successful.
Dec 05 12:22:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ce3cfb-9374-407a-814b-9656deb26c24]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[96547f86-ccfa-49d3-8538-518351a2b505]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:22:00 user nova-compute[75071]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:22:00 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:22:00 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:22:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:22:00 user nova-compute[75071]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:22:00 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:22:00 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:22:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[50393fc7-05d8-4593-b6e8-9858612d6ca8]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:22:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoTiarDB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:22:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "81333acc-8dc7-42f1-9026-e42a30e52a5a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:01 user nova-compute[75071]: INFO nova.compute.manager [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Detaching volume 93490fef-282f-4f1b-bc4e-0489b01f710c
Dec 05 12:22:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:22:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] <== connect_volume: return (1418ms) {'type': 'block', 'scsi_wwn': '26366616437636535', 'path': '/dev/sdd'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:22:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366616437636535', 'path': '/dev/sdd'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:22:01 user nova-compute[75071]: DEBUG nova.objects.instance [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lazy-loading 'flavor' on Instance uuid 62efa94c-ae01-48aa-b3d3-0d23d159801c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:22:01 user nova-compute[75071]: INFO nova.virt.block_device [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Attempting to driver detach volume 93490fef-282f-4f1b-bc4e-0489b01f710c from mountpoint /dev/vdb
Dec 05 12:22:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:22:01 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:22:01 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Dec 05 12:22:01 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:22:01 user nova-compute[75071]:   <serial>cc309cdc-014c-42c9-b515-3a094b0638be</serial>
Dec 05 12:22:01 user nova-compute[75071]: </disk>
Dec 05 12:22:01 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:22:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Attempting to detach device vdb from instance 81333acc-8dc7-42f1-9026-e42a30e52a5a from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:22:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:22:02 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:22:02 user nova-compute[75071]:   <source dev="/dev/sdi"/>
Dec 05 12:22:02 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:22:02 user nova-compute[75071]:   <serial>93490fef-282f-4f1b-bc4e-0489b01f710c</serial>
Dec 05 12:22:02 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:22:02 user nova-compute[75071]: </disk>
Dec 05 12:22:02 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:22:02 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Successfully detached device vdb from instance 81333acc-8dc7-42f1-9026-e42a30e52a5a from the persistent domain config.
Dec 05 12:22:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 81333acc-8dc7-42f1-9026-e42a30e52a5a from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:22:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:22:02 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:22:02 user nova-compute[75071]:   <source dev="/dev/sdi"/>
Dec 05 12:22:02 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:22:02 user nova-compute[75071]:   <serial>93490fef-282f-4f1b-bc4e-0489b01f710c</serial>
Dec 05 12:22:02 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:22:02 user nova-compute[75071]: </disk>
Dec 05 12:22:02 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:22:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:22:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:22:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] No VIF found with MAC fa:16:3e:8f:a8:2b, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:22:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 81333acc-8dc7-42f1-9026-e42a30e52a5a {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:22:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-91de5763-9739-4277-b719-d21cd15491e3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.252s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:04 user nova-compute[75071]: INFO nova.compute.manager [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Rebuilding instance
Dec 05 12:22:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:22:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-ed0c90a2-5ac9-4d94-a203-9fa3f8594e01 req-29b8791f-1f59-40bb-a4c3-9ab2b7343b31 service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Received event network-vif-unplugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ed0c90a2-5ac9-4d94-a203-9fa3f8594e01 req-29b8791f-1f59-40bb-a4c3-9ab2b7343b31 service nova] Acquiring lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ed0c90a2-5ac9-4d94-a203-9fa3f8594e01 req-29b8791f-1f59-40bb-a4c3-9ab2b7343b31 service nova] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ed0c90a2-5ac9-4d94-a203-9fa3f8594e01 req-29b8791f-1f59-40bb-a4c3-9ab2b7343b31 service nova] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-ed0c90a2-5ac9-4d94-a203-9fa3f8594e01 req-29b8791f-1f59-40bb-a4c3-9ab2b7343b31 service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] No waiting events found dispatching network-vif-unplugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:22:05 user nova-compute[75071]: WARNING nova.compute.manager [req-ed0c90a2-5ac9-4d94-a203-9fa3f8594e01 req-29b8791f-1f59-40bb-a4c3-9ab2b7343b31 service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Received unexpected event network-vif-unplugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd for instance with vm_state active and task_state rebuilding.
Dec 05 12:22:05 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Instance destroyed successfully.
Dec 05 12:22:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:05 user nova-compute[75071]: INFO nova.compute.manager [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Detaching volume cc309cdc-014c-42c9-b515-3a094b0638be
Dec 05 12:22:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:05 user nova-compute[75071]: INFO nova.virt.block_device [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Attempting to driver detach volume cc309cdc-014c-42c9-b515-3a094b0638be from mountpoint /dev/vdb
Dec 05 12:22:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Attempting to detach device vdb from instance 62efa94c-ae01-48aa-b3d3-0d23d159801c from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:22:05 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:22:05 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Dec 05 12:22:05 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:22:05 user nova-compute[75071]:   <serial>cc309cdc-014c-42c9-b515-3a094b0638be</serial>
Dec 05 12:22:05 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:22:05 user nova-compute[75071]: </disk>
Dec 05 12:22:05 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:22:05 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Successfully detached device vdb from instance 62efa94c-ae01-48aa-b3d3-0d23d159801c from the persistent domain config.
Dec 05 12:22:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoTiarDB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:22:05 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 12:22:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[defb0226-0e27-4f68-871d-be9c74eba019]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:22:05 user nova-compute[75071]: No targets found.
Dec 05 12:22:05 user nova-compute[75071]: iSNS:
Dec 05 12:22:05 user nova-compute[75071]: No targets found.
Dec 05 12:22:05 user nova-compute[75071]: STATIC:
Dec 05 12:22:05 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c
Dec 05 12:22:05 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:22:05 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:22:05 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:22:05 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:22:05 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:22:05 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665
Dec 05 12:22:05 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:22:05 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:22:05 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be
Dec 05 12:22:05 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:22:05 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:22:05 user nova-compute[75071]: FIRMWARE:
Dec 05 12:22:05 user nova-compute[75071]: No targets found.
Dec 05 12:22:05 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:22:05 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:22:05 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c20ca6-1271-4643-8722-5d7626dbd64f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce397827-368a-4941-a032-9d2411ec77d7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:22:05 user nova-compute[75071]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:22:05 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:22:05 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:22:05 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:22:05 user nova-compute[75071]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:22:05 user nova-compute[75071]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:22:05 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:22:05 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8264139090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be'): ({'sdd'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Removing single pathed devices sdd {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7709681-be69-4b92-9cf7-ac7a1bc599f0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b126e18-c6b4-41d9-8ccf-6c8ce4113e20]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Flushing IO for device /dev/sdd {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76264ea-8eee-4a21-ab50-ce89d818b8d2]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd93529-dea5-4764-9b95-7d9c320837fb]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:22:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a5ea6b-f76a-448b-8c78-9a2403d5d95d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2015f284-a266-4d22-a424-9e0de7d8e77d]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be, portal: 172.16.0.220,3260]
Dec 05 12:22:06 user nova-compute[75071]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be, portal: 172.16.0.220,3260] successful.
Dec 05 12:22:06 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1e8c3a-3f13-4e29-bb2c-58d148f7f6da]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:22:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] <== disconnect_volume: return (336ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:22:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:22:07 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Instance destroyed successfully.
Dec 05 12:22:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1207590253',display_name='tempest-ServerActionsTestOtherA-server-233404088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1207590253',id=13,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk/2CR5ryCdFhnzY7TEoYapKL803/W+14EuHBFh/Bn1ydNJw/5MkJqSTVw47d32v20VlRqVYqCUpZ+R3KOMF8XfpJIXjWBmPbrx5vIAMBConykgFyc0rPSXZyqCSasrlQ==',key_name='tempest-keypair-858510286',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:20:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='59b6bfae34944fcfbd49d2f18b232ec8',ramdisk_id='',reservation_id='r-6o3c9k6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1523780015',owner_user_name='tempest-ServerActionsTestOtherA-1523780015-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:22:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e73e24d5b1489c813f06690b12eef4',uuid=62efa94c-ae01-48aa-b3d3-0d23d159801c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "address": "fa:16:3e:8f:a8:2b", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9ba38-13", "ovs_interfaceid": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converting VIF {"id": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "address": "fa:16:3e:8f:a8:2b", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9ba38-13", "ovs_interfaceid": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=dfd9ba38-13c3-423b-81d9-8fd813ca2acd,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9ba38-13') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG os_vif [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=dfd9ba38-13c3-423b-81d9-8fd813ca2acd,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9ba38-13') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfd9ba38-13, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21b5ca07-f7e6-45bd-a68c-eec7fe30c1d0) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:22:07 user nova-compute[75071]: INFO os_vif [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=dfd9ba38-13c3-423b-81d9-8fd813ca2acd,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9ba38-13')
Dec 05 12:22:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoTiarDB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:22:07 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 12:22:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-33715cf7-ea7f-4114-aee7-d4548d46860f req-597a16e2-eec5-470d-b79d-7e0e793924fe service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Received event network-vif-plugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-33715cf7-ea7f-4114-aee7-d4548d46860f req-597a16e2-eec5-470d-b79d-7e0e793924fe service nova] Acquiring lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-33715cf7-ea7f-4114-aee7-d4548d46860f req-597a16e2-eec5-470d-b79d-7e0e793924fe service nova] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-33715cf7-ea7f-4114-aee7-d4548d46860f req-597a16e2-eec5-470d-b79d-7e0e793924fe service nova] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-33715cf7-ea7f-4114-aee7-d4548d46860f req-597a16e2-eec5-470d-b79d-7e0e793924fe service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] No waiting events found dispatching network-vif-plugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:22:07 user nova-compute[75071]: WARNING nova.compute.manager [req-33715cf7-ea7f-4114-aee7-d4548d46860f req-597a16e2-eec5-470d-b79d-7e0e793924fe service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Received unexpected event network-vif-plugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd for instance with vm_state active and task_state rebuilding.
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[305824ad-8cfa-4382-bc4d-17854dbf2312]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:22:07 user nova-compute[75071]: No targets found.
Dec 05 12:22:07 user nova-compute[75071]: iSNS:
Dec 05 12:22:07 user nova-compute[75071]: No targets found.
Dec 05 12:22:07 user nova-compute[75071]: STATIC:
Dec 05 12:22:07 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c
Dec 05 12:22:07 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:22:07 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:22:07 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:22:07 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:22:07 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:22:07 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665
Dec 05 12:22:07 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:22:07 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:22:07 user nova-compute[75071]: FIRMWARE:
Dec 05 12:22:07 user nova-compute[75071]: No targets found.
Dec 05 12:22:07 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:22:07 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:22:07 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f4402f-5af0-461e-9de6-99d7e15f08da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f11d89-2fd2-44f6-b1f7-860d477bcdc9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:22:07 user nova-compute[75071]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:22:07 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:22:07 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:22:07 user nova-compute[75071]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:22:07 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:22:07 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82641a44c0>, {}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Disconnecting from: [] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.089s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] <== disconnect_volume: return (90ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:22:07 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Deleting instance files /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c_del
Dec 05 12:22:07 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Deletion of /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c_del complete
Dec 05 12:22:07 user nova-compute[75071]: INFO nova.virt.block_device [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Booting with volume cc309cdc-014c-42c9-b515-3a094b0638be at /dev/vdb
Dec 05 12:22:07 user nova-compute[75071]: DEBUG os_brick.utils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fbef99-43ca-4e0c-97e0-285321fd868b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81f14ae-9be2-4f4c-a8a1-2d244e3c84c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e09a1b-feda-4131-9a2d-3e74418da3a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1417a670-7c17-481a-a68a-b5f6accff1f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:22:07 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:22:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc645ff-f3f4-429e-bac6-a140ff6b4ae8]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG os_brick.utils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:22:07 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Updating existing volume attachment record: e09d1b93-6311-45e5-bc7c-032ddbeca2e1 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:22:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "12b75ed0-0ac3-4d19-bc01-c4ab10fff348" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "12b75ed0-0ac3-4d19-bc01-c4ab10fff348" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "12b75ed0-0ac3-4d19-bc01-c4ab10fff348-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "12b75ed0-0ac3-4d19-bc01-c4ab10fff348-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "12b75ed0-0ac3-4d19-bc01-c4ab10fff348-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:10 user nova-compute[75071]: INFO nova.compute.manager [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Terminating instance
Dec 05 12:22:10 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Acquiring lock "c9e37746-57e8-4053-9f52-2c60bab457fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Acquiring lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:10 user nova-compute[75071]: INFO nova.compute.manager [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Terminating instance
Dec 05 12:22:10 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Instance destroyed successfully.
Dec 05 12:22:10 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lazy-loading 'resources' on Instance uuid 12b75ed0-0ac3-4d19-bc01-c4ab10fff348 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:20:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1687301094',display_name='tempest-VolumesAdminNegativeTest-server-1687301094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1687301094',id=14,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:20:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80bbd8689228459cb4bf4e93caebbf39',ramdisk_id='',reservation_id='r-9of61e9s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1655468341',owner_user_name='tempest-VolumesAdminNegativeTest-1655468341-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:20:17Z,user_data=None,user_id='d5aa0fe91fac4908b24204673a6c3af1',uuid=12b75ed0-0ac3-4d19-bc01-c4ab10fff348,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75e40851-836c-42a3-8153-b071589a4f6e", "address": "fa:16:3e:e0:76:c0", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e40851-83", "ovs_interfaceid": "75e40851-836c-42a3-8153-b071589a4f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Converting VIF {"id": "75e40851-836c-42a3-8153-b071589a4f6e", "address": "fa:16:3e:e0:76:c0", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75e40851-83", "ovs_interfaceid": "75e40851-836c-42a3-8153-b071589a4f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:76:c0,bridge_name='br-int',has_traffic_filtering=True,id=75e40851-836c-42a3-8153-b071589a4f6e,network=Network(30520b35-382e-42c5-8395-8dddfacb2b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e40851-83') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG os_vif [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:76:c0,bridge_name='br-int',has_traffic_filtering=True,id=75e40851-836c-42a3-8153-b071589a4f6e,network=Network(30520b35-382e-42c5-8395-8dddfacb2b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e40851-83') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75e40851-83, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=596d7860-bc52-46d6-b049-fc37b318dee1) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:10 user nova-compute[75071]: INFO os_vif [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:76:c0,bridge_name='br-int',has_traffic_filtering=True,id=75e40851-836c-42a3-8153-b071589a4f6e,network=Network(30520b35-382e-42c5-8395-8dddfacb2b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75e40851-83')
Dec 05 12:22:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Deleting instance files /opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348_del
Dec 05 12:22:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Deletion of /opt/stack/data/nova/instances/12b75ed0-0ac3-4d19-bc01-c4ab10fff348_del complete
Dec 05 12:22:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:11 user nova-compute[75071]: INFO nova.compute.manager [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Took 0.92 seconds to destroy the instance on the hypervisor.
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:22:11 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Instance destroyed successfully.
Dec 05 12:22:11 user nova-compute[75071]: DEBUG nova.objects.instance [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lazy-loading 'resources' on Instance uuid c9e37746-57e8-4053-9f52-2c60bab457fa {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T12:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1647147359',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1669594796',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJ6xZ5XBcUwxREIE7hpriVQZ0cMhVgvH0PlAMEkl0iPK+uJVd0fd5PCbz5I6L/042zo6fYM5B8tUUzAdxDa0FSOpcGykYLgtM0hDjxMaWQcHYNldfHmf9IbWnr2VIyMRg==',key_name='tempest-keypair-106536343',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:20:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6a14095bd354df1b0be6e89cd2e0b5a',ramdisk_id='',reservation_id='r-9ic0uf1k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1195759080',owner_user_name='tempest-ServerActionsV293TestJSON-1195759080-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:20:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='596a8048e44c4f5985956bba2b06aba7',uuid=c9e37746-57e8-4053-9f52-2c60bab457fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "address": "fa:16:3e:7b:99:8a", "network": {"id": "8f9b3ec7-df46-410f-8603-4e4ce082275b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-988513444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a14095bd354df1b0be6e89cd2e0b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c36d-f0", "ovs_interfaceid": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Converting VIF {"id": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "address": "fa:16:3e:7b:99:8a", "network": {"id": "8f9b3ec7-df46-410f-8603-4e4ce082275b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-988513444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6a14095bd354df1b0be6e89cd2e0b5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape148c36d-f0", "ovs_interfaceid": "e148c36d-f01c-41e2-8e2e-082e023af6fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=e148c36d-f01c-41e2-8e2e-082e023af6fb,network=Network(8f9b3ec7-df46-410f-8603-4e4ce082275b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c36d-f0') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_vif [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=e148c36d-f01c-41e2-8e2e-082e023af6fb,network=Network(8f9b3ec7-df46-410f-8603-4e4ce082275b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c36d-f0') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape148c36d-f0, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d07996ee-7e1a-41c7-baca-6674696867f9) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:22:11 user nova-compute[75071]: INFO os_vif [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:99:8a,bridge_name='br-int',has_traffic_filtering=True,id=e148c36d-f01c-41e2-8e2e-082e023af6fb,network=Network(8f9b3ec7-df46-410f-8603-4e4ce082275b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape148c36d-f0')
Dec 05 12:22:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gmdYpkry', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:22:11 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5f93b5-cd55-4ae7-a0ca-570d4102ee1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:22:11 user nova-compute[75071]: No targets found.
Dec 05 12:22:11 user nova-compute[75071]: iSNS:
Dec 05 12:22:11 user nova-compute[75071]: No targets found.
Dec 05 12:22:11 user nova-compute[75071]: STATIC:
Dec 05 12:22:11 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c
Dec 05 12:22:11 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:22:11 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:22:11 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:22:11 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:22:11 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:22:11 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665
Dec 05 12:22:11 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:22:11 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:22:11 user nova-compute[75071]: FIRMWARE:
Dec 05 12:22:11 user nova-compute[75071]: No targets found.
Dec 05 12:22:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:22:11 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:22:11 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c55d5d7-b898-4ed8-bd9b-7291cdeb3497]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ae979b-c24a-47de-9c5d-fd42a54aeb26]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:22:11 user nova-compute[75071]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:22:11 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:22:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 (non-flash)
Dec 05 12:22:11 user nova-compute[75071]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:22:11 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:22:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f826416fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a3846e-bdf7-4b05-8ac7-9820fb69245b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[468791a5-a333-4c8a-bc5f-e1f335fffb56]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37f49a6-d175-43b5-83e4-d91626120a81]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[99383653-ba7b-4284-9853-4c4c253f9e3f]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_d6485bde', '/dev/disk/by-id/scsi-1SCST_BIOd6485bde-9190b36b499db666', '/dev/disk/by-id/scsi-23931393062333662') {{(pid=85641) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d83d81-46f7-477f-b903-202a37ca17d7]: (4, None) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[122c4a85-4264-42be-8126-48f8752f9fcf]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c091e58-e519-408d-87fd-4995041daff3]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665, portal: 172.16.0.220,3260]
Dec 05 12:22:11 user nova-compute[75071]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665, portal: 172.16.0.220,3260] successful.
Dec 05 12:22:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ddf5aeb1-c8f8-432d-8c49-68373bb2b665 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b221996-c359-403f-8729-6b0e145abaa0]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] <== disconnect_volume: return (394ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:22:11 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Deleting instance files /opt/stack/data/nova/instances/c9e37746-57e8-4053-9f52-2c60bab457fa_del
Dec 05 12:22:11 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Deletion of /opt/stack/data/nova/instances/c9e37746-57e8-4053-9f52-2c60bab457fa_del complete
Dec 05 12:22:11 user nova-compute[75071]: INFO nova.compute.manager [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Took 1.33 seconds to destroy the instance on the hypervisor.
Dec 05 12:22:11 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:22:11 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:22:12 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:22:12 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Took 1.16 seconds to deallocate network for instance.
Dec 05 12:22:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-085d2a4e-bfd5-4339-b85a-69cb4f69fe8b req-dcb4554d-0d9c-47cc-8662-ce74d5638112 service nova] [instance: 12b75ed0-0ac3-4d19-bc01-c4ab10fff348] Received event network-vif-deleted-75e40851-836c-42a3-8153-b071589a4f6e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:12 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:22:12 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.535s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:12 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Deleted allocations for instance 12b75ed0-0ac3-4d19-bc01-c4ab10fff348
Dec 05 12:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:12 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:22:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:22:13 user nova-compute[75071]: INFO nova.compute.claims [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Claim successful on node user
Dec 05 12:22:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d83510d9-2951-40e1-b5e8-be708d2fb8ff tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "12b75ed0-0ac3-4d19-bc01-c4ab10fff348" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.015s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:13 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:22:13 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:22:13 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:22:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:22:13 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Took 1.87 seconds to deallocate network for instance.
Dec 05 12:22:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:22:13 user nova-compute[75071]: DEBUG nova.network.neutron [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:22:13 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:22:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:22:13 user nova-compute[75071]: DEBUG nova.policy [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3312b55016d34680b6873eedf97e9a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b958a2138af24f5a860e7a0c99d9ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:22:14 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Creating image(s)
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "/opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "/opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-4657ac00-1094-4e47-a313-9bd38fd655d2 req-6a2c03a0-e2bb-4ce7-8d13-c03d73decde4 service nova] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Received event network-vif-deleted-e148c36d-f01c-41e2-8e2e-082e023af6fb {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk 1073741824" returned: 0 in 0.071s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:14 user nova-compute[75071]: INFO nova.compute.manager [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Took 0.88 seconds to detach 1 volumes for instance.
Dec 05 12:22:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] [instance: c9e37746-57e8-4053-9f52-2c60bab457fa] Deleting volume: ddf5aeb1-c8f8-432d-8c49-68373bb2b665 {{(pid=75071) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:22:14 user nova-compute[75071]: INFO nova.compute.claims [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Claim successful on node user
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.285s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Cannot resize image /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:22:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:22:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Ensure instance console log exists: /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:15 user nova-compute[75071]: DEBUG nova.network.neutron [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Successfully created port: dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:22:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:15 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:22:15 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.968s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.798s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:22:15 user nova-compute[75071]: DEBUG nova.network.neutron [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:22:15 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:22:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:22:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:22:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:22:15 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Creating image(s)
Dec 05 12:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "/opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "/opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "/opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:15 user nova-compute[75071]: DEBUG nova.policy [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3312b55016d34680b6873eedf97e9a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b958a2138af24f5a860e7a0c99d9ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.465s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.225s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:16 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Deleted allocations for instance c9e37746-57e8-4053-9f52-2c60bab457fa
Dec 05 12:22:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5a151509-30d1-4ba8-b2fd-749886acdfac tempest-ServerActionsV293TestJSON-1195759080 tempest-ServerActionsV293TestJSON-1195759080-project-member] Lock "c9e37746-57e8-4053-9f52-2c60bab457fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.876s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk 1073741824" returned: 0 in 0.062s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Cannot resize image /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Ensure instance console log exists: /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Successfully updated port: dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquired lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-e72280f5-b2a7-4a38-b3d6-228d2d2cc02c req-9073fec7-6b29-423c-ad74-cc86e6457eae service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received event network-changed-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-e72280f5-b2a7-4a38-b3d6-228d2d2cc02c req-9073fec7-6b29-423c-ad74-cc86e6457eae service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Refreshing instance network info cache due to event network-changed-dd15e936-54b4-4e4b-a17a-9bad21c19bac. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e72280f5-b2a7-4a38-b3d6-228d2d2cc02c req-9073fec7-6b29-423c-ad74-cc86e6457eae service nova] Acquiring lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:22:17 user nova-compute[75071]: INFO nova.compute.claims [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Claim successful on node user
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Successfully created port: 4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Updating instance_info_cache with network_info: [{"id": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "address": "fa:16:3e:53:ed:01", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd15e936-54", "ovs_interfaceid": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Releasing lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Instance network_info: |[{"id": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "address": "fa:16:3e:53:ed:01", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd15e936-54", "ovs_interfaceid": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e72280f5-b2a7-4a38-b3d6-228d2d2cc02c req-9073fec7-6b29-423c-ad74-cc86e6457eae service nova] Acquired lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.network.neutron [req-e72280f5-b2a7-4a38-b3d6-228d2d2cc02c req-9073fec7-6b29-423c-ad74-cc86e6457eae service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Refreshing network info cache for port dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Start _get_guest_xml network_info=[{"id": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "address": "fa:16:3e:53:ed:01", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd15e936-54", "ovs_interfaceid": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:22:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:22:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:22:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1939676217',display_name='tempest-ServerRescueNegativeTestJSON-server-1939676217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1939676217',id=17,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b958a2138af24f5a860e7a0c99d9ebb5',ramdisk_id='',reservation_id='r-ampwzrjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-170727457',owner_user_name='tempest-ServerRescueNegativeTestJSON-170727457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:22:14Z,user_data=None,user_id='3312b55016d34680b6873eedf97e9a8f',uuid=9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "address": "fa:16:3e:53:ed:01", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd15e936-54", "ovs_interfaceid": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converting VIF {"id": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "address": "fa:16:3e:53:ed:01", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd15e936-54", "ovs_interfaceid": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ed:01,bridge_name='br-int',has_traffic_filtering=True,id=dd15e936-54b4-4e4b-a17a-9bad21c19bac,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd15e936-54') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.objects.instance [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:22:17 user nova-compute[75071]:   <uuid>9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f</uuid>
Dec 05 12:22:17 user nova-compute[75071]:   <name>instance-00000011</name>
Dec 05 12:22:17 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:22:17 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:22:17 user nova-compute[75071]:   <metadata>
Dec 05 12:22:17 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:22:17 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:22:17 user nova-compute[75071]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1939676217</nova:name>
Dec 05 12:22:17 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:22:17</nova:creationTime>
Dec 05 12:22:17 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:22:17 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:22:17 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:22:17 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:22:17 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:22:17 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:22:17 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:22:17 user nova-compute[75071]:       <nova:owner>
Dec 05 12:22:17 user nova-compute[75071]:         <nova:user uuid="3312b55016d34680b6873eedf97e9a8f">tempest-ServerRescueNegativeTestJSON-170727457-project-member</nova:user>
Dec 05 12:22:17 user nova-compute[75071]:         <nova:project uuid="b958a2138af24f5a860e7a0c99d9ebb5">tempest-ServerRescueNegativeTestJSON-170727457</nova:project>
Dec 05 12:22:17 user nova-compute[75071]:       </nova:owner>
Dec 05 12:22:17 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:22:17 user nova-compute[75071]:       <nova:ports>
Dec 05 12:22:17 user nova-compute[75071]:         <nova:port uuid="dd15e936-54b4-4e4b-a17a-9bad21c19bac">
Dec 05 12:22:17 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 05 12:22:17 user nova-compute[75071]:         </nova:port>
Dec 05 12:22:17 user nova-compute[75071]:       </nova:ports>
Dec 05 12:22:17 user nova-compute[75071]:     </nova:instance>
Dec 05 12:22:17 user nova-compute[75071]:   </metadata>
Dec 05 12:22:17 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:22:17 user nova-compute[75071]:     <system>
Dec 05 12:22:17 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:22:17 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:22:17 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:22:17 user nova-compute[75071]:       <entry name="serial">9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f</entry>
Dec 05 12:22:17 user nova-compute[75071]:       <entry name="uuid">9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f</entry>
Dec 05 12:22:17 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:22:17 user nova-compute[75071]:     </system>
Dec 05 12:22:17 user nova-compute[75071]:   </sysinfo>
Dec 05 12:22:17 user nova-compute[75071]:   <os>
Dec 05 12:22:17 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:22:17 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:22:17 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:22:17 user nova-compute[75071]:   </os>
Dec 05 12:22:17 user nova-compute[75071]:   <features>
Dec 05 12:22:17 user nova-compute[75071]:     <acpi/>
Dec 05 12:22:17 user nova-compute[75071]:     <apic/>
Dec 05 12:22:17 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:22:17 user nova-compute[75071]:   </features>
Dec 05 12:22:17 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:22:17 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:22:17 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:22:17 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:22:17 user nova-compute[75071]:   </clock>
Dec 05 12:22:17 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:22:17 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:22:17 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:22:17 user nova-compute[75071]:   </cpu>
Dec 05 12:22:17 user nova-compute[75071]:   <devices>
Dec 05 12:22:17 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:22:17 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:22:17 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk"/>
Dec 05 12:22:17 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:22:17 user nova-compute[75071]:     </disk>
Dec 05 12:22:17 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:22:17 user nova-compute[75071]:       <mac address="fa:16:3e:53:ed:01"/>
Dec 05 12:22:17 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:22:17 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:22:17 user nova-compute[75071]:       <target dev="tapdd15e936-54"/>
Dec 05 12:22:17 user nova-compute[75071]:     </interface>
Dec 05 12:22:17 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:22:17 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/console.log" append="off"/>
Dec 05 12:22:17 user nova-compute[75071]:     </serial>
Dec 05 12:22:17 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:22:17 user nova-compute[75071]:     <video>
Dec 05 12:22:17 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:22:17 user nova-compute[75071]:     </video>
Dec 05 12:22:17 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:22:17 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:22:17 user nova-compute[75071]:     </rng>
Dec 05 12:22:17 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:22:17 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:22:17 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:22:17 user nova-compute[75071]:     </memballoon>
Dec 05 12:22:17 user nova-compute[75071]:   </devices>
Dec 05 12:22:17 user nova-compute[75071]: </domain>
Dec 05 12:22:17 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:22:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1939676217',display_name='tempest-ServerRescueNegativeTestJSON-server-1939676217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1939676217',id=17,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b958a2138af24f5a860e7a0c99d9ebb5',ramdisk_id='',reservation_id='r-ampwzrjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-170727457',owner_user_name='tempest-ServerRescueNegativeTestJSON-170727457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:22:14Z,user_data=None,user_id='3312b55016d34680b6873eedf97e9a8f',uuid=9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "address": "fa:16:3e:53:ed:01", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd15e936-54", "ovs_interfaceid": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converting VIF {"id": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "address": "fa:16:3e:53:ed:01", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd15e936-54", "ovs_interfaceid": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:ed:01,bridge_name='br-int',has_traffic_filtering=True,id=dd15e936-54b4-4e4b-a17a-9bad21c19bac,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd15e936-54') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG os_vif [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ed:01,bridge_name='br-int',has_traffic_filtering=True,id=dd15e936-54b4-4e4b-a17a-9bad21c19bac,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd15e936-54') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e8ce5e7-f4c3-53cb-a7b6-5a3e16f1132d', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:17 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd15e936-54, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd15e936-54, col_values=(('qos', UUID('d1a9f057-b471-4910-97a4-7267647d98c2')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd15e936-54, col_values=(('external_ids', {'iface-id': 'dd15e936-54b4-4e4b-a17a-9bad21c19bac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:ed:01', 'vm-uuid': '9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:17 user nova-compute[75071]: INFO os_vif [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:ed:01,bridge_name='br-int',has_traffic_filtering=True,id=dd15e936-54b4-4e4b-a17a-9bad21c19bac,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd15e936-54')
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:22:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] No VIF found with MAC fa:16:3e:53:ed:01, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG nova.policy [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a213d662f65e41fa8cc3a20e736ca757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee29a575739045dd9db612290cfa9620', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:22:18 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Creating image(s)
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "/opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "/opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "/opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.194s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk 1073741824" returned: 0 in 0.055s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG nova.network.neutron [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Successfully updated port: 4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "refresh_cache-4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquired lock "refresh_cache-4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG nova.network.neutron [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG nova.network.neutron [req-e72280f5-b2a7-4a38-b3d6-228d2d2cc02c req-9073fec7-6b29-423c-ad74-cc86e6457eae service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Updated VIF entry in instance network info cache for port dd15e936-54b4-4e4b-a17a-9bad21c19bac. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG nova.network.neutron [req-e72280f5-b2a7-4a38-b3d6-228d2d2cc02c req-9073fec7-6b29-423c-ad74-cc86e6457eae service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Updating instance_info_cache with network_info: [{"id": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "address": "fa:16:3e:53:ed:01", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd15e936-54", "ovs_interfaceid": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e72280f5-b2a7-4a38-b3d6-228d2d2cc02c req-9073fec7-6b29-423c-ad74-cc86e6457eae service nova] Releasing lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG nova.network.neutron [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.233s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Cannot resize image /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Ensure instance console log exists: /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.network.neutron [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Updating instance_info_cache with network_info: [{"id": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "address": "fa:16:3e:59:88:5c", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2c318b-a7", "ovs_interfaceid": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Successfully created port: 5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Releasing lock "refresh_cache-4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Instance network_info: |[{"id": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "address": "fa:16:3e:59:88:5c", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2c318b-a7", "ovs_interfaceid": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Start _get_guest_xml network_info=[{"id": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "address": "fa:16:3e:59:88:5c", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2c318b-a7", "ovs_interfaceid": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:22:19 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:22:19 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-635283916',display_name='tempest-ServerRescueNegativeTestJSON-server-635283916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-635283916',id=18,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b958a2138af24f5a860e7a0c99d9ebb5',ramdisk_id='',reservation_id='r-hszh9mt9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-170727457',owner_user_name='tempest-ServerRescueNegativeTestJSON-170727457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:22:16Z,user_data=None,user_id='3312b55016d34680b6873eedf97e9a8f',uuid=4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "address": "fa:16:3e:59:88:5c", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2c318b-a7", "ovs_interfaceid": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converting VIF {"id": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "address": "fa:16:3e:59:88:5c", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2c318b-a7", "ovs_interfaceid": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=4d2c318b-a73f-4a69-b318-3f4ae56a5d7b,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2c318b-a7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.objects.instance [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'pci_devices' on Instance uuid 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-1eb8f9ce-addc-401a-ac74-756e508a0bb8 req-14a4775d-e1fe-42a6-972c-781584d6174a service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Received event network-changed-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-1eb8f9ce-addc-401a-ac74-756e508a0bb8 req-14a4775d-e1fe-42a6-972c-781584d6174a service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Refreshing instance network info cache due to event network-changed-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1eb8f9ce-addc-401a-ac74-756e508a0bb8 req-14a4775d-e1fe-42a6-972c-781584d6174a service nova] Acquiring lock "refresh_cache-4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1eb8f9ce-addc-401a-ac74-756e508a0bb8 req-14a4775d-e1fe-42a6-972c-781584d6174a service nova] Acquired lock "refresh_cache-4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.network.neutron [req-1eb8f9ce-addc-401a-ac74-756e508a0bb8 req-14a4775d-e1fe-42a6-972c-781584d6174a service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Refreshing network info cache for port 4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:22:19 user nova-compute[75071]:   <uuid>4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957</uuid>
Dec 05 12:22:19 user nova-compute[75071]:   <name>instance-00000012</name>
Dec 05 12:22:19 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:22:19 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:22:19 user nova-compute[75071]:   <metadata>
Dec 05 12:22:19 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:22:19 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:22:19 user nova-compute[75071]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-635283916</nova:name>
Dec 05 12:22:19 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:22:19</nova:creationTime>
Dec 05 12:22:19 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:22:19 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:22:19 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:22:19 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:22:19 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:22:19 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:22:19 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:22:19 user nova-compute[75071]:       <nova:owner>
Dec 05 12:22:19 user nova-compute[75071]:         <nova:user uuid="3312b55016d34680b6873eedf97e9a8f">tempest-ServerRescueNegativeTestJSON-170727457-project-member</nova:user>
Dec 05 12:22:19 user nova-compute[75071]:         <nova:project uuid="b958a2138af24f5a860e7a0c99d9ebb5">tempest-ServerRescueNegativeTestJSON-170727457</nova:project>
Dec 05 12:22:19 user nova-compute[75071]:       </nova:owner>
Dec 05 12:22:19 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:22:19 user nova-compute[75071]:       <nova:ports>
Dec 05 12:22:19 user nova-compute[75071]:         <nova:port uuid="4d2c318b-a73f-4a69-b318-3f4ae56a5d7b">
Dec 05 12:22:19 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 05 12:22:19 user nova-compute[75071]:         </nova:port>
Dec 05 12:22:19 user nova-compute[75071]:       </nova:ports>
Dec 05 12:22:19 user nova-compute[75071]:     </nova:instance>
Dec 05 12:22:19 user nova-compute[75071]:   </metadata>
Dec 05 12:22:19 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:22:19 user nova-compute[75071]:     <system>
Dec 05 12:22:19 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:22:19 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:22:19 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:22:19 user nova-compute[75071]:       <entry name="serial">4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957</entry>
Dec 05 12:22:19 user nova-compute[75071]:       <entry name="uuid">4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957</entry>
Dec 05 12:22:19 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:22:19 user nova-compute[75071]:     </system>
Dec 05 12:22:19 user nova-compute[75071]:   </sysinfo>
Dec 05 12:22:19 user nova-compute[75071]:   <os>
Dec 05 12:22:19 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:22:19 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:22:19 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:22:19 user nova-compute[75071]:   </os>
Dec 05 12:22:19 user nova-compute[75071]:   <features>
Dec 05 12:22:19 user nova-compute[75071]:     <acpi/>
Dec 05 12:22:19 user nova-compute[75071]:     <apic/>
Dec 05 12:22:19 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:22:19 user nova-compute[75071]:   </features>
Dec 05 12:22:19 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:22:19 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:22:19 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:22:19 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:22:19 user nova-compute[75071]:   </clock>
Dec 05 12:22:19 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:22:19 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:22:19 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:22:19 user nova-compute[75071]:   </cpu>
Dec 05 12:22:19 user nova-compute[75071]:   <devices>
Dec 05 12:22:19 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:22:19 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:22:19 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk"/>
Dec 05 12:22:19 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:22:19 user nova-compute[75071]:     </disk>
Dec 05 12:22:19 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:22:19 user nova-compute[75071]:       <mac address="fa:16:3e:59:88:5c"/>
Dec 05 12:22:19 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:22:19 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:22:19 user nova-compute[75071]:       <target dev="tap4d2c318b-a7"/>
Dec 05 12:22:19 user nova-compute[75071]:     </interface>
Dec 05 12:22:19 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:22:19 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/console.log" append="off"/>
Dec 05 12:22:19 user nova-compute[75071]:     </serial>
Dec 05 12:22:19 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:22:19 user nova-compute[75071]:     <video>
Dec 05 12:22:19 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:22:19 user nova-compute[75071]:     </video>
Dec 05 12:22:19 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:22:19 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:22:19 user nova-compute[75071]:     </rng>
Dec 05 12:22:19 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:22:19 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:22:19 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:22:19 user nova-compute[75071]:     </memballoon>
Dec 05 12:22:19 user nova-compute[75071]:   </devices>
Dec 05 12:22:19 user nova-compute[75071]: </domain>
Dec 05 12:22:19 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-635283916',display_name='tempest-ServerRescueNegativeTestJSON-server-635283916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-635283916',id=18,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b958a2138af24f5a860e7a0c99d9ebb5',ramdisk_id='',reservation_id='r-hszh9mt9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-170727457',owner_user_name='tempest-ServerRescueNegativeTestJSON-170727457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:22:16Z,user_data=None,user_id='3312b55016d34680b6873eedf97e9a8f',uuid=4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "address": "fa:16:3e:59:88:5c", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2c318b-a7", "ovs_interfaceid": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converting VIF {"id": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "address": "fa:16:3e:59:88:5c", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2c318b-a7", "ovs_interfaceid": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=4d2c318b-a73f-4a69-b318-3f4ae56a5d7b,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2c318b-a7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG os_vif [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=4d2c318b-a73f-4a69-b318-3f4ae56a5d7b,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2c318b-a7') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f217aff-d819-56f8-a8d9-db93b46d7ea9', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d2c318b-a7, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d2c318b-a7, col_values=(('qos', UUID('8464b33c-b457-49a9-bda6-d54455fde5ca')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d2c318b-a7, col_values=(('external_ids', {'iface-id': '4d2c318b-a73f-4a69-b318-3f4ae56a5d7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:88:5c', 'vm-uuid': '4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:19 user nova-compute[75071]: INFO os_vif [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=4d2c318b-a73f-4a69-b318-3f4ae56a5d7b,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2c318b-a7')
Dec 05 12:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] No VIF found with MAC fa:16:3e:59:88:5c, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:22:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Creating image(s)
Dec 05 12:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "/opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "/opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "/opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG nova.network.neutron [req-1eb8f9ce-addc-401a-ac74-756e508a0bb8 req-14a4775d-e1fe-42a6-972c-781584d6174a service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Updated VIF entry in instance network info cache for port 4d2c318b-a73f-4a69-b318-3f4ae56a5d7b. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG nova.network.neutron [req-1eb8f9ce-addc-401a-ac74-756e508a0bb8 req-14a4775d-e1fe-42a6-972c-781584d6174a service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Updating instance_info_cache with network_info: [{"id": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "address": "fa:16:3e:59:88:5c", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2c318b-a7", "ovs_interfaceid": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1eb8f9ce-addc-401a-ac74-756e508a0bb8 req-14a4775d-e1fe-42a6-972c-781584d6174a service nova] Releasing lock "refresh_cache-4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.202s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.252s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk 1073741824" returned: 0 in 0.208s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.466s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Successfully updated port: 5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquired lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.239s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:22:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Cannot resize image /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Ensure instance console log exists: /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Start _get_guest_xml network_info=[{"id": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "address": "fa:16:3e:8f:a8:2b", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9ba38-13", "ovs_interfaceid": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'e09d1b93-6311-45e5-bc7c-032ddbeca2e1', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoTiarDB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '62efa94c-ae01-48aa-b3d3-0d23d159801c', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc309cdc-014c-42c9-b515-3a094b0638be', 'serial': 'cc309cdc-014c-42c9-b515-3a094b0638be'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:22:21 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 05 12:22:21 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.objects.instance [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lazy-loading 'vcpu_model' on Instance uuid 62efa94c-ae01-48aa-b3d3-0d23d159801c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoTiarDB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:22:21 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:22:21 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:22:21 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Updating instance_info_cache with network_info: [{"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] No waiting events found dispatching network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:22:21 user nova-compute[75071]: WARNING nova.compute.manager [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received unexpected event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac for instance with vm_state building and task_state spawning.
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] No waiting events found dispatching network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:22:21 user nova-compute[75071]: WARNING nova.compute.manager [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received unexpected event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac for instance with vm_state building and task_state spawning.
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-changed-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Refreshing instance network info cache due to event network-changed-5077ca66-d74d-4ad0-abee-fe0ea86d67ac. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] Acquiring lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Releasing lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Instance network_info: |[{"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dd4926-5c87-4e3e-9207-f0ce4c5b7fa4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] Acquired lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Refreshing network info cache for port 5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Start _get_guest_xml network_info=[{"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:22:21 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:21 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:22:21 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:22:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-610057875',display_name='tempest-ServerActionsTestOtherB-server-610057875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-610057875',id=19,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD//5LMlmnSypPzSdRI5jpZ9XqSwL0meBfIrwjAimv5kjQelxMdWSK8Bf7Pi316SOZkmu0iNhVkGJ6EvGf+c87dPNcnj3FJiHI1f2q3NnaFYTTYG6q/U8Y9vdkHGXYuKCg==',key_name='tempest-keypair-186552237',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee29a575739045dd9db612290cfa9620',ramdisk_id='',reservation_id='r-0dy2tt38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1001076821',owner_user_name='tempest-ServerActionsTestOtherB-1001076821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a213d662f65e41fa8cc3a20e736ca757',uuid=c89c29d3-b60e-4dc5-a895-f9fe84ed69a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Converting VIF {"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lazy-loading 'pci_devices' on Instance uuid c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c85c0e-6fc1-4d45-b6f4-df159482639d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be] added
Dec 05 12:22:21 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:22:21 user nova-compute[75071]:   <uuid>c89c29d3-b60e-4dc5-a895-f9fe84ed69a7</uuid>
Dec 05 12:22:21 user nova-compute[75071]:   <name>instance-00000013</name>
Dec 05 12:22:21 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:22:21 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:22:21 user nova-compute[75071]:   <metadata>
Dec 05 12:22:21 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:22:21 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:22:21 user nova-compute[75071]:       <nova:name>tempest-ServerActionsTestOtherB-server-610057875</nova:name>
Dec 05 12:22:21 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:22:21</nova:creationTime>
Dec 05 12:22:21 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:22:21 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:22:21 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:22:21 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:22:21 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:22:21 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:22:21 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:22:21 user nova-compute[75071]:       <nova:owner>
Dec 05 12:22:21 user nova-compute[75071]:         <nova:user uuid="a213d662f65e41fa8cc3a20e736ca757">tempest-ServerActionsTestOtherB-1001076821-project-member</nova:user>
Dec 05 12:22:21 user nova-compute[75071]:         <nova:project uuid="ee29a575739045dd9db612290cfa9620">tempest-ServerActionsTestOtherB-1001076821</nova:project>
Dec 05 12:22:21 user nova-compute[75071]:       </nova:owner>
Dec 05 12:22:21 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:22:21 user nova-compute[75071]:       <nova:ports>
Dec 05 12:22:21 user nova-compute[75071]:         <nova:port uuid="5077ca66-d74d-4ad0-abee-fe0ea86d67ac">
Dec 05 12:22:21 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 05 12:22:21 user nova-compute[75071]:         </nova:port>
Dec 05 12:22:21 user nova-compute[75071]:       </nova:ports>
Dec 05 12:22:21 user nova-compute[75071]:     </nova:instance>
Dec 05 12:22:21 user nova-compute[75071]:   </metadata>
Dec 05 12:22:21 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:22:21 user nova-compute[75071]:     <system>
Dec 05 12:22:21 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:22:21 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:22:21 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:22:21 user nova-compute[75071]:       <entry name="serial">c89c29d3-b60e-4dc5-a895-f9fe84ed69a7</entry>
Dec 05 12:22:21 user nova-compute[75071]:       <entry name="uuid">c89c29d3-b60e-4dc5-a895-f9fe84ed69a7</entry>
Dec 05 12:22:21 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:22:21 user nova-compute[75071]:     </system>
Dec 05 12:22:21 user nova-compute[75071]:   </sysinfo>
Dec 05 12:22:21 user nova-compute[75071]:   <os>
Dec 05 12:22:21 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:22:21 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:22:21 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:22:21 user nova-compute[75071]:   </os>
Dec 05 12:22:21 user nova-compute[75071]:   <features>
Dec 05 12:22:21 user nova-compute[75071]:     <acpi/>
Dec 05 12:22:21 user nova-compute[75071]:     <apic/>
Dec 05 12:22:21 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:22:21 user nova-compute[75071]:   </features>
Dec 05 12:22:21 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:22:21 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:22:21 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:22:21 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:22:21 user nova-compute[75071]:   </clock>
Dec 05 12:22:21 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:22:21 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:22:21 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:22:21 user nova-compute[75071]:   </cpu>
Dec 05 12:22:21 user nova-compute[75071]:   <devices>
Dec 05 12:22:21 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:22:21 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:22:21 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk"/>
Dec 05 12:22:21 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:22:21 user nova-compute[75071]:     </disk>
Dec 05 12:22:21 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:22:21 user nova-compute[75071]:       <mac address="fa:16:3e:de:d7:62"/>
Dec 05 12:22:21 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:22:21 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:22:21 user nova-compute[75071]:       <target dev="tap5077ca66-d7"/>
Dec 05 12:22:21 user nova-compute[75071]:     </interface>
Dec 05 12:22:21 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:22:21 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/console.log" append="off"/>
Dec 05 12:22:21 user nova-compute[75071]:     </serial>
Dec 05 12:22:21 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:22:21 user nova-compute[75071]:     <video>
Dec 05 12:22:21 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:22:21 user nova-compute[75071]:     </video>
Dec 05 12:22:21 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:22:21 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:22:21 user nova-compute[75071]:     </rng>
Dec 05 12:22:21 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:22:21 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:22:21 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:22:21 user nova-compute[75071]:     </memballoon>
Dec 05 12:22:21 user nova-compute[75071]:   </devices>
Dec 05 12:22:21 user nova-compute[75071]: </domain>
Dec 05 12:22:21 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:22:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-610057875',display_name='tempest-ServerActionsTestOtherB-server-610057875',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-610057875',id=19,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD//5LMlmnSypPzSdRI5jpZ9XqSwL0meBfIrwjAimv5kjQelxMdWSK8Bf7Pi316SOZkmu0iNhVkGJ6EvGf+c87dPNcnj3FJiHI1f2q3NnaFYTTYG6q/U8Y9vdkHGXYuKCg==',key_name='tempest-keypair-186552237',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee29a575739045dd9db612290cfa9620',ramdisk_id='',reservation_id='r-0dy2tt38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1001076821',owner_user_name='tempest-ServerActionsTestOtherB-1001076821-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:22:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a213d662f65e41fa8cc3a20e736ca757',uuid=c89c29d3-b60e-4dc5-a895-f9fe84ed69a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Converting VIF {"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_vif [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a26441c-5832-55ed-b6e2-b2eb5e1fadaa', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b790c47b-5d15-498b-af6e-7e0a11d099ac]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8202ea-27a4-44db-b58f-fcbaf48b67a2]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hoTiarDB {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5077ca66-d7, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5077ca66-d7, col_values=(('qos', UUID('4f8a5e4c-b4f9-4643-923b-44502424a2f3')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5077ca66-d7, col_values=(('external_ids', {'iface-id': '5077ca66-d74d-4ad0-abee-fe0ea86d67ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:d7:62', 'vm-uuid': 'c89c29d3-b60e-4dc5-a895-f9fe84ed69a7'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hoTiarDB" returned: 0 in 0.030s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[efed6bd5-9ffb-44fe-90a4-2a4bc5668e7d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hoTiarDB'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[943c10c5-cf2a-4ad3-8e75-66f22b06db7b]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:21 user nova-compute[75071]: INFO os_vif [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7')
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c89f061-0e9a-48aa-aa65-e2a098b24c74]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:22:21 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:22:21 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:22:21 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:22:21 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1b3714-8b5f-48c3-8910-bf59d6d550e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be, portal: 172.16.0.220,3260]
Dec 05 12:22:21 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be, portal: 172.16.0.220,3260] successful.
Dec 05 12:22:21 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.043s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e21fef-4416-4b26-aaf2-34a54b4cc458]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] No VIF found with MAC fa:16:3e:de:d7:62, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bea9eb-56bc-4f99-8fa6-42a739634a3c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:22:21 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:22:21 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:22:21 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:22:21 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:22:21 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:22:21 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.447s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9542d22-a7f5-4504-b93e-eed98da4f073]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoTiarDB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Updated VIF entry in instance network info cache for port 5077ca66-d74d-4ad0-abee-fe0ea86d67ac. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:22:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Updating instance_info_cache with network_info: [{"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e914375b-bcdd-43f8-8f1c-be9671e91508 req-7d823e90-714c-4912-be60-194d10467e33 service nova] Releasing lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:22:22 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 81333acc-8dc7-42f1-9026-e42a30e52a5a is timed out.
Dec 05 12:22:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Successfully detached device vdb from instance 81333acc-8dc7-42f1-9026-e42a30e52a5a from the live domain config.
Dec 05 12:22:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UQRwvdHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:22:22 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:22:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] <== connect_volume: return (1493ms) {'type': 'block', 'scsi_wwn': '26366616437636535', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366616437636535', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.019s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb6a80e-c177-4973-a5a3-3b7dd7198cca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:22:22 user nova-compute[75071]: No targets found.
Dec 05 12:22:22 user nova-compute[75071]: iSNS:
Dec 05 12:22:22 user nova-compute[75071]: No targets found.
Dec 05 12:22:22 user nova-compute[75071]: STATIC:
Dec 05 12:22:22 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c
Dec 05 12:22:22 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:22:22 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:22:22 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:22:22 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:22:22 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:22:22 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be
Dec 05 12:22:22 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:22:22 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:22:22 user nova-compute[75071]: FIRMWARE:
Dec 05 12:22:22 user nova-compute[75071]: No targets found.
Dec 05 12:22:22 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:22:22 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:22:22 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T12:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1207590253',display_name='tempest-ServerActionsTestOtherA-server-233404088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1207590253',id=13,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk/2CR5ryCdFhnzY7TEoYapKL803/W+14EuHBFh/Bn1ydNJw/5MkJqSTVw47d32v20VlRqVYqCUpZ+R3KOMF8XfpJIXjWBmPbrx5vIAMBConykgFyc0rPSXZyqCSasrlQ==',key_name='tempest-keypair-858510286',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:20:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='59b6bfae34944fcfbd49d2f18b232ec8',ramdisk_id='',reservation_id='r-6o3c9k6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1523780015',owner_user_name='tempest-ServerActionsTestOtherA-1523780015-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e73e24d5b1489c813f06690b12eef4',uuid=62efa94c-ae01-48aa-b3d3-0d23d159801c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "address": "fa:16:3e:8f:a8:2b", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9ba38-13", "ovs_interfaceid": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converting VIF {"id": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "address": "fa:16:3e:8f:a8:2b", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9ba38-13", "ovs_interfaceid": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=dfd9ba38-13c3-423b-81d9-8fd813ca2acd,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9ba38-13') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:22:22 user nova-compute[75071]:   <uuid>62efa94c-ae01-48aa-b3d3-0d23d159801c</uuid>
Dec 05 12:22:22 user nova-compute[75071]:   <name>instance-0000000d</name>
Dec 05 12:22:22 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:22:22 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:22:22 user nova-compute[75071]:   <metadata>
Dec 05 12:22:22 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:22:22 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:22:22 user nova-compute[75071]:       <nova:name>tempest-ServerActionsTestOtherA-server-233404088</nova:name>
Dec 05 12:22:22 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:22:21</nova:creationTime>
Dec 05 12:22:22 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:22:22 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:22:22 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:22:22 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:22:22 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:22:22 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:22:22 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:22:22 user nova-compute[75071]:       <nova:owner>
Dec 05 12:22:22 user nova-compute[75071]:         <nova:user uuid="d7e73e24d5b1489c813f06690b12eef4">tempest-ServerActionsTestOtherA-1523780015-project-member</nova:user>
Dec 05 12:22:22 user nova-compute[75071]:         <nova:project uuid="59b6bfae34944fcfbd49d2f18b232ec8">tempest-ServerActionsTestOtherA-1523780015</nova:project>
Dec 05 12:22:22 user nova-compute[75071]:       </nova:owner>
Dec 05 12:22:22 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:22:22 user nova-compute[75071]:       <nova:ports>
Dec 05 12:22:22 user nova-compute[75071]:         <nova:port uuid="dfd9ba38-13c3-423b-81d9-8fd813ca2acd">
Dec 05 12:22:22 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 12:22:22 user nova-compute[75071]:         </nova:port>
Dec 05 12:22:22 user nova-compute[75071]:       </nova:ports>
Dec 05 12:22:22 user nova-compute[75071]:     </nova:instance>
Dec 05 12:22:22 user nova-compute[75071]:   </metadata>
Dec 05 12:22:22 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:22:22 user nova-compute[75071]:     <system>
Dec 05 12:22:22 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:22:22 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:22:22 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:22:22 user nova-compute[75071]:       <entry name="serial">62efa94c-ae01-48aa-b3d3-0d23d159801c</entry>
Dec 05 12:22:22 user nova-compute[75071]:       <entry name="uuid">62efa94c-ae01-48aa-b3d3-0d23d159801c</entry>
Dec 05 12:22:22 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:22:22 user nova-compute[75071]:     </system>
Dec 05 12:22:22 user nova-compute[75071]:   </sysinfo>
Dec 05 12:22:22 user nova-compute[75071]:   <os>
Dec 05 12:22:22 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:22:22 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:22:22 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:22:22 user nova-compute[75071]:   </os>
Dec 05 12:22:22 user nova-compute[75071]:   <features>
Dec 05 12:22:22 user nova-compute[75071]:     <acpi/>
Dec 05 12:22:22 user nova-compute[75071]:     <apic/>
Dec 05 12:22:22 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:22:22 user nova-compute[75071]:   </features>
Dec 05 12:22:22 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:22:22 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:22:22 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:22:22 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:22:22 user nova-compute[75071]:   </clock>
Dec 05 12:22:22 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:22:22 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:22:22 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:22:22 user nova-compute[75071]:   </cpu>
Dec 05 12:22:22 user nova-compute[75071]:   <devices>
Dec 05 12:22:22 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:22:22 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:22:22 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk"/>
Dec 05 12:22:22 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:22:22 user nova-compute[75071]:     </disk>
Dec 05 12:22:22 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:22:22 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:22:22 user nova-compute[75071]:       <source dev="/dev/sdb"/>
Dec 05 12:22:22 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Dec 05 12:22:22 user nova-compute[75071]:       <serial>cc309cdc-014c-42c9-b515-3a094b0638be</serial>
Dec 05 12:22:22 user nova-compute[75071]:     </disk>
Dec 05 12:22:22 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:22:22 user nova-compute[75071]:       <mac address="fa:16:3e:8f:a8:2b"/>
Dec 05 12:22:22 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:22:22 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:22:22 user nova-compute[75071]:       <target dev="tapdfd9ba38-13"/>
Dec 05 12:22:22 user nova-compute[75071]:     </interface>
Dec 05 12:22:22 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:22:22 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/console.log" append="off"/>
Dec 05 12:22:22 user nova-compute[75071]:     </serial>
Dec 05 12:22:22 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:22:22 user nova-compute[75071]:     <video>
Dec 05 12:22:22 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:22:22 user nova-compute[75071]:     </video>
Dec 05 12:22:22 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:22:22 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:22:22 user nova-compute[75071]:     </rng>
Dec 05 12:22:22 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:22:22 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:22:22 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:22:22 user nova-compute[75071]:     </memballoon>
Dec 05 12:22:22 user nova-compute[75071]:   </devices>
Dec 05 12:22:22 user nova-compute[75071]: </domain>
Dec 05 12:22:22 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T12:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1207590253',display_name='tempest-ServerActionsTestOtherA-server-233404088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1207590253',id=13,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk/2CR5ryCdFhnzY7TEoYapKL803/W+14EuHBFh/Bn1ydNJw/5MkJqSTVw47d32v20VlRqVYqCUpZ+R3KOMF8XfpJIXjWBmPbrx5vIAMBConykgFyc0rPSXZyqCSasrlQ==',key_name='tempest-keypair-858510286',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:20:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='59b6bfae34944fcfbd49d2f18b232ec8',ramdisk_id='',reservation_id='r-6o3c9k6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1523780015',owner_user_name='tempest-ServerActionsTestOtherA-1523780015-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:22:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e73e24d5b1489c813f06690b12eef4',uuid=62efa94c-ae01-48aa-b3d3-0d23d159801c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "address": "fa:16:3e:8f:a8:2b", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9ba38-13", "ovs_interfaceid": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converting VIF {"id": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "address": "fa:16:3e:8f:a8:2b", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9ba38-13", "ovs_interfaceid": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=dfd9ba38-13c3-423b-81d9-8fd813ca2acd,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9ba38-13') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG os_vif [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=dfd9ba38-13c3-423b-81d9-8fd813ca2acd,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9ba38-13') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f117f18a-342d-53eb-9b03-2a5b47a72468', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[08edb3d7-8150-4135-9c68-766bfd020463]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfd9ba38-13, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfd9ba38-13, col_values=(('qos', UUID('2a42cfc3-f77b-4d79-bd61-a838baaa2f9f')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfd9ba38-13, col_values=(('external_ids', {'iface-id': 'dfd9ba38-13c3-423b-81d9-8fd813ca2acd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:a8:2b', 'vm-uuid': '62efa94c-ae01-48aa-b3d3-0d23d159801c'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[831017ce-d36e-4801-9018-fd8847146ff2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:22:22 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:22:22 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:22:22 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:22:22 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:22:22 user nova-compute[75071]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c (non-flash)
Dec 05 12:22:22 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8264777010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c'): ({'sdi'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Removing single pathed devices sdi {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[706e599b-c93d-4aff-a912-35286c8b5335]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cd3bcf-8f9a-43e5-9136-c87e16117cd5]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Flushing IO for device /dev/sdi {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[091245cf-8bc1-48c5-a573-9488eaa41a4d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:22 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:22:22 user nova-compute[75071]: INFO os_vif [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=dfd9ba38-13c3-423b-81d9-8fd813ca2acd,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9ba38-13')
Dec 05 12:22:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.056s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[980a25d5-fb9c-4a4d-9ec1-cf704c033bb8]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] SCSI volumes sdi have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc87dea0-425f-40b0-b99a-4954be520d9b]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] No VIF found with MAC fa:16:3e:8f:a8:2b, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a17b15-06c8-42fb-8ffc-5f2fb17c568a]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c, portal: 172.16.0.220,3260]
Dec 05 12:22:23 user nova-compute[75071]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c, portal: 172.16.0.220,3260] successful.
Dec 05 12:22:23 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93490fef-282f-4f1b-bc4e-0489b01f710c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6654ee-ad4f-4f29-a2a1-9541e45abd3e]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] <== disconnect_volume: return (393ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-4c910cce-43a9-4331-93d7-5b3fe1a0238f req-b94c275e-29e2-41f7-a82a-dad2dc5f5054 service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Received event network-vif-plugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4c910cce-43a9-4331-93d7-5b3fe1a0238f req-b94c275e-29e2-41f7-a82a-dad2dc5f5054 service nova] Acquiring lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4c910cce-43a9-4331-93d7-5b3fe1a0238f req-b94c275e-29e2-41f7-a82a-dad2dc5f5054 service nova] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4c910cce-43a9-4331-93d7-5b3fe1a0238f req-b94c275e-29e2-41f7-a82a-dad2dc5f5054 service nova] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-4c910cce-43a9-4331-93d7-5b3fe1a0238f req-b94c275e-29e2-41f7-a82a-dad2dc5f5054 service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] No waiting events found dispatching network-vif-plugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:22:23 user nova-compute[75071]: WARNING nova.compute.manager [req-4c910cce-43a9-4331-93d7-5b3fe1a0238f req-b94c275e-29e2-41f7-a82a-dad2dc5f5054 service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Received unexpected event network-vif-plugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b for instance with vm_state building and task_state spawning.
Dec 05 12:22:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-4c910cce-43a9-4331-93d7-5b3fe1a0238f req-b94c275e-29e2-41f7-a82a-dad2dc5f5054 service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Received event network-vif-plugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4c910cce-43a9-4331-93d7-5b3fe1a0238f req-b94c275e-29e2-41f7-a82a-dad2dc5f5054 service nova] Acquiring lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4c910cce-43a9-4331-93d7-5b3fe1a0238f req-b94c275e-29e2-41f7-a82a-dad2dc5f5054 service nova] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4c910cce-43a9-4331-93d7-5b3fe1a0238f req-b94c275e-29e2-41f7-a82a-dad2dc5f5054 service nova] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-4c910cce-43a9-4331-93d7-5b3fe1a0238f req-b94c275e-29e2-41f7-a82a-dad2dc5f5054 service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] No waiting events found dispatching network-vif-plugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:22:23 user nova-compute[75071]: WARNING nova.compute.manager [req-4c910cce-43a9-4331-93d7-5b3fe1a0238f req-b94c275e-29e2-41f7-a82a-dad2dc5f5054 service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Received unexpected event network-vif-plugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b for instance with vm_state building and task_state spawning.
Dec 05 12:22:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:22:23 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Instance spawned successfully.
Dec 05 12:22:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:23 user nova-compute[75071]: INFO nova.compute.manager [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Took 9.72 seconds to spawn the instance on the hypervisor.
Dec 05 12:22:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:22:23 user nova-compute[75071]: INFO nova.compute.manager [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Took 10.79 seconds to build instance.
Dec 05 12:22:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8140d8b9-f57c-4590-8057-9c6eb12d5d16 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.942s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-5c55ea44-bcba-4024-8bd2-009ba6cde856 req-bb107872-66c6-43aa-8c4f-e9ae961e5ea6 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5c55ea44-bcba-4024-8bd2-009ba6cde856 req-bb107872-66c6-43aa-8c4f-e9ae961e5ea6 service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5c55ea44-bcba-4024-8bd2-009ba6cde856 req-bb107872-66c6-43aa-8c4f-e9ae961e5ea6 service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5c55ea44-bcba-4024-8bd2-009ba6cde856 req-bb107872-66c6-43aa-8c4f-e9ae961e5ea6 service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-5c55ea44-bcba-4024-8bd2-009ba6cde856 req-bb107872-66c6-43aa-8c4f-e9ae961e5ea6 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:22:24 user nova-compute[75071]: WARNING nova.compute.manager [req-5c55ea44-bcba-4024-8bd2-009ba6cde856 req-bb107872-66c6-43aa-8c4f-e9ae961e5ea6 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received unexpected event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with vm_state building and task_state spawning.
Dec 05 12:22:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:24 user nova-compute[75071]: DEBUG nova.objects.instance [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lazy-loading 'flavor' on Instance uuid 81333acc-8dc7-42f1-9026-e42a30e52a5a {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:22:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-37174142-2ccb-4435-acd9-41c24da6ea71 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.568s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-99d78261-9057-46e5-9002-b95dac347ff1 req-e5169834-ef91-4781-98eb-d3718856127d service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Received event network-vif-plugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-99d78261-9057-46e5-9002-b95dac347ff1 req-e5169834-ef91-4781-98eb-d3718856127d service nova] Acquiring lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-99d78261-9057-46e5-9002-b95dac347ff1 req-e5169834-ef91-4781-98eb-d3718856127d service nova] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-99d78261-9057-46e5-9002-b95dac347ff1 req-e5169834-ef91-4781-98eb-d3718856127d service nova] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-99d78261-9057-46e5-9002-b95dac347ff1 req-e5169834-ef91-4781-98eb-d3718856127d service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] No waiting events found dispatching network-vif-plugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:22:25 user nova-compute[75071]: WARNING nova.compute.manager [req-99d78261-9057-46e5-9002-b95dac347ff1 req-e5169834-ef91-4781-98eb-d3718856127d service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Received unexpected event network-vif-plugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd for instance with vm_state active and task_state rebuild_spawning.
Dec 05 12:22:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-8871d42e-ddd2-492e-a7f2-fe2f26713162 req-bb7b5990-94a2-4858-a845-6e4201614445 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8871d42e-ddd2-492e-a7f2-fe2f26713162 req-bb7b5990-94a2-4858-a845-6e4201614445 service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8871d42e-ddd2-492e-a7f2-fe2f26713162 req-bb7b5990-94a2-4858-a845-6e4201614445 service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8871d42e-ddd2-492e-a7f2-fe2f26713162 req-bb7b5990-94a2-4858-a845-6e4201614445 service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-8871d42e-ddd2-492e-a7f2-fe2f26713162 req-bb7b5990-94a2-4858-a845-6e4201614445 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:22:26 user nova-compute[75071]: WARNING nova.compute.manager [req-8871d42e-ddd2-492e-a7f2-fe2f26713162 req-bb7b5990-94a2-4858-a845-6e4201614445 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received unexpected event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with vm_state building and task_state spawning.
Dec 05 12:22:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:26 user nova-compute[75071]: DEBUG nova.compute.manager [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:22:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:22:26 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Instance spawned successfully.
Dec 05 12:22:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:22:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:26 user nova-compute[75071]: INFO nova.compute.manager [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Took 10.72 seconds to spawn the instance on the hypervisor.
Dec 05 12:22:26 user nova-compute[75071]: DEBUG nova.compute.manager [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:22:26 user nova-compute[75071]: INFO nova.compute.manager [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Took 12.11 seconds to build instance.
Dec 05 12:22:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-510f2062-809a-47a5-b6cf-341980fe01cb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.238s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:22:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:22:27 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Instance spawned successfully.
Dec 05 12:22:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:22:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-4f7119ad-706d-4254-90b1-dfdce9627ce8 req-e4dafa1c-2b79-4f29-8481-452c7e8fb450 service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Received event network-vif-plugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4f7119ad-706d-4254-90b1-dfdce9627ce8 req-e4dafa1c-2b79-4f29-8481-452c7e8fb450 service nova] Acquiring lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4f7119ad-706d-4254-90b1-dfdce9627ce8 req-e4dafa1c-2b79-4f29-8481-452c7e8fb450 service nova] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4f7119ad-706d-4254-90b1-dfdce9627ce8 req-e4dafa1c-2b79-4f29-8481-452c7e8fb450 service nova] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-4f7119ad-706d-4254-90b1-dfdce9627ce8 req-e4dafa1c-2b79-4f29-8481-452c7e8fb450 service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] No waiting events found dispatching network-vif-plugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:22:27 user nova-compute[75071]: WARNING nova.compute.manager [req-4f7119ad-706d-4254-90b1-dfdce9627ce8 req-e4dafa1c-2b79-4f29-8481-452c7e8fb450 service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Received unexpected event network-vif-plugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd for instance with vm_state active and task_state rebuild_spawning.
Dec 05 12:22:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:27 user nova-compute[75071]: INFO nova.compute.manager [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Took 9.79 seconds to spawn the instance on the hypervisor.
Dec 05 12:22:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:22:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:27 user nova-compute[75071]: INFO nova.compute.manager [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Took 10.83 seconds to build instance.
Dec 05 12:22:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2515af70-244a-4867-b733-9e25d0d70673 tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.961s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:22:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:22:28 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Instance spawned successfully.
Dec 05 12:22:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:22:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:22:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:28 user nova-compute[75071]: DEBUG nova.objects.instance [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75071) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Dec 05 12:22:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-795b9dc0-6d56-4a6f-8df8-940f0589a00b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.089s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:22:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 12:22:34 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:22:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:39 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:22:40 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:22:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquiring lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:22:41 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:22:41 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:22:41 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:22:41 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:22:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:41 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:22:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:22:41 user nova-compute[75071]: INFO nova.compute.claims [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Claim successful on node user
Dec 05 12:22:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:42 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:22:42 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:22:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.946s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:22:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:22:42 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:22:42 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:22:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:22:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:42 user nova-compute[75071]: DEBUG nova.policy [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a361c08c15664fbd880f06b487d62aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6041024288a84808858ed4938f83fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:22:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Creating image(s)
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquiring lock "/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.208s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.237s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk 1073741824" returned: 0 in 0.074s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Successfully created port: 1219420b-24a0-435b-aaa4-283c51d9a847 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.206s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:22:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Cannot resize image /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Ensure instance console log exists: /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Successfully updated port: 1219420b-24a0-435b-aaa4-283c51d9a847 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquiring lock "refresh_cache-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquired lock "refresh_cache-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-7b5f899f-91d2-43a6-8d35-ef089cf84b2d req-3c6e2760-c462-425a-acdd-b4c5664e8bf4 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received event network-changed-1219420b-24a0-435b-aaa4-283c51d9a847 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-7b5f899f-91d2-43a6-8d35-ef089cf84b2d req-3c6e2760-c462-425a-acdd-b4c5664e8bf4 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Refreshing instance network info cache due to event network-changed-1219420b-24a0-435b-aaa4-283c51d9a847. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7b5f899f-91d2-43a6-8d35-ef089cf84b2d req-3c6e2760-c462-425a-acdd-b4c5664e8bf4 service nova] Acquiring lock "refresh_cache-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:44 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Updating instance_info_cache with network_info: [{"id": "1219420b-24a0-435b-aaa4-283c51d9a847", "address": "fa:16:3e:f4:b1:b4", "network": {"id": "18d0b7e0-69a8-4771-8e3a-665d0b5d2c75", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1386912740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219420b-24", "ovs_interfaceid": "1219420b-24a0-435b-aaa4-283c51d9a847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Releasing lock "refresh_cache-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Instance network_info: |[{"id": "1219420b-24a0-435b-aaa4-283c51d9a847", "address": "fa:16:3e:f4:b1:b4", "network": {"id": "18d0b7e0-69a8-4771-8e3a-665d0b5d2c75", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1386912740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219420b-24", "ovs_interfaceid": "1219420b-24a0-435b-aaa4-283c51d9a847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7b5f899f-91d2-43a6-8d35-ef089cf84b2d req-3c6e2760-c462-425a-acdd-b4c5664e8bf4 service nova] Acquired lock "refresh_cache-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.network.neutron [req-7b5f899f-91d2-43a6-8d35-ef089cf84b2d req-3c6e2760-c462-425a-acdd-b4c5664e8bf4 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Refreshing network info cache for port 1219420b-24a0-435b-aaa4-283c51d9a847 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Start _get_guest_xml network_info=[{"id": "1219420b-24a0-435b-aaa4-283c51d9a847", "address": "fa:16:3e:f4:b1:b4", "network": {"id": "18d0b7e0-69a8-4771-8e3a-665d0b5d2c75", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1386912740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219420b-24", "ovs_interfaceid": "1219420b-24a0-435b-aaa4-283c51d9a847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:22:45 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:22:45 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1053518687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1053518687',id=20,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz9ElrhNZZvItqxGapQtmVbaKvJMnHtVQyBhczgKvaO8d/GBJ06KdbJMsPoiJPdFlj8W+R0Nu4rD1BhABN0XoGYod9pe9msGHytqCXlWqPOlmLX9S/AlygQdInxVYWU+Q==',key_name='tempest-keypair-1649114374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6041024288a84808858ed4938f83fee5',ramdisk_id='',reservation_id='r-v4p52h60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1076524669',owner_user_name='tempest-TaggedAttachmentsTest-1076524669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:22:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a361c08c15664fbd880f06b487d62aa6',uuid=26cff7c2-b2a8-4a33-a2a0-3a63a2073d21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1219420b-24a0-435b-aaa4-283c51d9a847", "address": "fa:16:3e:f4:b1:b4", "network": {"id": "18d0b7e0-69a8-4771-8e3a-665d0b5d2c75", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1386912740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219420b-24", "ovs_interfaceid": "1219420b-24a0-435b-aaa4-283c51d9a847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Converting VIF {"id": "1219420b-24a0-435b-aaa4-283c51d9a847", "address": "fa:16:3e:f4:b1:b4", "network": {"id": "18d0b7e0-69a8-4771-8e3a-665d0b5d2c75", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1386912740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219420b-24", "ovs_interfaceid": "1219420b-24a0-435b-aaa4-283c51d9a847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b1:b4,bridge_name='br-int',has_traffic_filtering=True,id=1219420b-24a0-435b-aaa4-283c51d9a847,network=Network(18d0b7e0-69a8-4771-8e3a-665d0b5d2c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219420b-24') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lazy-loading 'pci_devices' on Instance uuid 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:22:45 user nova-compute[75071]:   <uuid>26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</uuid>
Dec 05 12:22:45 user nova-compute[75071]:   <name>instance-00000014</name>
Dec 05 12:22:45 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:22:45 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:22:45 user nova-compute[75071]:   <metadata>
Dec 05 12:22:45 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:22:45 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:22:45 user nova-compute[75071]:       <nova:name>tempest-device-tagging-server-1053518687</nova:name>
Dec 05 12:22:45 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:22:45</nova:creationTime>
Dec 05 12:22:45 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:22:45 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:22:45 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:22:45 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:22:45 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:22:45 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:22:45 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:22:45 user nova-compute[75071]:       <nova:owner>
Dec 05 12:22:45 user nova-compute[75071]:         <nova:user uuid="a361c08c15664fbd880f06b487d62aa6">tempest-TaggedAttachmentsTest-1076524669-project-member</nova:user>
Dec 05 12:22:45 user nova-compute[75071]:         <nova:project uuid="6041024288a84808858ed4938f83fee5">tempest-TaggedAttachmentsTest-1076524669</nova:project>
Dec 05 12:22:45 user nova-compute[75071]:       </nova:owner>
Dec 05 12:22:45 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:22:45 user nova-compute[75071]:       <nova:ports>
Dec 05 12:22:45 user nova-compute[75071]:         <nova:port uuid="1219420b-24a0-435b-aaa4-283c51d9a847">
Dec 05 12:22:45 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 12:22:45 user nova-compute[75071]:         </nova:port>
Dec 05 12:22:45 user nova-compute[75071]:       </nova:ports>
Dec 05 12:22:45 user nova-compute[75071]:     </nova:instance>
Dec 05 12:22:45 user nova-compute[75071]:   </metadata>
Dec 05 12:22:45 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:22:45 user nova-compute[75071]:     <system>
Dec 05 12:22:45 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:22:45 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:22:45 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:22:45 user nova-compute[75071]:       <entry name="serial">26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</entry>
Dec 05 12:22:45 user nova-compute[75071]:       <entry name="uuid">26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</entry>
Dec 05 12:22:45 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:22:45 user nova-compute[75071]:     </system>
Dec 05 12:22:45 user nova-compute[75071]:   </sysinfo>
Dec 05 12:22:45 user nova-compute[75071]:   <os>
Dec 05 12:22:45 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:22:45 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:22:45 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:22:45 user nova-compute[75071]:   </os>
Dec 05 12:22:45 user nova-compute[75071]:   <features>
Dec 05 12:22:45 user nova-compute[75071]:     <acpi/>
Dec 05 12:22:45 user nova-compute[75071]:     <apic/>
Dec 05 12:22:45 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:22:45 user nova-compute[75071]:   </features>
Dec 05 12:22:45 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:22:45 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:22:45 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:22:45 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:22:45 user nova-compute[75071]:   </clock>
Dec 05 12:22:45 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:22:45 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:22:45 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:22:45 user nova-compute[75071]:   </cpu>
Dec 05 12:22:45 user nova-compute[75071]:   <devices>
Dec 05 12:22:45 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:22:45 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:22:45 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk"/>
Dec 05 12:22:45 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:22:45 user nova-compute[75071]:     </disk>
Dec 05 12:22:45 user nova-compute[75071]:     <disk type="file" device="cdrom">
Dec 05 12:22:45 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none"/>
Dec 05 12:22:45 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk.config"/>
Dec 05 12:22:45 user nova-compute[75071]:       <target dev="hda" bus="ide"/>
Dec 05 12:22:45 user nova-compute[75071]:     </disk>
Dec 05 12:22:45 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:22:45 user nova-compute[75071]:       <mac address="fa:16:3e:f4:b1:b4"/>
Dec 05 12:22:45 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:22:45 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:22:45 user nova-compute[75071]:       <target dev="tap1219420b-24"/>
Dec 05 12:22:45 user nova-compute[75071]:     </interface>
Dec 05 12:22:45 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:22:45 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/console.log" append="off"/>
Dec 05 12:22:45 user nova-compute[75071]:     </serial>
Dec 05 12:22:45 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:22:45 user nova-compute[75071]:     <video>
Dec 05 12:22:45 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:22:45 user nova-compute[75071]:     </video>
Dec 05 12:22:45 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:22:45 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:22:45 user nova-compute[75071]:     </rng>
Dec 05 12:22:45 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:22:45 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:22:45 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:22:45 user nova-compute[75071]:     </memballoon>
Dec 05 12:22:45 user nova-compute[75071]:   </devices>
Dec 05 12:22:45 user nova-compute[75071]: </domain>
Dec 05 12:22:45 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1053518687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1053518687',id=20,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz9ElrhNZZvItqxGapQtmVbaKvJMnHtVQyBhczgKvaO8d/GBJ06KdbJMsPoiJPdFlj8W+R0Nu4rD1BhABN0XoGYod9pe9msGHytqCXlWqPOlmLX9S/AlygQdInxVYWU+Q==',key_name='tempest-keypair-1649114374',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6041024288a84808858ed4938f83fee5',ramdisk_id='',reservation_id='r-v4p52h60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1076524669',owner_user_name='tempest-TaggedAttachmentsTest-1076524669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:22:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a361c08c15664fbd880f06b487d62aa6',uuid=26cff7c2-b2a8-4a33-a2a0-3a63a2073d21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1219420b-24a0-435b-aaa4-283c51d9a847", "address": "fa:16:3e:f4:b1:b4", "network": {"id": "18d0b7e0-69a8-4771-8e3a-665d0b5d2c75", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1386912740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219420b-24", "ovs_interfaceid": "1219420b-24a0-435b-aaa4-283c51d9a847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Converting VIF {"id": "1219420b-24a0-435b-aaa4-283c51d9a847", "address": "fa:16:3e:f4:b1:b4", "network": {"id": "18d0b7e0-69a8-4771-8e3a-665d0b5d2c75", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1386912740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219420b-24", "ovs_interfaceid": "1219420b-24a0-435b-aaa4-283c51d9a847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b1:b4,bridge_name='br-int',has_traffic_filtering=True,id=1219420b-24a0-435b-aaa4-283c51d9a847,network=Network(18d0b7e0-69a8-4771-8e3a-665d0b5d2c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219420b-24') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG os_vif [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b1:b4,bridge_name='br-int',has_traffic_filtering=True,id=1219420b-24a0-435b-aaa4-283c51d9a847,network=Network(18d0b7e0-69a8-4771-8e3a-665d0b5d2c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219420b-24') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e3b5319-9d6e-50c7-9585-fc509702f132', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1219420b-24, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1219420b-24, col_values=(('qos', UUID('bb365763-5bb8-40fd-a9d1-24913665e08d')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1219420b-24, col_values=(('external_ids', {'iface-id': '1219420b-24a0-435b-aaa4-283c51d9a847', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:b1:b4', 'vm-uuid': '26cff7c2-b2a8-4a33-a2a0-3a63a2073d21'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:45 user nova-compute[75071]: INFO os_vif [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:b1:b4,bridge_name='br-int',has_traffic_filtering=True,id=1219420b-24a0-435b-aaa4-283c51d9a847,network=Network(18d0b7e0-69a8-4771-8e3a-665d0b5d2c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219420b-24')
Dec 05 12:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] No BDM found with device name hda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] No VIF found with MAC fa:16:3e:f4:b1:b4, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:22:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Using config drive
Dec 05 12:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Creating config drive at /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk.config
Dec 05 12:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7qmw_26t {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7qmw_26t" returned: 0 in 0.057s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.network.neutron [req-7b5f899f-91d2-43a6-8d35-ef089cf84b2d req-3c6e2760-c462-425a-acdd-b4c5664e8bf4 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Updated VIF entry in instance network info cache for port 1219420b-24a0-435b-aaa4-283c51d9a847. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG nova.network.neutron [req-7b5f899f-91d2-43a6-8d35-ef089cf84b2d req-3c6e2760-c462-425a-acdd-b4c5664e8bf4 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Updating instance_info_cache with network_info: [{"id": "1219420b-24a0-435b-aaa4-283c51d9a847", "address": "fa:16:3e:f4:b1:b4", "network": {"id": "18d0b7e0-69a8-4771-8e3a-665d0b5d2c75", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1386912740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219420b-24", "ovs_interfaceid": "1219420b-24a0-435b-aaa4-283c51d9a847", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7b5f899f-91d2-43a6-8d35-ef089cf84b2d req-3c6e2760-c462-425a-acdd-b4c5664e8bf4 service nova] Releasing lock "refresh_cache-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:22:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-8201c46a-9b29-43ec-bc9a-b578924295df req-711b68a2-2282-48c3-8662-39011d264f35 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received event network-vif-plugged-1219420b-24a0-435b-aaa4-283c51d9a847 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8201c46a-9b29-43ec-bc9a-b578924295df req-711b68a2-2282-48c3-8662-39011d264f35 service nova] Acquiring lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8201c46a-9b29-43ec-bc9a-b578924295df req-711b68a2-2282-48c3-8662-39011d264f35 service nova] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8201c46a-9b29-43ec-bc9a-b578924295df req-711b68a2-2282-48c3-8662-39011d264f35 service nova] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-8201c46a-9b29-43ec-bc9a-b578924295df req-711b68a2-2282-48c3-8662-39011d264f35 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] No waiting events found dispatching network-vif-plugged-1219420b-24a0-435b-aaa4-283c51d9a847 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:22:49 user nova-compute[75071]: WARNING nova.compute.manager [req-8201c46a-9b29-43ec-bc9a-b578924295df req-711b68a2-2282-48c3-8662-39011d264f35 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received unexpected event network-vif-plugged-1219420b-24a0-435b-aaa4-283c51d9a847 for instance with vm_state building and task_state spawning.
Dec 05 12:22:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-8c9fbdc3-72fb-47c6-8872-23dc08ea43ae req-e4e836bd-c1a4-4ac2-98c1-66a63906db8d service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received event network-changed-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-8c9fbdc3-72fb-47c6-8872-23dc08ea43ae req-e4e836bd-c1a4-4ac2-98c1-66a63906db8d service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Refreshing instance network info cache due to event network-changed-30895720-729f-445d-b49a-d843f1cb23a8. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8c9fbdc3-72fb-47c6-8872-23dc08ea43ae req-e4e836bd-c1a4-4ac2-98c1-66a63906db8d service nova] Acquiring lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8c9fbdc3-72fb-47c6-8872-23dc08ea43ae req-e4e836bd-c1a4-4ac2-98c1-66a63906db8d service nova] Acquired lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG nova.network.neutron [req-8c9fbdc3-72fb-47c6-8872-23dc08ea43ae req-e4e836bd-c1a4-4ac2-98c1-66a63906db8d service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Refreshing network info cache for port 30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-9cabe9e7-3e24-44e7-b623-cc2cee085218 req-03cd0f6e-9c0f-46aa-9fb6-b9a70f9f743b service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received event network-vif-plugged-1219420b-24a0-435b-aaa4-283c51d9a847 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9cabe9e7-3e24-44e7-b623-cc2cee085218 req-03cd0f6e-9c0f-46aa-9fb6-b9a70f9f743b service nova] Acquiring lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9cabe9e7-3e24-44e7-b623-cc2cee085218 req-03cd0f6e-9c0f-46aa-9fb6-b9a70f9f743b service nova] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9cabe9e7-3e24-44e7-b623-cc2cee085218 req-03cd0f6e-9c0f-46aa-9fb6-b9a70f9f743b service nova] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-9cabe9e7-3e24-44e7-b623-cc2cee085218 req-03cd0f6e-9c0f-46aa-9fb6-b9a70f9f743b service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] No waiting events found dispatching network-vif-plugged-1219420b-24a0-435b-aaa4-283c51d9a847 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:22:49 user nova-compute[75071]: WARNING nova.compute.manager [req-9cabe9e7-3e24-44e7-b623-cc2cee085218 req-03cd0f6e-9c0f-46aa-9fb6-b9a70f9f743b service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received unexpected event network-vif-plugged-1219420b-24a0-435b-aaa4-283c51d9a847 for instance with vm_state building and task_state spawning.
Dec 05 12:22:49 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:22:49 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:22:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=7396MB free_disk=25.307964324951172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:49 user nova-compute[75071]: INFO nova.compute.manager [None req-28c06de7-6e18-45e6-9270-16da1c8af777 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Unrescuing
Dec 05 12:22:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-28c06de7-6e18-45e6-9270-16da1c8af777 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:22:49 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Instance spawned successfully.
Dec 05 12:22:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:22:49 user nova-compute[75071]: INFO nova.compute.manager [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Took 6.94 seconds to spawn the instance on the hypervisor.
Dec 05 12:22:49 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 81333acc-8dc7-42f1-9026-e42a30e52a5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e08be776-0fa9-4871-86eb-2093530c00f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 854ee980-5c0b-4c4f-b9fd-609720e693be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 62efa94c-ae01-48aa-b3d3-0d23d159801c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 22a59c32-0b4a-4f5a-92bb-79c2882b515a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:22:50 user nova-compute[75071]: INFO nova.compute.manager [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Took 8.36 seconds to build instance.
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d46eaec4-d055-45a0-a9e5-ba6029151462 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.690s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Acquiring lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.objects.instance [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lazy-loading 'flavor' on Instance uuid 22a59c32-0b4a-4f5a-92bb-79c2882b515a {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.network.neutron [req-8c9fbdc3-72fb-47c6-8872-23dc08ea43ae req-e4e836bd-c1a4-4ac2-98c1-66a63906db8d service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updated VIF entry in instance network info cache for port 30895720-729f-445d-b49a-d843f1cb23a8. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.network.neutron [req-8c9fbdc3-72fb-47c6-8872-23dc08ea43ae req-e4e836bd-c1a4-4ac2-98c1-66a63906db8d service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updating instance_info_cache with network_info: [{"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8c9fbdc3-72fb-47c6-8872-23dc08ea43ae req-e4e836bd-c1a4-4ac2-98c1-66a63906db8d service nova] Releasing lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-28c06de7-6e18-45e6-9270-16da1c8af777 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquired lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.network.neutron [None req-28c06de7-6e18-45e6-9270-16da1c8af777 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Acquiring lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:50 user nova-compute[75071]: INFO nova.compute.manager [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Attaching volume 19bd4598-27a9-4012-a3a1-6c933f9909de to /dev/vdb
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG os_brick.utils [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[54afa09a-f02f-40c3-8c37-a1bf54d6aa33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ab782b-004c-4eba-8e6a-42a87e652741]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddf7b16-cd30-4011-aec6-9f0b8d26f48f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ae0eeb-11aa-481b-a063-effc12f40fc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:22:50 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:22:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1927727d-6c56-490d-847d-954085e297d6]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG os_brick.utils [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:22:50 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Updating existing volume attachment record: 808201da-b9a5-4094-844b-4a80aaa434f0 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG nova.network.neutron [None req-28c06de7-6e18-45e6-9270-16da1c8af777 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updating instance_info_cache with network_info: [{"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-28c06de7-6e18-45e6-9270-16da1c8af777 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Releasing lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG nova.objects.instance [None req-28c06de7-6e18-45e6-9270-16da1c8af777 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lazy-loading 'flavor' on Instance uuid e0c82eba-8448-4780-b92d-62d7c60ec7ef {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-a720b014-da59-48c8-a4e0-255c925848a8 req-d88bd925-5ab0-4abe-bc1a-aa45a56cfdce service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received event network-changed-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-a720b014-da59-48c8-a4e0-255c925848a8 req-d88bd925-5ab0-4abe-bc1a-aa45a56cfdce service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Refreshing instance network info cache due to event network-changed-30895720-729f-445d-b49a-d843f1cb23a8. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a720b014-da59-48c8-a4e0-255c925848a8 req-d88bd925-5ab0-4abe-bc1a-aa45a56cfdce service nova] Acquiring lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a720b014-da59-48c8-a4e0-255c925848a8 req-d88bd925-5ab0-4abe-bc1a-aa45a56cfdce service nova] Acquired lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG nova.network.neutron [req-a720b014-da59-48c8-a4e0-255c925848a8 req-d88bd925-5ab0-4abe-bc1a-aa45a56cfdce service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Refreshing network info cache for port 30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-e0e8d129-d113-478c-bd77-ea16c8fa3830 req-ae9e5d1b-bd9e-47e7-848f-226444fcc813 service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received event network-vif-unplugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e0e8d129-d113-478c-bd77-ea16c8fa3830 req-ae9e5d1b-bd9e-47e7-848f-226444fcc813 service nova] Acquiring lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e0e8d129-d113-478c-bd77-ea16c8fa3830 req-ae9e5d1b-bd9e-47e7-848f-226444fcc813 service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e0e8d129-d113-478c-bd77-ea16c8fa3830 req-ae9e5d1b-bd9e-47e7-848f-226444fcc813 service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-e0e8d129-d113-478c-bd77-ea16c8fa3830 req-ae9e5d1b-bd9e-47e7-848f-226444fcc813 service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] No waiting events found dispatching network-vif-unplugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:22:51 user nova-compute[75071]: WARNING nova.compute.manager [req-e0e8d129-d113-478c-bd77-ea16c8fa3830 req-ae9e5d1b-bd9e-47e7-848f-226444fcc813 service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received unexpected event network-vif-unplugged-30895720-729f-445d-b49a-d843f1cb23a8 for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:22:51 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 12:22:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-81333acc-8dc7-42f1-9026-e42a30e52a5a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-81333acc-8dc7-42f1-9026-e42a30e52a5a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lazy-loading 'info_cache' on Instance uuid 81333acc-8dc7-42f1-9026-e42a30e52a5a {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG nova.network.neutron [req-a720b014-da59-48c8-a4e0-255c925848a8 req-d88bd925-5ab0-4abe-bc1a-aa45a56cfdce service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updated VIF entry in instance network info cache for port 30895720-729f-445d-b49a-d843f1cb23a8. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG nova.network.neutron [req-a720b014-da59-48c8-a4e0-255c925848a8 req-d88bd925-5ab0-4abe-bc1a-aa45a56cfdce service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updating instance_info_cache with network_info: [{"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a720b014-da59-48c8-a4e0-255c925848a8 req-d88bd925-5ab0-4abe-bc1a-aa45a56cfdce service nova] Releasing lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:22:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Instance destroyed successfully.
Dec 05 12:22:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "81333acc-8dc7-42f1-9026-e42a30e52a5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "81333acc-8dc7-42f1-9026-e42a30e52a5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:52 user nova-compute[75071]: INFO nova.compute.manager [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Terminating instance
Dec 05 12:22:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Updating instance_info_cache with network_info: [{"id": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "address": "fa:16:3e:53:f5:d1", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcda865e-a8", "ovs_interfaceid": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-81333acc-8dc7-42f1-9026-e42a30e52a5a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:22:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:53 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Instance destroyed successfully.
Dec 05 12:22:53 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lazy-loading 'resources' on Instance uuid 81333acc-8dc7-42f1-9026-e42a30e52a5a {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:16:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1354621952',display_name='tempest-AttachVolumeNegativeTest-server-1354621952',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1354621952',id=1,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGuZXR1cGsv6IXUCU3yHn0jwELABItzEJlxPUpxrDBqByQSVywlXx5ET9iaHgOwsb/KQz1xcz5lPQZ6kLJttJC4cScZ9m8RxyQCf+l8X9iK8fvojH4Ti+cbkTntTtiZYyg==',key_name='tempest-keypair-830669204',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:17:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5c1a038a4eb45508b7f5aa3eb435229',ramdisk_id='',reservation_id='r-005uxusz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1152460930',owner_user_name='tempest-AttachVolumeNegativeTest-1152460930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:17:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d78c212de2e426fad0cba51a2e7bf52',uuid=81333acc-8dc7-42f1-9026-e42a30e52a5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "address": "fa:16:3e:53:f5:d1", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcda865e-a8", "ovs_interfaceid": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converting VIF {"id": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "address": "fa:16:3e:53:f5:d1", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcda865e-a8", "ovs_interfaceid": "bcda865e-a8e7-4f6a-a633-95c0d037b04e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:f5:d1,bridge_name='br-int',has_traffic_filtering=True,id=bcda865e-a8e7-4f6a-a633-95c0d037b04e,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcda865e-a8') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG os_vif [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:f5:d1,bridge_name='br-int',has_traffic_filtering=True,id=bcda865e-a8e7-4f6a-a633-95c0d037b04e,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcda865e-a8') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcda865e-a8, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2396fe65-c614-4c4c-90ce-59c84bf0445c) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:53 user nova-compute[75071]: INFO os_vif [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:f5:d1,bridge_name='br-int',has_traffic_filtering=True,id=bcda865e-a8e7-4f6a-a633-95c0d037b04e,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcda865e-a8')
Dec 05 12:22:53 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Deleting instance files /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a_del
Dec 05 12:22:53 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Deletion of /opt/stack/data/nova/instances/81333acc-8dc7-42f1-9026-e42a30e52a5a_del complete
Dec 05 12:22:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-70922099-52c2-4c89-9aaf-218b41dfd657 req-6fa5a582-1470-44cb-a35d-46fe77a68f59 service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received event network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-70922099-52c2-4c89-9aaf-218b41dfd657 req-6fa5a582-1470-44cb-a35d-46fe77a68f59 service nova] Acquiring lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-70922099-52c2-4c89-9aaf-218b41dfd657 req-6fa5a582-1470-44cb-a35d-46fe77a68f59 service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-70922099-52c2-4c89-9aaf-218b41dfd657 req-6fa5a582-1470-44cb-a35d-46fe77a68f59 service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-70922099-52c2-4c89-9aaf-218b41dfd657 req-6fa5a582-1470-44cb-a35d-46fe77a68f59 service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] No waiting events found dispatching network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:22:53 user nova-compute[75071]: WARNING nova.compute.manager [req-70922099-52c2-4c89-9aaf-218b41dfd657 req-6fa5a582-1470-44cb-a35d-46fe77a68f59 service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received unexpected event network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:22:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-70922099-52c2-4c89-9aaf-218b41dfd657 req-6fa5a582-1470-44cb-a35d-46fe77a68f59 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Received event network-vif-unplugged-bcda865e-a8e7-4f6a-a633-95c0d037b04e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-70922099-52c2-4c89-9aaf-218b41dfd657 req-6fa5a582-1470-44cb-a35d-46fe77a68f59 service nova] Acquiring lock "81333acc-8dc7-42f1-9026-e42a30e52a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-70922099-52c2-4c89-9aaf-218b41dfd657 req-6fa5a582-1470-44cb-a35d-46fe77a68f59 service nova] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-70922099-52c2-4c89-9aaf-218b41dfd657 req-6fa5a582-1470-44cb-a35d-46fe77a68f59 service nova] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-70922099-52c2-4c89-9aaf-218b41dfd657 req-6fa5a582-1470-44cb-a35d-46fe77a68f59 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] No waiting events found dispatching network-vif-unplugged-bcda865e-a8e7-4f6a-a633-95c0d037b04e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-70922099-52c2-4c89-9aaf-218b41dfd657 req-6fa5a582-1470-44cb-a35d-46fe77a68f59 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Received event network-vif-unplugged-bcda865e-a8e7-4f6a-a633-95c0d037b04e for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-70922099-52c2-4c89-9aaf-218b41dfd657 req-6fa5a582-1470-44cb-a35d-46fe77a68f59 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Received event network-vif-plugged-bcda865e-a8e7-4f6a-a633-95c0d037b04e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-70922099-52c2-4c89-9aaf-218b41dfd657 req-6fa5a582-1470-44cb-a35d-46fe77a68f59 service nova] Acquiring lock "81333acc-8dc7-42f1-9026-e42a30e52a5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-70922099-52c2-4c89-9aaf-218b41dfd657 req-6fa5a582-1470-44cb-a35d-46fe77a68f59 service nova] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-70922099-52c2-4c89-9aaf-218b41dfd657 req-6fa5a582-1470-44cb-a35d-46fe77a68f59 service nova] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-70922099-52c2-4c89-9aaf-218b41dfd657 req-6fa5a582-1470-44cb-a35d-46fe77a68f59 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] No waiting events found dispatching network-vif-plugged-bcda865e-a8e7-4f6a-a633-95c0d037b04e {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:22:53 user nova-compute[75071]: WARNING nova.compute.manager [req-70922099-52c2-4c89-9aaf-218b41dfd657 req-6fa5a582-1470-44cb-a35d-46fe77a68f59 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Received unexpected event network-vif-plugged-bcda865e-a8e7-4f6a-a633-95c0d037b04e for instance with vm_state active and task_state deleting.
Dec 05 12:22:53 user nova-compute[75071]: INFO nova.compute.manager [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Took 1.49 seconds to destroy the instance on the hypervisor.
Dec 05 12:22:53 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:22:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:54 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:22:54 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Took 1.00 seconds to deallocate network for instance.
Dec 05 12:22:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-449c18f1-1937-4e98-bae2-85463b719cf2 req-7e360840-8736-4116-ad8c-294079811355 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Received event network-vif-deleted-bcda865e-a8e7-4f6a-a633-95c0d037b04e {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:54 user nova-compute[75071]: INFO nova.compute.manager [req-449c18f1-1937-4e98-bae2-85463b719cf2 req-7e360840-8736-4116-ad8c-294079811355 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Neutron deleted interface bcda865e-a8e7-4f6a-a633-95c0d037b04e; detaching it from the instance and deleting it from the info cache
Dec 05 12:22:54 user nova-compute[75071]: DEBUG nova.network.neutron [req-449c18f1-1937-4e98-bae2-85463b719cf2 req-7e360840-8736-4116-ad8c-294079811355 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:22:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-449c18f1-1937-4e98-bae2-85463b719cf2 req-7e360840-8736-4116-ad8c-294079811355 service nova] [instance: 81333acc-8dc7-42f1-9026-e42a30e52a5a] Detach interface failed, port_id=bcda865e-a8e7-4f6a-a633-95c0d037b04e, reason: Instance 81333acc-8dc7-42f1-9026-e42a30e52a5a could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:22:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:55 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:22:55 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:55 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Deleted allocations for instance 81333acc-8dc7-42f1-9026-e42a30e52a5a
Dec 05 12:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b5e97d67-66be-4cb9-95d1-44fda51021d2 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "81333acc-8dc7-42f1-9026-e42a30e52a5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.256s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-edbe79c5-bb6a-41ef-ab14-45724620676f req-8708753e-353a-4329-85ac-770b0304fb27 service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received event network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-edbe79c5-bb6a-41ef-ab14-45724620676f req-8708753e-353a-4329-85ac-770b0304fb27 service nova] Acquiring lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-edbe79c5-bb6a-41ef-ab14-45724620676f req-8708753e-353a-4329-85ac-770b0304fb27 service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-edbe79c5-bb6a-41ef-ab14-45724620676f req-8708753e-353a-4329-85ac-770b0304fb27 service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-edbe79c5-bb6a-41ef-ab14-45724620676f req-8708753e-353a-4329-85ac-770b0304fb27 service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] No waiting events found dispatching network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:22:55 user nova-compute[75071]: WARNING nova.compute.manager [req-edbe79c5-bb6a-41ef-ab14-45724620676f req-8708753e-353a-4329-85ac-770b0304fb27 service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received unexpected event network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:22:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-edbe79c5-bb6a-41ef-ab14-45724620676f req-8708753e-353a-4329-85ac-770b0304fb27 service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received event network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-edbe79c5-bb6a-41ef-ab14-45724620676f req-8708753e-353a-4329-85ac-770b0304fb27 service nova] Acquiring lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-edbe79c5-bb6a-41ef-ab14-45724620676f req-8708753e-353a-4329-85ac-770b0304fb27 service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:22:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-edbe79c5-bb6a-41ef-ab14-45724620676f req-8708753e-353a-4329-85ac-770b0304fb27 service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:22:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-edbe79c5-bb6a-41ef-ab14-45724620676f req-8708753e-353a-4329-85ac-770b0304fb27 service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] No waiting events found dispatching network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:22:55 user nova-compute[75071]: WARNING nova.compute.manager [req-edbe79c5-bb6a-41ef-ab14-45724620676f req-8708753e-353a-4329-85ac-770b0304fb27 service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received unexpected event network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:22:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-28c06de7-6e18-45e6-9270-16da1c8af777 tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:22:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:22:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puqfvkSP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:23:01 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:23:01 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:23:01 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74dc4ae-b268-4b2e-b1b2-b4f3c095fa21]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:23:01 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9af952-cf31-437b-8a43-c497b25f9f22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de] added
Dec 05 12:23:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.057s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe388c1-7681-4f2d-8c20-9718a177f9a0]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10bf7c1-0d81-451c-b821-24a7060dac30]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v puqfvkSP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v puqfvkSP" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de88bb9-6b3d-4124-b284-7885174ff4f7]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'puqfvkSP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[923ded17-30f5-4c30-9a28-0e495ea345c6]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[49429ec4-d20c-4e39-8b15-211580c234cd]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:23:01 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:23:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:23:01 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:23:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cbc4ee-4869-40ff-ad3d-2bec6bd35535]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de, portal: 172.16.0.220,3260]
Dec 05 12:23:01 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de, portal: 172.16.0.220,3260] successful.
Dec 05 12:23:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[017dcf27-7fb8-4c9f-b8c4-3dd2ee57da27]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d6cbd1-6a80-4bff-b779-89431ecd3c40]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:23:01 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:23:01 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de (non-flash)
Dec 05 12:23:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:23:01 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:23:01 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de (non-flash)
Dec 05 12:23:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e7fc18-a2b1-4b57-ac10-b8204b9f4f50]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:23:02 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:23:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puqfvkSP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:23:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:23:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23364663664313864', 'path': '/dev/sdd'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:23:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364663664313864', 'path': '/dev/sdd'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:23:03 user nova-compute[75071]: DEBUG nova.objects.instance [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lazy-loading 'flavor' on Instance uuid 22a59c32-0b4a-4f5a-92bb-79c2882b515a {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:23:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:23:03 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:23:03 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Dec 05 12:23:03 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:23:03 user nova-compute[75071]:   <serial>19bd4598-27a9-4012-a3a1-6c933f9909de</serial>
Dec 05 12:23:03 user nova-compute[75071]: </disk>
Dec 05 12:23:03 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:23:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:23:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:23:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] No VIF found with MAC fa:16:3e:09:64:8c, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:23:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-075d0e4d-25e6-4266-928f-b4b0f660e06d tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.014s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Acquiring lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Acquiring lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:04 user nova-compute[75071]: INFO nova.compute.manager [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Terminating instance
Dec 05 12:23:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-f1f8c6c8-3aaa-40a9-9248-72c35b8e4583 req-e0a594c8-801c-4fee-acfb-4726c031ebfb service nova] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Received event network-vif-unplugged-50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f1f8c6c8-3aaa-40a9-9248-72c35b8e4583 req-e0a594c8-801c-4fee-acfb-4726c031ebfb service nova] Acquiring lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f1f8c6c8-3aaa-40a9-9248-72c35b8e4583 req-e0a594c8-801c-4fee-acfb-4726c031ebfb service nova] Lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f1f8c6c8-3aaa-40a9-9248-72c35b8e4583 req-e0a594c8-801c-4fee-acfb-4726c031ebfb service nova] Lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-f1f8c6c8-3aaa-40a9-9248-72c35b8e4583 req-e0a594c8-801c-4fee-acfb-4726c031ebfb service nova] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] No waiting events found dispatching network-vif-unplugged-50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-f1f8c6c8-3aaa-40a9-9248-72c35b8e4583 req-e0a594c8-801c-4fee-acfb-4726c031ebfb service nova] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Received event network-vif-unplugged-50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:23:05 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Instance destroyed successfully.
Dec 05 12:23:05 user nova-compute[75071]: DEBUG nova.objects.instance [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lazy-loading 'resources' on Instance uuid 22a59c32-0b4a-4f5a-92bb-79c2882b515a {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:20:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-712981727',display_name='tempest-DeleteServersTestJSON-server-712981727',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-712981727',id=15,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:21:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='896fedb155fd4942baf7dd1b9b074eba',ramdisk_id='',reservation_id='r-hgnlbhhx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-178107000',owner_user_name='tempest-DeleteServersTestJSON-178107000-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:21:06Z,user_data=None,user_id='8329e945f94544ef849d35de4726bad8',uuid=22a59c32-0b4a-4f5a-92bb-79c2882b515a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "address": "fa:16:3e:09:64:8c", "network": {"id": "242fcf8b-eac4-4ad5-915c-3dcf23b9d522", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-57708078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "896fedb155fd4942baf7dd1b9b074eba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ffdfa4-c4", "ovs_interfaceid": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Converting VIF {"id": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "address": "fa:16:3e:09:64:8c", "network": {"id": "242fcf8b-eac4-4ad5-915c-3dcf23b9d522", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-57708078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "896fedb155fd4942baf7dd1b9b074eba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50ffdfa4-c4", "ovs_interfaceid": "50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:64:8c,bridge_name='br-int',has_traffic_filtering=True,id=50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c,network=Network(242fcf8b-eac4-4ad5-915c-3dcf23b9d522),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50ffdfa4-c4') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG os_vif [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:64:8c,bridge_name='br-int',has_traffic_filtering=True,id=50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c,network=Network(242fcf8b-eac4-4ad5-915c-3dcf23b9d522),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50ffdfa4-c4') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50ffdfa4-c4, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7b81730-38fc-443b-990c-e1ba1e0590b7) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:05 user nova-compute[75071]: INFO os_vif [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:64:8c,bridge_name='br-int',has_traffic_filtering=True,id=50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c,network=Network(242fcf8b-eac4-4ad5-915c-3dcf23b9d522),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50ffdfa4-c4')
Dec 05 12:23:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'puqfvkSP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:23:05 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:23:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[091823b2-fc59-41fc-acf8-cd373d9f0a2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:23:05 user nova-compute[75071]: No targets found.
Dec 05 12:23:05 user nova-compute[75071]: iSNS:
Dec 05 12:23:05 user nova-compute[75071]: No targets found.
Dec 05 12:23:05 user nova-compute[75071]: STATIC:
Dec 05 12:23:05 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:23:05 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:23:05 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:23:05 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de
Dec 05 12:23:05 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:23:05 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:23:05 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be
Dec 05 12:23:05 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:23:05 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:23:05 user nova-compute[75071]: FIRMWARE:
Dec 05 12:23:05 user nova-compute[75071]: No targets found.
Dec 05 12:23:05 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:23:05 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:23:05 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5c0e3e-9ff4-4dbb-9980-dd6ee7c3ab1d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88b6eb6-042e-402e-a53e-eeea0e996c1e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:23:05 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:23:05 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de (non-flash)
Dec 05 12:23:05 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:23:05 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:23:05 user nova-compute[75071]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de (non-flash)
Dec 05 12:23:05 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f826412f010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de'): ({'sdd'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Removing single pathed devices sdd {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:23:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb9a025-2485-4a67-b49f-27c3311f5fad]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc934ee-22f9-4d1c-9416-a703aa9a58a9]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Flushing IO for device /dev/sdd {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e8af37-a42a-4f37-aa93-c43d267ecffa]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0bff64-1e4a-43e9-b4a7-cae401f1b3f5]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[36160752-59d0-416a-97ef-89ccc54ac429]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba3a786-4dc4-416b-a34f-1d3a45cbe214]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de, portal: 172.16.0.220,3260]
Dec 05 12:23:06 user nova-compute[75071]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de, portal: 172.16.0.220,3260] successful.
Dec 05 12:23:06 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "854ee980-5c0b-4c4f-b9fd-609720e693be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "854ee980-5c0b-4c4f-b9fd-609720e693be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:06 user nova-compute[75071]: INFO nova.compute.manager [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Terminating instance
Dec 05 12:23:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19bd4598-27a9-4012-a3a1-6c933f9909de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1f1dc2-3d4c-4945-83e0-e04d1c67874d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] <== disconnect_volume: return (352ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:23:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Deleting instance files /opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a_del
Dec 05 12:23:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Deletion of /opt/stack/data/nova/instances/22a59c32-0b4a-4f5a-92bb-79c2882b515a_del complete
Dec 05 12:23:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:06 user nova-compute[75071]: INFO nova.compute.manager [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Took 1.44 seconds to destroy the instance on the hypervisor.
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-cb2a72aa-0065-41b0-bb88-51d8e281dac2 req-ccf5be57-d4fa-4d07-a34e-22b4e85c87cc service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Received event network-vif-unplugged-cbc3d793-a281-45c9-a3fa-4d1fb88a3d45 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cb2a72aa-0065-41b0-bb88-51d8e281dac2 req-ccf5be57-d4fa-4d07-a34e-22b4e85c87cc service nova] Acquiring lock "854ee980-5c0b-4c4f-b9fd-609720e693be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cb2a72aa-0065-41b0-bb88-51d8e281dac2 req-ccf5be57-d4fa-4d07-a34e-22b4e85c87cc service nova] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cb2a72aa-0065-41b0-bb88-51d8e281dac2 req-ccf5be57-d4fa-4d07-a34e-22b4e85c87cc service nova] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-cb2a72aa-0065-41b0-bb88-51d8e281dac2 req-ccf5be57-d4fa-4d07-a34e-22b4e85c87cc service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] No waiting events found dispatching network-vif-unplugged-cbc3d793-a281-45c9-a3fa-4d1fb88a3d45 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:23:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-cb2a72aa-0065-41b0-bb88-51d8e281dac2 req-ccf5be57-d4fa-4d07-a34e-22b4e85c87cc service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Received event network-vif-unplugged-cbc3d793-a281-45c9-a3fa-4d1fb88a3d45 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:23:07 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Instance destroyed successfully.
Dec 05 12:23:07 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lazy-loading 'resources' on Instance uuid 854ee980-5c0b-4c4f-b9fd-609720e693be {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:23:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:17:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1355481569',display_name='tempest-VolumesAdminNegativeTest-server-1355481569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1355481569',id=4,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHFTB8HtgrqlNwPyex8IYW2vacfK6EMhzbU2JJdY4CzU23aR6X4QA+ipUCcyuWI8/YpvhZXi5b0UFWPhZSw2v/wLJTbmVzYBW+oXwyQRbJnDKovYkkmvcXwa+oWeY/I+w==',key_name='tempest-keypair-623525767',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:17:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80bbd8689228459cb4bf4e93caebbf39',ramdisk_id='',reservation_id='r-tzbzipak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1655468341',owner_user_name='tempest-VolumesAdminNegativeTest-1655468341-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d5aa0fe91fac4908b24204673a6c3af1',uuid=854ee980-5c0b-4c4f-b9fd-609720e693be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "address": "fa:16:3e:85:5c:09", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc3d793-a2", "ovs_interfaceid": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:23:07 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Converting VIF {"id": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "address": "fa:16:3e:85:5c:09", "network": {"id": "30520b35-382e-42c5-8395-8dddfacb2b0b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1550860922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80bbd8689228459cb4bf4e93caebbf39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbc3d793-a2", "ovs_interfaceid": "cbc3d793-a281-45c9-a3fa-4d1fb88a3d45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:23:07 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:5c:09,bridge_name='br-int',has_traffic_filtering=True,id=cbc3d793-a281-45c9-a3fa-4d1fb88a3d45,network=Network(30520b35-382e-42c5-8395-8dddfacb2b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc3d793-a2') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:23:07 user nova-compute[75071]: DEBUG os_vif [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:5c:09,bridge_name='br-int',has_traffic_filtering=True,id=cbc3d793-a281-45c9-a3fa-4d1fb88a3d45,network=Network(30520b35-382e-42c5-8395-8dddfacb2b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc3d793-a2') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:23:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbc3d793-a2, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:23:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29f5b4e1-534c-4daa-8e9a-3fb5b5d8b2db) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:23:07 user nova-compute[75071]: INFO os_vif [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:5c:09,bridge_name='br-int',has_traffic_filtering=True,id=cbc3d793-a281-45c9-a3fa-4d1fb88a3d45,network=Network(30520b35-382e-42c5-8395-8dddfacb2b0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbc3d793-a2')
Dec 05 12:23:07 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Deleting instance files /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be_del
Dec 05 12:23:07 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Deletion of /opt/stack/data/nova/instances/854ee980-5c0b-4c4f-b9fd-609720e693be_del complete
Dec 05 12:23:07 user nova-compute[75071]: INFO nova.compute.manager [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Took 1.02 seconds to destroy the instance on the hypervisor.
Dec 05 12:23:07 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:23:07 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:23:07 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:23:07 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:23:07 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Took 0.97 seconds to deallocate network for instance.
Dec 05 12:23:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-e4803fb6-0bf2-4dff-bbc9-1307e8b4ebd2 req-b69d893d-e1c2-4b14-81bb-c976a46f7958 service nova] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Received event network-vif-plugged-50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:23:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e4803fb6-0bf2-4dff-bbc9-1307e8b4ebd2 req-b69d893d-e1c2-4b14-81bb-c976a46f7958 service nova] Acquiring lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e4803fb6-0bf2-4dff-bbc9-1307e8b4ebd2 req-b69d893d-e1c2-4b14-81bb-c976a46f7958 service nova] Lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e4803fb6-0bf2-4dff-bbc9-1307e8b4ebd2 req-b69d893d-e1c2-4b14-81bb-c976a46f7958 service nova] Lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-e4803fb6-0bf2-4dff-bbc9-1307e8b4ebd2 req-b69d893d-e1c2-4b14-81bb-c976a46f7958 service nova] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] No waiting events found dispatching network-vif-plugged-50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:23:07 user nova-compute[75071]: WARNING nova.compute.manager [req-e4803fb6-0bf2-4dff-bbc9-1307e8b4ebd2 req-b69d893d-e1c2-4b14-81bb-c976a46f7958 service nova] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Received unexpected event network-vif-plugged-50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c for instance with vm_state active and task_state deleting.
Dec 05 12:23:08 user nova-compute[75071]: INFO nova.compute.manager [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Took 0.91 seconds to detach 1 volumes for instance.
Dec 05 12:23:08 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:23:08 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Took 1.06 seconds to deallocate network for instance.
Dec 05 12:23:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:08 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Refreshing inventories for resource provider 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 12:23:08 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Updating ProviderTree inventory for provider 25beb694-9dd7-475f-9657-74a5f0368417 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 12:23:08 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Updating inventory in ProviderTree for provider 25beb694-9dd7-475f-9657-74a5f0368417 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 12:23:08 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Refreshing aggregate associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 12:23:08 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Refreshing trait associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 12:23:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-ed0dfc94-30e9-4ead-94a4-c1ec9d728310 req-833a7908-b81e-4fcf-a4da-a07388bb030a service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Received event network-vif-plugged-cbc3d793-a281-45c9-a3fa-4d1fb88a3d45 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:23:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ed0dfc94-30e9-4ead-94a4-c1ec9d728310 req-833a7908-b81e-4fcf-a4da-a07388bb030a service nova] Acquiring lock "854ee980-5c0b-4c4f-b9fd-609720e693be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ed0dfc94-30e9-4ead-94a4-c1ec9d728310 req-833a7908-b81e-4fcf-a4da-a07388bb030a service nova] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ed0dfc94-30e9-4ead-94a4-c1ec9d728310 req-833a7908-b81e-4fcf-a4da-a07388bb030a service nova] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-ed0dfc94-30e9-4ead-94a4-c1ec9d728310 req-833a7908-b81e-4fcf-a4da-a07388bb030a service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] No waiting events found dispatching network-vif-plugged-cbc3d793-a281-45c9-a3fa-4d1fb88a3d45 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:23:08 user nova-compute[75071]: WARNING nova.compute.manager [req-ed0dfc94-30e9-4ead-94a4-c1ec9d728310 req-833a7908-b81e-4fcf-a4da-a07388bb030a service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Received unexpected event network-vif-plugged-cbc3d793-a281-45c9-a3fa-4d1fb88a3d45 for instance with vm_state deleted and task_state None.
Dec 05 12:23:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-ed0dfc94-30e9-4ead-94a4-c1ec9d728310 req-833a7908-b81e-4fcf-a4da-a07388bb030a service nova] [instance: 22a59c32-0b4a-4f5a-92bb-79c2882b515a] Received event network-vif-deleted-50ffdfa4-c490-4b0f-b5f0-efbe3ac9ac3c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:23:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-ed0dfc94-30e9-4ead-94a4-c1ec9d728310 req-833a7908-b81e-4fcf-a4da-a07388bb030a service nova] [instance: 854ee980-5c0b-4c4f-b9fd-609720e693be] Received event network-vif-deleted-cbc3d793-a281-45c9-a3fa-4d1fb88a3d45 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:23:08 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:23:08 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:23:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.617s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.593s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:09 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Deleted allocations for instance 854ee980-5c0b-4c4f-b9fd-609720e693be
Dec 05 12:23:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b8436aaf-e7c7-4929-9c60-e3bc56d40535 tempest-VolumesAdminNegativeTest-1655468341 tempest-VolumesAdminNegativeTest-1655468341-project-member] Lock "854ee980-5c0b-4c4f-b9fd-609720e693be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.917s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:09 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:23:09 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:23:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:09 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Deleted allocations for instance 22a59c32-0b4a-4f5a-92bb-79c2882b515a
Dec 05 12:23:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-892b6119-7445-4c5e-813d-bb0592dafae3 tempest-DeleteServersTestJSON-178107000 tempest-DeleteServersTestJSON-178107000-project-member] Lock "22a59c32-0b4a-4f5a-92bb-79c2882b515a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.583s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_power_states {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid e08be776-0fa9-4871-86eb-2093530c00f3 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid e0c82eba-8448-4780-b92d-62d7c60ec7ef {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 62efa94c-ae01-48aa-b3d3-0d23d159801c {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "e08be776-0fa9-4871-86eb-2093530c00f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "e08be776-0fa9-4871-86eb-2093530c00f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "62efa94c-ae01-48aa-b3d3-0d23d159801c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "e08be776-0fa9-4871-86eb-2093530c00f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquiring lock "10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquiring lock "10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:13 user nova-compute[75071]: INFO nova.compute.manager [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Terminating instance
Dec 05 12:23:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:13 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Instance destroyed successfully.
Dec 05 12:23:13 user nova-compute[75071]: DEBUG nova.objects.instance [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lazy-loading 'resources' on Instance uuid 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:21:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1362406998',display_name='tempest-VolumesActionsTest-instance-1362406998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1362406998',id=16,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:21:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dce66477a63c44ac8df4b147456f3653',ramdisk_id='',reservation_id='r-tibipm47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-128873361',owner_user_name='tempest-VolumesActionsTest-128873361-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:21:29Z,user_data=None,user_id='44a85d29f03344119f15021c037ae5e0',uuid=10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "address": "fa:16:3e:34:0f:1d", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc59b402-1e", "ovs_interfaceid": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Converting VIF {"id": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "address": "fa:16:3e:34:0f:1d", "network": {"id": "a5b2962d-4c1e-40d6-adc0-ea51e41d06a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-24674144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dce66477a63c44ac8df4b147456f3653", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc59b402-1e", "ovs_interfaceid": "cc59b402-1e5e-42ad-baf9-ab91fc3b0055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:0f:1d,bridge_name='br-int',has_traffic_filtering=True,id=cc59b402-1e5e-42ad-baf9-ab91fc3b0055,network=Network(a5b2962d-4c1e-40d6-adc0-ea51e41d06a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc59b402-1e') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG os_vif [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:0f:1d,bridge_name='br-int',has_traffic_filtering=True,id=cc59b402-1e5e-42ad-baf9-ab91fc3b0055,network=Network(a5b2962d-4c1e-40d6-adc0-ea51e41d06a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc59b402-1e') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc59b402-1e, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a63c9b22-fe19-4523-a8af-a1cc2acb0d73) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:13 user nova-compute[75071]: INFO os_vif [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:0f:1d,bridge_name='br-int',has_traffic_filtering=True,id=cc59b402-1e5e-42ad-baf9-ab91fc3b0055,network=Network(a5b2962d-4c1e-40d6-adc0-ea51e41d06a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc59b402-1e')
Dec 05 12:23:13 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Deleting instance files /opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9_del
Dec 05 12:23:13 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Deletion of /opt/stack/data/nova/instances/10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9_del complete
Dec 05 12:23:14 user nova-compute[75071]: INFO nova.compute.manager [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Took 0.74 seconds to destroy the instance on the hypervisor.
Dec 05 12:23:14 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:23:14 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:23:14 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:23:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:14 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:23:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-d1b23dc4-96e0-482a-bc84-77c4f10a35cb req-2c1b5cd3-f15f-4234-a912-703b157f36e3 service nova] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Received event network-vif-deleted-cc59b402-1e5e-42ad-baf9-ab91fc3b0055 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:23:14 user nova-compute[75071]: INFO nova.compute.manager [req-d1b23dc4-96e0-482a-bc84-77c4f10a35cb req-2c1b5cd3-f15f-4234-a912-703b157f36e3 service nova] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Neutron deleted interface cc59b402-1e5e-42ad-baf9-ab91fc3b0055; detaching it from the instance and deleting it from the info cache
Dec 05 12:23:14 user nova-compute[75071]: DEBUG nova.network.neutron [req-d1b23dc4-96e0-482a-bc84-77c4f10a35cb req-2c1b5cd3-f15f-4234-a912-703b157f36e3 service nova] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:23:14 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Took 0.63 seconds to deallocate network for instance.
Dec 05 12:23:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-d1b23dc4-96e0-482a-bc84-77c4f10a35cb req-2c1b5cd3-f15f-4234-a912-703b157f36e3 service nova] [instance: 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9] Detach interface failed, port_id=cc59b402-1e5e-42ad-baf9-ab91fc3b0055, reason: Instance 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:23:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:15 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:23:15 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:23:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:15 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Deleted allocations for instance 10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9
Dec 05 12:23:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89d67812-741c-460d-ab15-c0f3eb713b96 tempest-VolumesActionsTest-128873361 tempest-VolumesActionsTest-128873361-project-member] Lock "10d0a8d4-0b9d-4baa-8f37-6ab9c51cf2e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.928s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:23:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:23:19 user nova-compute[75071]: INFO nova.compute.claims [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Claim successful on node user
Dec 05 12:23:19 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:23:19 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:23:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:23:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:23:19 user nova-compute[75071]: DEBUG nova.network.neutron [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:23:19 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:23:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:23:19 user nova-compute[75071]: DEBUG nova.policy [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a70218d8181040818ed8290e743bd2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cda9a88b434e66ad6d8ac75790d141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:23:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:23:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:23:19 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Creating image(s)
Dec 05 12:23:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "/opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "/opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "/opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.378s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Successfully created port: a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk 1073741824" returned: 0 in 0.058s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Cannot resize image /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Ensure instance console log exists: /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Successfully updated port: a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquired lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-e0aa01f8-5b05-470e-8d1c-c1fe4a8e3f08 req-ee6e0519-ef42-413f-8a67-bb040edcde9b service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received event network-changed-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-e0aa01f8-5b05-470e-8d1c-c1fe4a8e3f08 req-ee6e0519-ef42-413f-8a67-bb040edcde9b service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Refreshing instance network info cache due to event network-changed-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e0aa01f8-5b05-470e-8d1c-c1fe4a8e3f08 req-ee6e0519-ef42-413f-8a67-bb040edcde9b service nova] Acquiring lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Updating instance_info_cache with network_info: [{"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Releasing lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Instance network_info: |[{"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e0aa01f8-5b05-470e-8d1c-c1fe4a8e3f08 req-ee6e0519-ef42-413f-8a67-bb040edcde9b service nova] Acquired lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-e0aa01f8-5b05-470e-8d1c-c1fe4a8e3f08 req-ee6e0519-ef42-413f-8a67-bb040edcde9b service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Refreshing network info cache for port a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Start _get_guest_xml network_info=[{"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:23:21 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:23:21 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-6013421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-6013421',id=21,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4ojfp9xi4tIHEe5RUJWGaicVoCqfOcH9OAOng/6HjRCsqOv8KiR+xZvXDUbR4ocmbrJ48luSYFcwek/7Ldu8YJzwjPZxeE+cTAt0k9n2mCG+3kSNO0REXWDGwoZVYSrA==',key_name='tempest-keypair-399432094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36cda9a88b434e66ad6d8ac75790d141',ramdisk_id='',reservation_id='r-xmrtzxbg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1822750901',owner_user_name='tempest-AttachVolumeShelveTestJSON-1822750901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:23:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a70218d8181040818ed8290e743bd2db',uuid=cad9a071-e232-4629-a3cc-9cb9d3fe9333,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converting VIF {"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:89,bridge_name='br-int',has_traffic_filtering=True,id=a8db5130-7bc3-414c-b8bf-469e4fa0eb7b,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db5130-7b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.objects.instance [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'pci_devices' on Instance uuid cad9a071-e232-4629-a3cc-9cb9d3fe9333 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:23:21 user nova-compute[75071]:   <uuid>cad9a071-e232-4629-a3cc-9cb9d3fe9333</uuid>
Dec 05 12:23:21 user nova-compute[75071]:   <name>instance-00000015</name>
Dec 05 12:23:21 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:23:21 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:23:21 user nova-compute[75071]:   <metadata>
Dec 05 12:23:21 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:23:21 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:23:21 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-6013421</nova:name>
Dec 05 12:23:21 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:23:21</nova:creationTime>
Dec 05 12:23:21 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:23:21 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:23:21 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:23:21 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:23:21 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:23:21 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:23:21 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:23:21 user nova-compute[75071]:       <nova:owner>
Dec 05 12:23:21 user nova-compute[75071]:         <nova:user uuid="a70218d8181040818ed8290e743bd2db">tempest-AttachVolumeShelveTestJSON-1822750901-project-member</nova:user>
Dec 05 12:23:21 user nova-compute[75071]:         <nova:project uuid="36cda9a88b434e66ad6d8ac75790d141">tempest-AttachVolumeShelveTestJSON-1822750901</nova:project>
Dec 05 12:23:21 user nova-compute[75071]:       </nova:owner>
Dec 05 12:23:21 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:23:21 user nova-compute[75071]:       <nova:ports>
Dec 05 12:23:21 user nova-compute[75071]:         <nova:port uuid="a8db5130-7bc3-414c-b8bf-469e4fa0eb7b">
Dec 05 12:23:21 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 12:23:21 user nova-compute[75071]:         </nova:port>
Dec 05 12:23:21 user nova-compute[75071]:       </nova:ports>
Dec 05 12:23:21 user nova-compute[75071]:     </nova:instance>
Dec 05 12:23:21 user nova-compute[75071]:   </metadata>
Dec 05 12:23:21 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:23:21 user nova-compute[75071]:     <system>
Dec 05 12:23:21 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:23:21 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:23:21 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:23:21 user nova-compute[75071]:       <entry name="serial">cad9a071-e232-4629-a3cc-9cb9d3fe9333</entry>
Dec 05 12:23:21 user nova-compute[75071]:       <entry name="uuid">cad9a071-e232-4629-a3cc-9cb9d3fe9333</entry>
Dec 05 12:23:21 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:23:21 user nova-compute[75071]:     </system>
Dec 05 12:23:21 user nova-compute[75071]:   </sysinfo>
Dec 05 12:23:21 user nova-compute[75071]:   <os>
Dec 05 12:23:21 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:23:21 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:23:21 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:23:21 user nova-compute[75071]:   </os>
Dec 05 12:23:21 user nova-compute[75071]:   <features>
Dec 05 12:23:21 user nova-compute[75071]:     <acpi/>
Dec 05 12:23:21 user nova-compute[75071]:     <apic/>
Dec 05 12:23:21 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:23:21 user nova-compute[75071]:   </features>
Dec 05 12:23:21 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:23:21 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:23:21 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:23:21 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:23:21 user nova-compute[75071]:   </clock>
Dec 05 12:23:21 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:23:21 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:23:21 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:23:21 user nova-compute[75071]:   </cpu>
Dec 05 12:23:21 user nova-compute[75071]:   <devices>
Dec 05 12:23:21 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:23:21 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:23:21 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk"/>
Dec 05 12:23:21 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:23:21 user nova-compute[75071]:     </disk>
Dec 05 12:23:21 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:23:21 user nova-compute[75071]:       <mac address="fa:16:3e:ad:51:89"/>
Dec 05 12:23:21 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:23:21 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:23:21 user nova-compute[75071]:       <target dev="tapa8db5130-7b"/>
Dec 05 12:23:21 user nova-compute[75071]:     </interface>
Dec 05 12:23:21 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:23:21 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/console.log" append="off"/>
Dec 05 12:23:21 user nova-compute[75071]:     </serial>
Dec 05 12:23:21 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:23:21 user nova-compute[75071]:     <video>
Dec 05 12:23:21 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:23:21 user nova-compute[75071]:     </video>
Dec 05 12:23:21 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:23:21 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:23:21 user nova-compute[75071]:     </rng>
Dec 05 12:23:21 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:23:21 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:23:21 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:23:21 user nova-compute[75071]:     </memballoon>
Dec 05 12:23:21 user nova-compute[75071]:   </devices>
Dec 05 12:23:21 user nova-compute[75071]: </domain>
Dec 05 12:23:21 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-6013421',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-6013421',id=21,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4ojfp9xi4tIHEe5RUJWGaicVoCqfOcH9OAOng/6HjRCsqOv8KiR+xZvXDUbR4ocmbrJ48luSYFcwek/7Ldu8YJzwjPZxeE+cTAt0k9n2mCG+3kSNO0REXWDGwoZVYSrA==',key_name='tempest-keypair-399432094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36cda9a88b434e66ad6d8ac75790d141',ramdisk_id='',reservation_id='r-xmrtzxbg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1822750901',owner_user_name='tempest-AttachVolumeShelveTestJSON-1822750901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:23:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a70218d8181040818ed8290e743bd2db',uuid=cad9a071-e232-4629-a3cc-9cb9d3fe9333,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converting VIF {"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:89,bridge_name='br-int',has_traffic_filtering=True,id=a8db5130-7bc3-414c-b8bf-469e4fa0eb7b,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db5130-7b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG os_vif [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:89,bridge_name='br-int',has_traffic_filtering=True,id=a8db5130-7bc3-414c-b8bf-469e4fa0eb7b,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db5130-7b') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f383b49-053e-5de1-8559-5719bb3fd8db', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8db5130-7b, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8db5130-7b, col_values=(('qos', UUID('eff389ca-3ac4-412c-ac70-8bc8a2175be0')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8db5130-7b, col_values=(('external_ids', {'iface-id': 'a8db5130-7bc3-414c-b8bf-469e4fa0eb7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:51:89', 'vm-uuid': 'cad9a071-e232-4629-a3cc-9cb9d3fe9333'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:21 user nova-compute[75071]: INFO os_vif [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:89,bridge_name='br-int',has_traffic_filtering=True,id=a8db5130-7bc3-414c-b8bf-469e4fa0eb7b,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db5130-7b')
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] No VIF found with MAC fa:16:3e:ad:51:89, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-e0aa01f8-5b05-470e-8d1c-c1fe4a8e3f08 req-ee6e0519-ef42-413f-8a67-bb040edcde9b service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Updated VIF entry in instance network info cache for port a8db5130-7bc3-414c-b8bf-469e4fa0eb7b. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-e0aa01f8-5b05-470e-8d1c-c1fe4a8e3f08 req-ee6e0519-ef42-413f-8a67-bb040edcde9b service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Updating instance_info_cache with network_info: [{"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:23:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e0aa01f8-5b05-470e-8d1c-c1fe4a8e3f08 req-ee6e0519-ef42-413f-8a67-bb040edcde9b service nova] Releasing lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:23:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-c4266430-db0a-4f1a-a15c-d89c1214e786 req-3913a1d7-b5d3-449c-a1df-bf2eb47237b8 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received event network-vif-plugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:23:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c4266430-db0a-4f1a-a15c-d89c1214e786 req-3913a1d7-b5d3-449c-a1df-bf2eb47237b8 service nova] Acquiring lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c4266430-db0a-4f1a-a15c-d89c1214e786 req-3913a1d7-b5d3-449c-a1df-bf2eb47237b8 service nova] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c4266430-db0a-4f1a-a15c-d89c1214e786 req-3913a1d7-b5d3-449c-a1df-bf2eb47237b8 service nova] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-c4266430-db0a-4f1a-a15c-d89c1214e786 req-3913a1d7-b5d3-449c-a1df-bf2eb47237b8 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] No waiting events found dispatching network-vif-plugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:23:23 user nova-compute[75071]: WARNING nova.compute.manager [req-c4266430-db0a-4f1a-a15c-d89c1214e786 req-3913a1d7-b5d3-449c-a1df-bf2eb47237b8 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received unexpected event network-vif-plugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b for instance with vm_state building and task_state spawning.
Dec 05 12:23:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-0e7bbfd0-532c-40cb-9230-f0e33b50f851 req-d24f8176-327f-45e9-86b7-a7e747dbb8c1 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received event network-vif-plugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:23:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0e7bbfd0-532c-40cb-9230-f0e33b50f851 req-d24f8176-327f-45e9-86b7-a7e747dbb8c1 service nova] Acquiring lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0e7bbfd0-532c-40cb-9230-f0e33b50f851 req-d24f8176-327f-45e9-86b7-a7e747dbb8c1 service nova] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0e7bbfd0-532c-40cb-9230-f0e33b50f851 req-d24f8176-327f-45e9-86b7-a7e747dbb8c1 service nova] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-0e7bbfd0-532c-40cb-9230-f0e33b50f851 req-d24f8176-327f-45e9-86b7-a7e747dbb8c1 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] No waiting events found dispatching network-vif-plugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:23:25 user nova-compute[75071]: WARNING nova.compute.manager [req-0e7bbfd0-532c-40cb-9230-f0e33b50f851 req-d24f8176-327f-45e9-86b7-a7e747dbb8c1 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received unexpected event network-vif-plugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b for instance with vm_state building and task_state spawning.
Dec 05 12:23:25 user nova-compute[75071]: DEBUG nova.compute.manager [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:23:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:23:25 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Instance spawned successfully.
Dec 05 12:23:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:23:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:23:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:23:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:23:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:23:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:23:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:23:25 user nova-compute[75071]: INFO nova.compute.manager [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Took 5.74 seconds to spawn the instance on the hypervisor.
Dec 05 12:23:25 user nova-compute[75071]: DEBUG nova.compute.manager [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:23:25 user nova-compute[75071]: INFO nova.compute.manager [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Took 6.41 seconds to build instance.
Dec 05 12:23:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-67489025-8c2f-4933-8c3b-872729a5534f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.512s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:40 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:23:40 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:23:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:23:41 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:23:41 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:23:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:41 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:23:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:45 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:23:45 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:23:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=7569MB free_disk=25.259132385253906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:23:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e08be776-0fa9-4871-86eb-2093530c00f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:23:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:23:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 62efa94c-ae01-48aa-b3d3-0d23d159801c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:23:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:23:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:23:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:23:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:23:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance cad9a071-e232-4629-a3cc-9cb9d3fe9333 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:23:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:23:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:23:45 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:23:45 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:23:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:23:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "17348e17-fde4-49b9-a79d-8361724acc4f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "17348e17-fde4-49b9-a79d-8361724acc4f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:23:46 user nova-compute[75071]: INFO nova.compute.claims [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Claim successful on node user
Dec 05 12:23:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG nova.network.neutron [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:23:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:23:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG nova.policy [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d78c212de2e426fad0cba51a2e7bf52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c1a038a4eb45508b7f5aa3eb435229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:23:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Creating image(s)
Dec 05 12:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "/opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "/opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "/opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:23:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.194s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/disk 1073741824" returned: 0 in 0.049s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG nova.network.neutron [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Successfully created port: fd5c707a-6b81-4c59-87d0-8204082e274a {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Cannot resize image /opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Ensure instance console log exists: /opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Updating instance_info_cache with network_info: [{"id": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "address": "fa:16:3e:32:a2:62", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f59600f-fe", "ovs_interfaceid": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:23:47 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.network.neutron [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Successfully updated port: fd5c707a-6b81-4c59-87d0-8204082e274a {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "refresh_cache-17348e17-fde4-49b9-a79d-8361724acc4f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquired lock "refresh_cache-17348e17-fde4-49b9-a79d-8361724acc4f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.network.neutron [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-acb6be87-9ad4-4bbc-9e3f-a1c5bbd9076a req-f87d9e84-b19f-4284-b1c0-293a0be28dbc service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Received event network-changed-fd5c707a-6b81-4c59-87d0-8204082e274a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-acb6be87-9ad4-4bbc-9e3f-a1c5bbd9076a req-f87d9e84-b19f-4284-b1c0-293a0be28dbc service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Refreshing instance network info cache due to event network-changed-fd5c707a-6b81-4c59-87d0-8204082e274a. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-acb6be87-9ad4-4bbc-9e3f-a1c5bbd9076a req-f87d9e84-b19f-4284-b1c0-293a0be28dbc service nova] Acquiring lock "refresh_cache-17348e17-fde4-49b9-a79d-8361724acc4f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.network.neutron [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.network.neutron [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Updating instance_info_cache with network_info: [{"id": "fd5c707a-6b81-4c59-87d0-8204082e274a", "address": "fa:16:3e:4f:0f:1c", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5c707a-6b", "ovs_interfaceid": "fd5c707a-6b81-4c59-87d0-8204082e274a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Releasing lock "refresh_cache-17348e17-fde4-49b9-a79d-8361724acc4f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Instance network_info: |[{"id": "fd5c707a-6b81-4c59-87d0-8204082e274a", "address": "fa:16:3e:4f:0f:1c", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5c707a-6b", "ovs_interfaceid": "fd5c707a-6b81-4c59-87d0-8204082e274a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-acb6be87-9ad4-4bbc-9e3f-a1c5bbd9076a req-f87d9e84-b19f-4284-b1c0-293a0be28dbc service nova] Acquired lock "refresh_cache-17348e17-fde4-49b9-a79d-8361724acc4f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.network.neutron [req-acb6be87-9ad4-4bbc-9e3f-a1c5bbd9076a req-f87d9e84-b19f-4284-b1c0-293a0be28dbc service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Refreshing network info cache for port fd5c707a-6b81-4c59-87d0-8204082e274a {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Start _get_guest_xml network_info=[{"id": "fd5c707a-6b81-4c59-87d0-8204082e274a", "address": "fa:16:3e:4f:0f:1c", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5c707a-6b", "ovs_interfaceid": "fd5c707a-6b81-4c59-87d0-8204082e274a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:23:48 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:23:48 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-117102152',display_name='tempest-AttachVolumeNegativeTest-server-117102152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-117102152',id=22,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLb9de/I70kpl8WryK8ZjE2MJmvZ9xawT3KV75HA1/NLwTKi2kyyx141C489P+/cA+7w/9xb11YoPevhXin2EgowfRszakaOrTAL4cO7W/uaj7BBQyce/72ycxM03stW6A==',key_name='tempest-keypair-1414079810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5c1a038a4eb45508b7f5aa3eb435229',ramdisk_id='',reservation_id='r-x4pdkicd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1152460930',owner_user_name='tempest-AttachVolumeNegativeTest-1152460930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d78c212de2e426fad0cba51a2e7bf52',uuid=17348e17-fde4-49b9-a79d-8361724acc4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd5c707a-6b81-4c59-87d0-8204082e274a", "address": "fa:16:3e:4f:0f:1c", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5c707a-6b", "ovs_interfaceid": "fd5c707a-6b81-4c59-87d0-8204082e274a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converting VIF {"id": "fd5c707a-6b81-4c59-87d0-8204082e274a", "address": "fa:16:3e:4f:0f:1c", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5c707a-6b", "ovs_interfaceid": "fd5c707a-6b81-4c59-87d0-8204082e274a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:0f:1c,bridge_name='br-int',has_traffic_filtering=True,id=fd5c707a-6b81-4c59-87d0-8204082e274a,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5c707a-6b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.objects.instance [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lazy-loading 'pci_devices' on Instance uuid 17348e17-fde4-49b9-a79d-8361724acc4f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:23:48 user nova-compute[75071]:   <uuid>17348e17-fde4-49b9-a79d-8361724acc4f</uuid>
Dec 05 12:23:48 user nova-compute[75071]:   <name>instance-00000016</name>
Dec 05 12:23:48 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:23:48 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:23:48 user nova-compute[75071]:   <metadata>
Dec 05 12:23:48 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:23:48 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:23:48 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeNegativeTest-server-117102152</nova:name>
Dec 05 12:23:48 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:23:48</nova:creationTime>
Dec 05 12:23:48 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:23:48 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:23:48 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:23:48 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:23:48 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:23:48 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:23:48 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:23:48 user nova-compute[75071]:       <nova:owner>
Dec 05 12:23:48 user nova-compute[75071]:         <nova:user uuid="7d78c212de2e426fad0cba51a2e7bf52">tempest-AttachVolumeNegativeTest-1152460930-project-member</nova:user>
Dec 05 12:23:48 user nova-compute[75071]:         <nova:project uuid="d5c1a038a4eb45508b7f5aa3eb435229">tempest-AttachVolumeNegativeTest-1152460930</nova:project>
Dec 05 12:23:48 user nova-compute[75071]:       </nova:owner>
Dec 05 12:23:48 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:23:48 user nova-compute[75071]:       <nova:ports>
Dec 05 12:23:48 user nova-compute[75071]:         <nova:port uuid="fd5c707a-6b81-4c59-87d0-8204082e274a">
Dec 05 12:23:48 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 12:23:48 user nova-compute[75071]:         </nova:port>
Dec 05 12:23:48 user nova-compute[75071]:       </nova:ports>
Dec 05 12:23:48 user nova-compute[75071]:     </nova:instance>
Dec 05 12:23:48 user nova-compute[75071]:   </metadata>
Dec 05 12:23:48 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:23:48 user nova-compute[75071]:     <system>
Dec 05 12:23:48 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:23:48 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:23:48 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:23:48 user nova-compute[75071]:       <entry name="serial">17348e17-fde4-49b9-a79d-8361724acc4f</entry>
Dec 05 12:23:48 user nova-compute[75071]:       <entry name="uuid">17348e17-fde4-49b9-a79d-8361724acc4f</entry>
Dec 05 12:23:48 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:23:48 user nova-compute[75071]:     </system>
Dec 05 12:23:48 user nova-compute[75071]:   </sysinfo>
Dec 05 12:23:48 user nova-compute[75071]:   <os>
Dec 05 12:23:48 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:23:48 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:23:48 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:23:48 user nova-compute[75071]:   </os>
Dec 05 12:23:48 user nova-compute[75071]:   <features>
Dec 05 12:23:48 user nova-compute[75071]:     <acpi/>
Dec 05 12:23:48 user nova-compute[75071]:     <apic/>
Dec 05 12:23:48 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:23:48 user nova-compute[75071]:   </features>
Dec 05 12:23:48 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:23:48 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:23:48 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:23:48 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:23:48 user nova-compute[75071]:   </clock>
Dec 05 12:23:48 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:23:48 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:23:48 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:23:48 user nova-compute[75071]:   </cpu>
Dec 05 12:23:48 user nova-compute[75071]:   <devices>
Dec 05 12:23:48 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:23:48 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:23:48 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/disk"/>
Dec 05 12:23:48 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:23:48 user nova-compute[75071]:     </disk>
Dec 05 12:23:48 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:23:48 user nova-compute[75071]:       <mac address="fa:16:3e:4f:0f:1c"/>
Dec 05 12:23:48 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:23:48 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:23:48 user nova-compute[75071]:       <target dev="tapfd5c707a-6b"/>
Dec 05 12:23:48 user nova-compute[75071]:     </interface>
Dec 05 12:23:48 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:23:48 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/console.log" append="off"/>
Dec 05 12:23:48 user nova-compute[75071]:     </serial>
Dec 05 12:23:48 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:23:48 user nova-compute[75071]:     <video>
Dec 05 12:23:48 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:23:48 user nova-compute[75071]:     </video>
Dec 05 12:23:48 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:23:48 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:23:48 user nova-compute[75071]:     </rng>
Dec 05 12:23:48 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:23:48 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:23:48 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:23:48 user nova-compute[75071]:     </memballoon>
Dec 05 12:23:48 user nova-compute[75071]:   </devices>
Dec 05 12:23:48 user nova-compute[75071]: </domain>
Dec 05 12:23:48 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-117102152',display_name='tempest-AttachVolumeNegativeTest-server-117102152',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-117102152',id=22,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLb9de/I70kpl8WryK8ZjE2MJmvZ9xawT3KV75HA1/NLwTKi2kyyx141C489P+/cA+7w/9xb11YoPevhXin2EgowfRszakaOrTAL4cO7W/uaj7BBQyce/72ycxM03stW6A==',key_name='tempest-keypair-1414079810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5c1a038a4eb45508b7f5aa3eb435229',ramdisk_id='',reservation_id='r-x4pdkicd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1152460930',owner_user_name='tempest-AttachVolumeNegativeTest-1152460930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:23:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d78c212de2e426fad0cba51a2e7bf52',uuid=17348e17-fde4-49b9-a79d-8361724acc4f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd5c707a-6b81-4c59-87d0-8204082e274a", "address": "fa:16:3e:4f:0f:1c", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5c707a-6b", "ovs_interfaceid": "fd5c707a-6b81-4c59-87d0-8204082e274a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converting VIF {"id": "fd5c707a-6b81-4c59-87d0-8204082e274a", "address": "fa:16:3e:4f:0f:1c", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5c707a-6b", "ovs_interfaceid": "fd5c707a-6b81-4c59-87d0-8204082e274a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:0f:1c,bridge_name='br-int',has_traffic_filtering=True,id=fd5c707a-6b81-4c59-87d0-8204082e274a,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5c707a-6b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG os_vif [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:0f:1c,bridge_name='br-int',has_traffic_filtering=True,id=fd5c707a-6b81-4c59-87d0-8204082e274a,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5c707a-6b') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7754f45f-c326-508d-8350-17326ec40e10', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd5c707a-6b, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd5c707a-6b, col_values=(('qos', UUID('2963c1dd-3331-4ebe-bc83-d94de11bd680')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd5c707a-6b, col_values=(('external_ids', {'iface-id': 'fd5c707a-6b81-4c59-87d0-8204082e274a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:0f:1c', 'vm-uuid': '17348e17-fde4-49b9-a79d-8361724acc4f'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:23:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:48 user nova-compute[75071]: INFO os_vif [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:0f:1c,bridge_name='br-int',has_traffic_filtering=True,id=fd5c707a-6b81-4c59-87d0-8204082e274a,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5c707a-6b')
Dec 05 12:23:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:23:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] No VIF found with MAC fa:16:3e:4f:0f:1c, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:23:49 user nova-compute[75071]: DEBUG nova.network.neutron [req-acb6be87-9ad4-4bbc-9e3f-a1c5bbd9076a req-f87d9e84-b19f-4284-b1c0-293a0be28dbc service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Updated VIF entry in instance network info cache for port fd5c707a-6b81-4c59-87d0-8204082e274a. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:23:49 user nova-compute[75071]: DEBUG nova.network.neutron [req-acb6be87-9ad4-4bbc-9e3f-a1c5bbd9076a req-f87d9e84-b19f-4284-b1c0-293a0be28dbc service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Updating instance_info_cache with network_info: [{"id": "fd5c707a-6b81-4c59-87d0-8204082e274a", "address": "fa:16:3e:4f:0f:1c", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5c707a-6b", "ovs_interfaceid": "fd5c707a-6b81-4c59-87d0-8204082e274a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:23:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-acb6be87-9ad4-4bbc-9e3f-a1c5bbd9076a req-f87d9e84-b19f-4284-b1c0-293a0be28dbc service nova] Releasing lock "refresh_cache-17348e17-fde4-49b9-a79d-8361724acc4f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:23:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-f48c9855-fb48-4ed9-87f3-ed140d613559 req-ab0fa605-944b-45f3-80de-f29fbd000092 service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Received event network-vif-plugged-fd5c707a-6b81-4c59-87d0-8204082e274a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f48c9855-fb48-4ed9-87f3-ed140d613559 req-ab0fa605-944b-45f3-80de-f29fbd000092 service nova] Acquiring lock "17348e17-fde4-49b9-a79d-8361724acc4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f48c9855-fb48-4ed9-87f3-ed140d613559 req-ab0fa605-944b-45f3-80de-f29fbd000092 service nova] Lock "17348e17-fde4-49b9-a79d-8361724acc4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f48c9855-fb48-4ed9-87f3-ed140d613559 req-ab0fa605-944b-45f3-80de-f29fbd000092 service nova] Lock "17348e17-fde4-49b9-a79d-8361724acc4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-f48c9855-fb48-4ed9-87f3-ed140d613559 req-ab0fa605-944b-45f3-80de-f29fbd000092 service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] No waiting events found dispatching network-vif-plugged-fd5c707a-6b81-4c59-87d0-8204082e274a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:23:50 user nova-compute[75071]: WARNING nova.compute.manager [req-f48c9855-fb48-4ed9-87f3-ed140d613559 req-ab0fa605-944b-45f3-80de-f29fbd000092 service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Received unexpected event network-vif-plugged-fd5c707a-6b81-4c59-87d0-8204082e274a for instance with vm_state building and task_state spawning.
Dec 05 12:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:23:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:23:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Instance spawned successfully.
Dec 05 12:23:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:23:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:23:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:23:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:23:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:23:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:23:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:23:52 user nova-compute[75071]: INFO nova.compute.manager [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Took 5.73 seconds to spawn the instance on the hypervisor.
Dec 05 12:23:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:23:52 user nova-compute[75071]: INFO nova.compute.manager [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Took 6.50 seconds to build instance.
Dec 05 12:23:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-319b5f2a-d24e-4e50-8b5d-614f56e7748e tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "17348e17-fde4-49b9-a79d-8361724acc4f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.611s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-280cd296-4f3e-4d30-ad6f-56054ee0a8bc req-53e3bda4-3d43-45f1-9439-bdb3ac5ec9eb service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Received event network-vif-plugged-fd5c707a-6b81-4c59-87d0-8204082e274a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:23:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-280cd296-4f3e-4d30-ad6f-56054ee0a8bc req-53e3bda4-3d43-45f1-9439-bdb3ac5ec9eb service nova] Acquiring lock "17348e17-fde4-49b9-a79d-8361724acc4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-280cd296-4f3e-4d30-ad6f-56054ee0a8bc req-53e3bda4-3d43-45f1-9439-bdb3ac5ec9eb service nova] Lock "17348e17-fde4-49b9-a79d-8361724acc4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-280cd296-4f3e-4d30-ad6f-56054ee0a8bc req-53e3bda4-3d43-45f1-9439-bdb3ac5ec9eb service nova] Lock "17348e17-fde4-49b9-a79d-8361724acc4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-280cd296-4f3e-4d30-ad6f-56054ee0a8bc req-53e3bda4-3d43-45f1-9439-bdb3ac5ec9eb service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] No waiting events found dispatching network-vif-plugged-fd5c707a-6b81-4c59-87d0-8204082e274a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:23:52 user nova-compute[75071]: WARNING nova.compute.manager [req-280cd296-4f3e-4d30-ad6f-56054ee0a8bc req-53e3bda4-3d43-45f1-9439-bdb3ac5ec9eb service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Received unexpected event network-vif-plugged-fd5c707a-6b81-4c59-87d0-8204082e274a for instance with vm_state active and task_state None.
Dec 05 12:23:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:23:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:55 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:23:55 user nova-compute[75071]: INFO nova.compute.claims [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Claim successful on node user
Dec 05 12:23:55 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:23:55 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:23:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:23:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:23:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:23:56 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:23:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:23:56 user nova-compute[75071]: DEBUG nova.policy [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1feef67013ea4c4db4be3a352eeaec7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9ac01e22eb428885981285a18f34fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:23:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:23:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:23:56 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Creating image(s)
Dec 05 12:23:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "/opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "/opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "/opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "d0909f64c74f4e3908389a7cae90a4b018ba6b5b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "d0909f64c74f4e3908389a7cae90a4b018ba6b5b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Successfully created port: 580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b.part --force-share --output=json" returned: 0 in 0.207s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG nova.virt.images [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] dadec85f-a232-41ae-a859-c4f45f17f685 was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b.part /opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b.part /opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b.converted" returned: 0 in 0.276s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b.converted --force-share --output=json" returned: 0 in 0.240s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "d0909f64c74f4e3908389a7cae90a4b018ba6b5b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.316s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Successfully updated port: 580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquired lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-ee4f5fa2-10e1-4ca6-8c38-f684b83462be req-d28d014a-ecbd-4527-80b1-b85ad4ce0cea service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received event network-changed-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-ee4f5fa2-10e1-4ca6-8c38-f684b83462be req-d28d014a-ecbd-4527-80b1-b85ad4ce0cea service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Refreshing instance network info cache due to event network-changed-580a2511-2f94-4e37-af8e-3a3b72654b35. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ee4f5fa2-10e1-4ca6-8c38-f684b83462be req-d28d014a-ecbd-4527-80b1-b85ad4ce0cea service nova] Acquiring lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b --force-share --output=json" returned: 0 in 0.229s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "d0909f64c74f4e3908389a7cae90a4b018ba6b5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "d0909f64c74f4e3908389a7cae90a4b018ba6b5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b --force-share --output=json" returned: 0 in 0.219s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b,backing_fmt=raw /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b,backing_fmt=raw /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk 1073741824" returned: 0 in 0.064s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "d0909f64c74f4e3908389a7cae90a4b018ba6b5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Updating instance_info_cache with network_info: [{"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Releasing lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Instance network_info: |[{"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ee4f5fa2-10e1-4ca6-8c38-f684b83462be req-d28d014a-ecbd-4527-80b1-b85ad4ce0cea service nova] Acquired lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.network.neutron [req-ee4f5fa2-10e1-4ca6-8c38-f684b83462be req-d28d014a-ecbd-4527-80b1-b85ad4ce0cea service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Refreshing network info cache for port 580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b --force-share --output=json" returned: 0 in 0.205s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Checking if we can resize image /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Cannot resize image /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Ensure instance console log exists: /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Start _get_guest_xml network_info=[{"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:23:53Z,direct_url=<?>,disk_format='qcow2',id=dadec85f-a232-41ae-a859-c4f45f17f685,min_disk=0,min_ram=0,name='tempest-scenario-img--1454732921',owner='9b9ac01e22eb428885981285a18f34fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:23:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'dadec85f-a232-41ae-a859-c4f45f17f685'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:23:58 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:23:58 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:23:53Z,direct_url=<?>,disk_format='qcow2',id=dadec85f-a232-41ae-a859-c4f45f17f685,min_disk=0,min_ram=0,name='tempest-scenario-img--1454732921',owner='9b9ac01e22eb428885981285a18f34fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:23:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1840068028',display_name='tempest-TestMinimumBasicScenario-server-1840068028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1840068028',id=23,image_ref='dadec85f-a232-41ae-a859-c4f45f17f685',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgYMh9m/slisf+9eEjgMwJqp26BZoxHiS18Q50W2wVpua8bBzoOPb8JZBddNfzVLxaFl9d7uvsRsNK9UBDNxU25Bg3r71t7m+QxWjc+CF2KmO3pHsDIjEe7HS4xaBQ2gQ==',key_name='tempest-TestMinimumBasicScenario-459970224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b9ac01e22eb428885981285a18f34fc',ramdisk_id='',reservation_id='r-oa91ac1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dadec85f-a232-41ae-a859-c4f45f17f685',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-901409176',owner_user_name='tempest-TestMinimumBasicScenario-901409176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:23:56Z,user_data=None,user_id='1feef67013ea4c4db4be3a352eeaec7f',uuid=386e93a2-2435-4d5f-bee2-fdb5f52fd476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Converting VIF {"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=580a2511-2f94-4e37-af8e-3a3b72654b35,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580a2511-2f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lazy-loading 'pci_devices' on Instance uuid 386e93a2-2435-4d5f-bee2-fdb5f52fd476 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:23:58 user nova-compute[75071]:   <uuid>386e93a2-2435-4d5f-bee2-fdb5f52fd476</uuid>
Dec 05 12:23:58 user nova-compute[75071]:   <name>instance-00000017</name>
Dec 05 12:23:58 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:23:58 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:23:58 user nova-compute[75071]:   <metadata>
Dec 05 12:23:58 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:23:58 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:23:58 user nova-compute[75071]:       <nova:name>tempest-TestMinimumBasicScenario-server-1840068028</nova:name>
Dec 05 12:23:58 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:23:58</nova:creationTime>
Dec 05 12:23:58 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:23:58 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:23:58 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:23:58 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:23:58 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:23:58 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:23:58 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:23:58 user nova-compute[75071]:       <nova:owner>
Dec 05 12:23:58 user nova-compute[75071]:         <nova:user uuid="1feef67013ea4c4db4be3a352eeaec7f">tempest-TestMinimumBasicScenario-901409176-project-member</nova:user>
Dec 05 12:23:58 user nova-compute[75071]:         <nova:project uuid="9b9ac01e22eb428885981285a18f34fc">tempest-TestMinimumBasicScenario-901409176</nova:project>
Dec 05 12:23:58 user nova-compute[75071]:       </nova:owner>
Dec 05 12:23:58 user nova-compute[75071]:       <nova:root type="image" uuid="dadec85f-a232-41ae-a859-c4f45f17f685"/>
Dec 05 12:23:58 user nova-compute[75071]:       <nova:ports>
Dec 05 12:23:58 user nova-compute[75071]:         <nova:port uuid="580a2511-2f94-4e37-af8e-3a3b72654b35">
Dec 05 12:23:58 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 12:23:58 user nova-compute[75071]:         </nova:port>
Dec 05 12:23:58 user nova-compute[75071]:       </nova:ports>
Dec 05 12:23:58 user nova-compute[75071]:     </nova:instance>
Dec 05 12:23:58 user nova-compute[75071]:   </metadata>
Dec 05 12:23:58 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:23:58 user nova-compute[75071]:     <system>
Dec 05 12:23:58 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:23:58 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:23:58 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:23:58 user nova-compute[75071]:       <entry name="serial">386e93a2-2435-4d5f-bee2-fdb5f52fd476</entry>
Dec 05 12:23:58 user nova-compute[75071]:       <entry name="uuid">386e93a2-2435-4d5f-bee2-fdb5f52fd476</entry>
Dec 05 12:23:58 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:23:58 user nova-compute[75071]:     </system>
Dec 05 12:23:58 user nova-compute[75071]:   </sysinfo>
Dec 05 12:23:58 user nova-compute[75071]:   <os>
Dec 05 12:23:58 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:23:58 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:23:58 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:23:58 user nova-compute[75071]:   </os>
Dec 05 12:23:58 user nova-compute[75071]:   <features>
Dec 05 12:23:58 user nova-compute[75071]:     <acpi/>
Dec 05 12:23:58 user nova-compute[75071]:     <apic/>
Dec 05 12:23:58 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:23:58 user nova-compute[75071]:   </features>
Dec 05 12:23:58 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:23:58 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:23:58 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:23:58 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:23:58 user nova-compute[75071]:   </clock>
Dec 05 12:23:58 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:23:58 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:23:58 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:23:58 user nova-compute[75071]:   </cpu>
Dec 05 12:23:58 user nova-compute[75071]:   <devices>
Dec 05 12:23:58 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:23:58 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:23:58 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk"/>
Dec 05 12:23:58 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:23:58 user nova-compute[75071]:     </disk>
Dec 05 12:23:58 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:23:58 user nova-compute[75071]:       <mac address="fa:16:3e:c5:10:6a"/>
Dec 05 12:23:58 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:23:58 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:23:58 user nova-compute[75071]:       <target dev="tap580a2511-2f"/>
Dec 05 12:23:58 user nova-compute[75071]:     </interface>
Dec 05 12:23:58 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:23:58 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/console.log" append="off"/>
Dec 05 12:23:58 user nova-compute[75071]:     </serial>
Dec 05 12:23:58 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:23:58 user nova-compute[75071]:     <video>
Dec 05 12:23:58 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:23:58 user nova-compute[75071]:     </video>
Dec 05 12:23:58 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:23:58 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:23:58 user nova-compute[75071]:     </rng>
Dec 05 12:23:58 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:23:58 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:23:58 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:23:58 user nova-compute[75071]:     </memballoon>
Dec 05 12:23:58 user nova-compute[75071]:   </devices>
Dec 05 12:23:58 user nova-compute[75071]: </domain>
Dec 05 12:23:58 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1840068028',display_name='tempest-TestMinimumBasicScenario-server-1840068028',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1840068028',id=23,image_ref='dadec85f-a232-41ae-a859-c4f45f17f685',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgYMh9m/slisf+9eEjgMwJqp26BZoxHiS18Q50W2wVpua8bBzoOPb8JZBddNfzVLxaFl9d7uvsRsNK9UBDNxU25Bg3r71t7m+QxWjc+CF2KmO3pHsDIjEe7HS4xaBQ2gQ==',key_name='tempest-TestMinimumBasicScenario-459970224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b9ac01e22eb428885981285a18f34fc',ramdisk_id='',reservation_id='r-oa91ac1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dadec85f-a232-41ae-a859-c4f45f17f685',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-901409176',owner_user_name='tempest-TestMinimumBasicScenario-901409176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:23:56Z,user_data=None,user_id='1feef67013ea4c4db4be3a352eeaec7f',uuid=386e93a2-2435-4d5f-bee2-fdb5f52fd476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Converting VIF {"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=580a2511-2f94-4e37-af8e-3a3b72654b35,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580a2511-2f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG os_vif [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=580a2511-2f94-4e37-af8e-3a3b72654b35,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580a2511-2f') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93b169ff-62e5-5383-b027-7d0f35b0b0b8', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap580a2511-2f, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap580a2511-2f, col_values=(('qos', UUID('9136db2f-541e-4bd6-ad36-504e6adb4c87')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap580a2511-2f, col_values=(('external_ids', {'iface-id': '580a2511-2f94-4e37-af8e-3a3b72654b35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:10:6a', 'vm-uuid': '386e93a2-2435-4d5f-bee2-fdb5f52fd476'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:23:58 user nova-compute[75071]: INFO os_vif [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=580a2511-2f94-4e37-af8e-3a3b72654b35,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580a2511-2f')
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.network.neutron [req-ee4f5fa2-10e1-4ca6-8c38-f684b83462be req-d28d014a-ecbd-4527-80b1-b85ad4ce0cea service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Updated VIF entry in instance network info cache for port 580a2511-2f94-4e37-af8e-3a3b72654b35. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.network.neutron [req-ee4f5fa2-10e1-4ca6-8c38-f684b83462be req-d28d014a-ecbd-4527-80b1-b85ad4ce0cea service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Updating instance_info_cache with network_info: [{"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] No VIF found with MAC fa:16:3e:c5:10:6a, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:23:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ee4f5fa2-10e1-4ca6-8c38-f684b83462be req-d28d014a-ecbd-4527-80b1-b85ad4ce0cea service nova] Releasing lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:24:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-3faf0464-b784-4a6b-978d-6e74c067aeb1 req-d61e7792-cf7b-45f9-af0e-93e3e9a4e53e service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received event network-vif-plugged-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:24:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3faf0464-b784-4a6b-978d-6e74c067aeb1 req-d61e7792-cf7b-45f9-af0e-93e3e9a4e53e service nova] Acquiring lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3faf0464-b784-4a6b-978d-6e74c067aeb1 req-d61e7792-cf7b-45f9-af0e-93e3e9a4e53e service nova] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3faf0464-b784-4a6b-978d-6e74c067aeb1 req-d61e7792-cf7b-45f9-af0e-93e3e9a4e53e service nova] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-3faf0464-b784-4a6b-978d-6e74c067aeb1 req-d61e7792-cf7b-45f9-af0e-93e3e9a4e53e service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] No waiting events found dispatching network-vif-plugged-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:24:00 user nova-compute[75071]: WARNING nova.compute.manager [req-3faf0464-b784-4a6b-978d-6e74c067aeb1 req-d61e7792-cf7b-45f9-af0e-93e3e9a4e53e service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received unexpected event network-vif-plugged-580a2511-2f94-4e37-af8e-3a3b72654b35 for instance with vm_state building and task_state spawning.
Dec 05 12:24:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:02 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:24:02 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Instance spawned successfully.
Dec 05 12:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:24:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:24:02 user nova-compute[75071]: INFO nova.compute.manager [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Took 6.55 seconds to spawn the instance on the hypervisor.
Dec 05 12:24:02 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:24:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-8611a3ec-8c18-4615-a50f-67734ebf7ba4 req-a985a967-196d-4a26-853c-2262e92db74b service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received event network-vif-plugged-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8611a3ec-8c18-4615-a50f-67734ebf7ba4 req-a985a967-196d-4a26-853c-2262e92db74b service nova] Acquiring lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8611a3ec-8c18-4615-a50f-67734ebf7ba4 req-a985a967-196d-4a26-853c-2262e92db74b service nova] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8611a3ec-8c18-4615-a50f-67734ebf7ba4 req-a985a967-196d-4a26-853c-2262e92db74b service nova] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-8611a3ec-8c18-4615-a50f-67734ebf7ba4 req-a985a967-196d-4a26-853c-2262e92db74b service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] No waiting events found dispatching network-vif-plugged-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:24:02 user nova-compute[75071]: WARNING nova.compute.manager [req-8611a3ec-8c18-4615-a50f-67734ebf7ba4 req-a985a967-196d-4a26-853c-2262e92db74b service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received unexpected event network-vif-plugged-580a2511-2f94-4e37-af8e-3a3b72654b35 for instance with vm_state building and task_state spawning.
Dec 05 12:24:02 user nova-compute[75071]: INFO nova.compute.manager [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Took 7.61 seconds to build instance.
Dec 05 12:24:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d6b5399f-963c-44f2-ac49-627170305e6a tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.738s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:04 user nova-compute[75071]: INFO nova.compute.manager [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Rescuing
Dec 05 12:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "refresh_cache-4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:24:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquired lock "refresh_cache-4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:24:04 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:24:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Updating instance_info_cache with network_info: [{"id": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "address": "fa:16:3e:59:88:5c", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2c318b-a7", "ovs_interfaceid": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:24:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Releasing lock "refresh_cache-4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:24:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-a9f12c22-10c8-4482-8d6e-133cd74f6ffe req-edb8f12b-3410-4f5f-9e00-f4e4eb7c3b33 service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Received event network-vif-unplugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a9f12c22-10c8-4482-8d6e-133cd74f6ffe req-edb8f12b-3410-4f5f-9e00-f4e4eb7c3b33 service nova] Acquiring lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a9f12c22-10c8-4482-8d6e-133cd74f6ffe req-edb8f12b-3410-4f5f-9e00-f4e4eb7c3b33 service nova] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a9f12c22-10c8-4482-8d6e-133cd74f6ffe req-edb8f12b-3410-4f5f-9e00-f4e4eb7c3b33 service nova] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-a9f12c22-10c8-4482-8d6e-133cd74f6ffe req-edb8f12b-3410-4f5f-9e00-f4e4eb7c3b33 service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] No waiting events found dispatching network-vif-unplugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:24:06 user nova-compute[75071]: WARNING nova.compute.manager [req-a9f12c22-10c8-4482-8d6e-133cd74f6ffe req-edb8f12b-3410-4f5f-9e00-f4e4eb7c3b33 service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Received unexpected event network-vif-unplugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b for instance with vm_state active and task_state rescuing.
Dec 05 12:24:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Instance destroyed successfully.
Dec 05 12:24:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Attempting rescue
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75071) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Instance directory exists: not creating {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 05 12:24:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Creating image(s)
Dec 05 12:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "/opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "/opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "/opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.212s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue" returned: 0 in 0.066s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'migration_context' on Instance uuid 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.objects.base [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Object Instance<4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Start _get_guest_xml network_info=[{"id": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "address": "fa:16:3e:59:88:5c", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "vif_mac": "fa:16:3e:59:88:5c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2c318b-a7", "ovs_interfaceid": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'resources' on Instance uuid 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.objects.base [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Object Instance<4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'numa_topology' on Instance uuid 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.objects.base [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Object Instance<4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:24:06 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:24:06 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:24:06 user nova-compute[75071]: DEBUG nova.objects.base [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Object Instance<4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:24:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-635283916',display_name='tempest-ServerRescueNegativeTestJSON-server-635283916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-635283916',id=18,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:22:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b958a2138af24f5a860e7a0c99d9ebb5',ramdisk_id='',reservation_id='r-hszh9mt9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-170727457',owner_user_name='tempest-ServerRescueNegativeTestJSON-170727457-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:22:27Z,user_data=None,user_id='3312b55016d34680b6873eedf97e9a8f',uuid=4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "address": "fa:16:3e:59:88:5c", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "vif_mac": "fa:16:3e:59:88:5c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2c318b-a7", "ovs_interfaceid": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:24:07 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converting VIF {"id": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "address": "fa:16:3e:59:88:5c", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "vif_mac": "fa:16:3e:59:88:5c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2c318b-a7", "ovs_interfaceid": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:24:07 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=4d2c318b-a73f-4a69-b318-3f4ae56a5d7b,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2c318b-a7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:24:07 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'pci_devices' on Instance uuid 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:24:07 user nova-compute[75071]: DEBUG nova.objects.base [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Object Instance<4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:24:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:24:07 user nova-compute[75071]:   <uuid>4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957</uuid>
Dec 05 12:24:07 user nova-compute[75071]:   <name>instance-00000012</name>
Dec 05 12:24:07 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:24:07 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:24:07 user nova-compute[75071]:   <metadata>
Dec 05 12:24:07 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:24:07 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:24:07 user nova-compute[75071]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-635283916</nova:name>
Dec 05 12:24:07 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:24:06</nova:creationTime>
Dec 05 12:24:07 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:24:07 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:24:07 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:24:07 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:24:07 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:24:07 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:24:07 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:24:07 user nova-compute[75071]:       <nova:owner>
Dec 05 12:24:07 user nova-compute[75071]:         <nova:user uuid="3312b55016d34680b6873eedf97e9a8f">tempest-ServerRescueNegativeTestJSON-170727457-project-member</nova:user>
Dec 05 12:24:07 user nova-compute[75071]:         <nova:project uuid="b958a2138af24f5a860e7a0c99d9ebb5">tempest-ServerRescueNegativeTestJSON-170727457</nova:project>
Dec 05 12:24:07 user nova-compute[75071]:       </nova:owner>
Dec 05 12:24:07 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:24:07 user nova-compute[75071]:       <nova:ports>
Dec 05 12:24:07 user nova-compute[75071]:         <nova:port uuid="4d2c318b-a73f-4a69-b318-3f4ae56a5d7b">
Dec 05 12:24:07 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 05 12:24:07 user nova-compute[75071]:         </nova:port>
Dec 05 12:24:07 user nova-compute[75071]:       </nova:ports>
Dec 05 12:24:07 user nova-compute[75071]:     </nova:instance>
Dec 05 12:24:07 user nova-compute[75071]:   </metadata>
Dec 05 12:24:07 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:24:07 user nova-compute[75071]:     <system>
Dec 05 12:24:07 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:24:07 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:24:07 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:24:07 user nova-compute[75071]:       <entry name="serial">4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957</entry>
Dec 05 12:24:07 user nova-compute[75071]:       <entry name="uuid">4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957</entry>
Dec 05 12:24:07 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:24:07 user nova-compute[75071]:     </system>
Dec 05 12:24:07 user nova-compute[75071]:   </sysinfo>
Dec 05 12:24:07 user nova-compute[75071]:   <os>
Dec 05 12:24:07 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:24:07 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:24:07 user nova-compute[75071]:   </os>
Dec 05 12:24:07 user nova-compute[75071]:   <features>
Dec 05 12:24:07 user nova-compute[75071]:     <acpi/>
Dec 05 12:24:07 user nova-compute[75071]:     <apic/>
Dec 05 12:24:07 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:24:07 user nova-compute[75071]:   </features>
Dec 05 12:24:07 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:24:07 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:24:07 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:24:07 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:24:07 user nova-compute[75071]:   </clock>
Dec 05 12:24:07 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:24:07 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:24:07 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:24:07 user nova-compute[75071]:   </cpu>
Dec 05 12:24:07 user nova-compute[75071]:   <devices>
Dec 05 12:24:07 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:24:07 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:24:07 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue"/>
Dec 05 12:24:07 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:24:07 user nova-compute[75071]:     </disk>
Dec 05 12:24:07 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:24:07 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:24:07 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk"/>
Dec 05 12:24:07 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Dec 05 12:24:07 user nova-compute[75071]:     </disk>
Dec 05 12:24:07 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:24:07 user nova-compute[75071]:       <mac address="fa:16:3e:59:88:5c"/>
Dec 05 12:24:07 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:24:07 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:24:07 user nova-compute[75071]:       <target dev="tap4d2c318b-a7"/>
Dec 05 12:24:07 user nova-compute[75071]:     </interface>
Dec 05 12:24:07 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:24:07 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/console.log" append="off"/>
Dec 05 12:24:07 user nova-compute[75071]:     </serial>
Dec 05 12:24:07 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:24:07 user nova-compute[75071]:     <video>
Dec 05 12:24:07 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:24:07 user nova-compute[75071]:     </video>
Dec 05 12:24:07 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:24:07 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:24:07 user nova-compute[75071]:     </rng>
Dec 05 12:24:07 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:24:07 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:24:07 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:24:07 user nova-compute[75071]:     </memballoon>
Dec 05 12:24:07 user nova-compute[75071]:   </devices>
Dec 05 12:24:07 user nova-compute[75071]: </domain>
Dec 05 12:24:07 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:24:07 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Instance destroyed successfully.
Dec 05 12:24:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:24:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:24:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] No VIF found with MAC fa:16:3e:59:88:5c, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:24:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-2561293f-eb61-4db1-9a92-55a23d06a66e req-6a1b55cb-3445-41a9-a72f-97561c649b3b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-changed-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:24:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-2561293f-eb61-4db1-9a92-55a23d06a66e req-6a1b55cb-3445-41a9-a72f-97561c649b3b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Refreshing instance network info cache due to event network-changed-5077ca66-d74d-4ad0-abee-fe0ea86d67ac. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:24:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2561293f-eb61-4db1-9a92-55a23d06a66e req-6a1b55cb-3445-41a9-a72f-97561c649b3b service nova] Acquiring lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:24:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2561293f-eb61-4db1-9a92-55a23d06a66e req-6a1b55cb-3445-41a9-a72f-97561c649b3b service nova] Acquired lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:24:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-2561293f-eb61-4db1-9a92-55a23d06a66e req-6a1b55cb-3445-41a9-a72f-97561c649b3b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Refreshing network info cache for port 5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:24:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-0cf1d42d-22b4-4707-9b3d-8cf6e87fb74d req-c1abde93-748b-4803-9019-f135c78dac5a service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Received event network-vif-plugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:24:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0cf1d42d-22b4-4707-9b3d-8cf6e87fb74d req-c1abde93-748b-4803-9019-f135c78dac5a service nova] Acquiring lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0cf1d42d-22b4-4707-9b3d-8cf6e87fb74d req-c1abde93-748b-4803-9019-f135c78dac5a service nova] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0cf1d42d-22b4-4707-9b3d-8cf6e87fb74d req-c1abde93-748b-4803-9019-f135c78dac5a service nova] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-0cf1d42d-22b4-4707-9b3d-8cf6e87fb74d req-c1abde93-748b-4803-9019-f135c78dac5a service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] No waiting events found dispatching network-vif-plugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:24:08 user nova-compute[75071]: WARNING nova.compute.manager [req-0cf1d42d-22b4-4707-9b3d-8cf6e87fb74d req-c1abde93-748b-4803-9019-f135c78dac5a service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Received unexpected event network-vif-plugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b for instance with vm_state active and task_state rescuing.
Dec 05 12:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-2561293f-eb61-4db1-9a92-55a23d06a66e req-6a1b55cb-3445-41a9-a72f-97561c649b3b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Updated VIF entry in instance network info cache for port 5077ca66-d74d-4ad0-abee-fe0ea86d67ac. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:24:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-2561293f-eb61-4db1-9a92-55a23d06a66e req-6a1b55cb-3445-41a9-a72f-97561c649b3b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Updating instance_info_cache with network_info: [{"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:24:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2561293f-eb61-4db1-9a92-55a23d06a66e req-6a1b55cb-3445-41a9-a72f-97561c649b3b service nova] Releasing lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:24:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-c58527dc-6fd2-4a89-9c30-adb3c92bd638 req-ed9bc599-e0ef-4e23-b08d-990aff0e2cae service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Received event network-vif-plugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:24:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c58527dc-6fd2-4a89-9c30-adb3c92bd638 req-ed9bc599-e0ef-4e23-b08d-990aff0e2cae service nova] Acquiring lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c58527dc-6fd2-4a89-9c30-adb3c92bd638 req-ed9bc599-e0ef-4e23-b08d-990aff0e2cae service nova] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c58527dc-6fd2-4a89-9c30-adb3c92bd638 req-ed9bc599-e0ef-4e23-b08d-990aff0e2cae service nova] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-c58527dc-6fd2-4a89-9c30-adb3c92bd638 req-ed9bc599-e0ef-4e23-b08d-990aff0e2cae service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] No waiting events found dispatching network-vif-plugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:24:10 user nova-compute[75071]: WARNING nova.compute.manager [req-c58527dc-6fd2-4a89-9c30-adb3c92bd638 req-ed9bc599-e0ef-4e23-b08d-990aff0e2cae service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Received unexpected event network-vif-plugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b for instance with vm_state active and task_state rescuing.
Dec 05 12:24:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-c58527dc-6fd2-4a89-9c30-adb3c92bd638 req-ed9bc599-e0ef-4e23-b08d-990aff0e2cae service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Received event network-vif-plugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:24:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c58527dc-6fd2-4a89-9c30-adb3c92bd638 req-ed9bc599-e0ef-4e23-b08d-990aff0e2cae service nova] Acquiring lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c58527dc-6fd2-4a89-9c30-adb3c92bd638 req-ed9bc599-e0ef-4e23-b08d-990aff0e2cae service nova] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c58527dc-6fd2-4a89-9c30-adb3c92bd638 req-ed9bc599-e0ef-4e23-b08d-990aff0e2cae service nova] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-c58527dc-6fd2-4a89-9c30-adb3c92bd638 req-ed9bc599-e0ef-4e23-b08d-990aff0e2cae service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] No waiting events found dispatching network-vif-plugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:24:10 user nova-compute[75071]: WARNING nova.compute.manager [req-c58527dc-6fd2-4a89-9c30-adb3c92bd638 req-ed9bc599-e0ef-4e23-b08d-990aff0e2cae service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Received unexpected event network-vif-plugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b for instance with vm_state active and task_state rescuing.
Dec 05 12:24:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a064dc1d-fcaf-4656-b7b9-2ba16c0cd5ac tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:24:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Acquiring lock "9656e5d1-8fde-4a19-991c-211868fa5c91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Lock "9656e5d1-8fde-4a19-991c-211868fa5c91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:24:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:19 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:24:19 user nova-compute[75071]: INFO nova.compute.claims [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Claim successful on node user
Dec 05 12:24:20 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:24:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:24:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG nova.policy [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa483ae6045044f79ffd2b1abbc53b7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3579bec934044881a26b5b396a8ab0d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:24:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Creating image(s)
Dec 05 12:24:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Acquiring lock "/opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Lock "/opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Lock "/opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/disk 1073741824" returned: 0 in 0.051s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.261s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:21 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:24:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Successfully created port: e6d3f295-2730-49ff-833f-fe9c55982a13 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:24:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:21 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Cannot resize image /opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:24:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:24:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Ensure instance console log exists: /opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:24:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Successfully updated port: e6d3f295-2730-49ff-833f-fe9c55982a13 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:24:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Acquiring lock "refresh_cache-9656e5d1-8fde-4a19-991c-211868fa5c91" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:24:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Acquired lock "refresh_cache-9656e5d1-8fde-4a19-991c-211868fa5c91" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:24:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:24:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-54274473-7a79-452e-9d22-8538d646c9be req-4feb680b-9884-461d-a1ab-a8e1cbdbf603 service nova] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Received event network-changed-e6d3f295-2730-49ff-833f-fe9c55982a13 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:24:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-54274473-7a79-452e-9d22-8538d646c9be req-4feb680b-9884-461d-a1ab-a8e1cbdbf603 service nova] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Refreshing instance network info cache due to event network-changed-e6d3f295-2730-49ff-833f-fe9c55982a13. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:24:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-54274473-7a79-452e-9d22-8538d646c9be req-4feb680b-9884-461d-a1ab-a8e1cbdbf603 service nova] Acquiring lock "refresh_cache-9656e5d1-8fde-4a19-991c-211868fa5c91" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:24:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Updating instance_info_cache with network_info: [{"id": "e6d3f295-2730-49ff-833f-fe9c55982a13", "address": "fa:16:3e:b4:20:de", "network": {"id": "a4b18234-057b-4055-9a64-f1ed0b9d3437", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a819537618b54160ae57eb9baebc65fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d3f295-27", "ovs_interfaceid": "e6d3f295-2730-49ff-833f-fe9c55982a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Releasing lock "refresh_cache-9656e5d1-8fde-4a19-991c-211868fa5c91" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Instance network_info: |[{"id": "e6d3f295-2730-49ff-833f-fe9c55982a13", "address": "fa:16:3e:b4:20:de", "network": {"id": "a4b18234-057b-4055-9a64-f1ed0b9d3437", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a819537618b54160ae57eb9baebc65fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d3f295-27", "ovs_interfaceid": "e6d3f295-2730-49ff-833f-fe9c55982a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-54274473-7a79-452e-9d22-8538d646c9be req-4feb680b-9884-461d-a1ab-a8e1cbdbf603 service nova] Acquired lock "refresh_cache-9656e5d1-8fde-4a19-991c-211868fa5c91" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.network.neutron [req-54274473-7a79-452e-9d22-8538d646c9be req-4feb680b-9884-461d-a1ab-a8e1cbdbf603 service nova] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Refreshing network info cache for port e6d3f295-2730-49ff-833f-fe9c55982a13 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Start _get_guest_xml network_info=[{"id": "e6d3f295-2730-49ff-833f-fe9c55982a13", "address": "fa:16:3e:b4:20:de", "network": {"id": "a4b18234-057b-4055-9a64-f1ed0b9d3437", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a819537618b54160ae57eb9baebc65fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d3f295-27", "ovs_interfaceid": "e6d3f295-2730-49ff-833f-fe9c55982a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:24:22 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:24:22 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1212614315',display_name='tempest-VolumesNegativeTest-instance-1212614315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1212614315',id=24,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3579bec934044881a26b5b396a8ab0d2',ramdisk_id='',reservation_id='r-l50wh9s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-102609202',owner_user_name='tempest-VolumesNegativeTest-102609202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:24:20Z,user_data=None,user_id='aa483ae6045044f79ffd2b1abbc53b7f',uuid=9656e5d1-8fde-4a19-991c-211868fa5c91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6d3f295-2730-49ff-833f-fe9c55982a13", "address": "fa:16:3e:b4:20:de", "network": {"id": "a4b18234-057b-4055-9a64-f1ed0b9d3437", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a819537618b54160ae57eb9baebc65fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d3f295-27", "ovs_interfaceid": "e6d3f295-2730-49ff-833f-fe9c55982a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Converting VIF {"id": "e6d3f295-2730-49ff-833f-fe9c55982a13", "address": "fa:16:3e:b4:20:de", "network": {"id": "a4b18234-057b-4055-9a64-f1ed0b9d3437", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a819537618b54160ae57eb9baebc65fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d3f295-27", "ovs_interfaceid": "e6d3f295-2730-49ff-833f-fe9c55982a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:20:de,bridge_name='br-int',has_traffic_filtering=True,id=e6d3f295-2730-49ff-833f-fe9c55982a13,network=Network(a4b18234-057b-4055-9a64-f1ed0b9d3437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d3f295-27') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.objects.instance [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Lazy-loading 'pci_devices' on Instance uuid 9656e5d1-8fde-4a19-991c-211868fa5c91 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:24:22 user nova-compute[75071]:   <uuid>9656e5d1-8fde-4a19-991c-211868fa5c91</uuid>
Dec 05 12:24:22 user nova-compute[75071]:   <name>instance-00000018</name>
Dec 05 12:24:22 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:24:22 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:24:22 user nova-compute[75071]:   <metadata>
Dec 05 12:24:22 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:24:22 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:24:22 user nova-compute[75071]:       <nova:name>tempest-VolumesNegativeTest-instance-1212614315</nova:name>
Dec 05 12:24:22 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:24:22</nova:creationTime>
Dec 05 12:24:22 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:24:22 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:24:22 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:24:22 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:24:22 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:24:22 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:24:22 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:24:22 user nova-compute[75071]:       <nova:owner>
Dec 05 12:24:22 user nova-compute[75071]:         <nova:user uuid="aa483ae6045044f79ffd2b1abbc53b7f">tempest-VolumesNegativeTest-102609202-project-member</nova:user>
Dec 05 12:24:22 user nova-compute[75071]:         <nova:project uuid="3579bec934044881a26b5b396a8ab0d2">tempest-VolumesNegativeTest-102609202</nova:project>
Dec 05 12:24:22 user nova-compute[75071]:       </nova:owner>
Dec 05 12:24:22 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:24:22 user nova-compute[75071]:       <nova:ports>
Dec 05 12:24:22 user nova-compute[75071]:         <nova:port uuid="e6d3f295-2730-49ff-833f-fe9c55982a13">
Dec 05 12:24:22 user nova-compute[75071]:           <nova:ip type="fixed" address="192.168.233.197" ipVersion="4"/>
Dec 05 12:24:22 user nova-compute[75071]:         </nova:port>
Dec 05 12:24:22 user nova-compute[75071]:       </nova:ports>
Dec 05 12:24:22 user nova-compute[75071]:     </nova:instance>
Dec 05 12:24:22 user nova-compute[75071]:   </metadata>
Dec 05 12:24:22 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:24:22 user nova-compute[75071]:     <system>
Dec 05 12:24:22 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:24:22 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:24:22 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:24:22 user nova-compute[75071]:       <entry name="serial">9656e5d1-8fde-4a19-991c-211868fa5c91</entry>
Dec 05 12:24:22 user nova-compute[75071]:       <entry name="uuid">9656e5d1-8fde-4a19-991c-211868fa5c91</entry>
Dec 05 12:24:22 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:24:22 user nova-compute[75071]:     </system>
Dec 05 12:24:22 user nova-compute[75071]:   </sysinfo>
Dec 05 12:24:22 user nova-compute[75071]:   <os>
Dec 05 12:24:22 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:24:22 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:24:22 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:24:22 user nova-compute[75071]:   </os>
Dec 05 12:24:22 user nova-compute[75071]:   <features>
Dec 05 12:24:22 user nova-compute[75071]:     <acpi/>
Dec 05 12:24:22 user nova-compute[75071]:     <apic/>
Dec 05 12:24:22 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:24:22 user nova-compute[75071]:   </features>
Dec 05 12:24:22 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:24:22 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:24:22 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:24:22 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:24:22 user nova-compute[75071]:   </clock>
Dec 05 12:24:22 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:24:22 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:24:22 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:24:22 user nova-compute[75071]:   </cpu>
Dec 05 12:24:22 user nova-compute[75071]:   <devices>
Dec 05 12:24:22 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:24:22 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:24:22 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/disk"/>
Dec 05 12:24:22 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:24:22 user nova-compute[75071]:     </disk>
Dec 05 12:24:22 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:24:22 user nova-compute[75071]:       <mac address="fa:16:3e:b4:20:de"/>
Dec 05 12:24:22 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:24:22 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:24:22 user nova-compute[75071]:       <target dev="tape6d3f295-27"/>
Dec 05 12:24:22 user nova-compute[75071]:     </interface>
Dec 05 12:24:22 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:24:22 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/console.log" append="off"/>
Dec 05 12:24:22 user nova-compute[75071]:     </serial>
Dec 05 12:24:22 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:24:22 user nova-compute[75071]:     <video>
Dec 05 12:24:22 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:24:22 user nova-compute[75071]:     </video>
Dec 05 12:24:22 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:24:22 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:24:22 user nova-compute[75071]:     </rng>
Dec 05 12:24:22 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:24:22 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:24:22 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:24:22 user nova-compute[75071]:     </memballoon>
Dec 05 12:24:22 user nova-compute[75071]:   </devices>
Dec 05 12:24:22 user nova-compute[75071]: </domain>
Dec 05 12:24:22 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1212614315',display_name='tempest-VolumesNegativeTest-instance-1212614315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1212614315',id=24,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3579bec934044881a26b5b396a8ab0d2',ramdisk_id='',reservation_id='r-l50wh9s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-102609202',owner_user_name='tempest-VolumesNegativeTest-102609202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:24:20Z,user_data=None,user_id='aa483ae6045044f79ffd2b1abbc53b7f',uuid=9656e5d1-8fde-4a19-991c-211868fa5c91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6d3f295-2730-49ff-833f-fe9c55982a13", "address": "fa:16:3e:b4:20:de", "network": {"id": "a4b18234-057b-4055-9a64-f1ed0b9d3437", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a819537618b54160ae57eb9baebc65fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d3f295-27", "ovs_interfaceid": "e6d3f295-2730-49ff-833f-fe9c55982a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Converting VIF {"id": "e6d3f295-2730-49ff-833f-fe9c55982a13", "address": "fa:16:3e:b4:20:de", "network": {"id": "a4b18234-057b-4055-9a64-f1ed0b9d3437", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a819537618b54160ae57eb9baebc65fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d3f295-27", "ovs_interfaceid": "e6d3f295-2730-49ff-833f-fe9c55982a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:20:de,bridge_name='br-int',has_traffic_filtering=True,id=e6d3f295-2730-49ff-833f-fe9c55982a13,network=Network(a4b18234-057b-4055-9a64-f1ed0b9d3437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d3f295-27') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG os_vif [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:20:de,bridge_name='br-int',has_traffic_filtering=True,id=e6d3f295-2730-49ff-833f-fe9c55982a13,network=Network(a4b18234-057b-4055-9a64-f1ed0b9d3437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d3f295-27') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79efbc94-1bd9-536b-9ef2-3069800765ba', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6d3f295-27, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6d3f295-27, col_values=(('qos', UUID('47714b83-3eba-49a4-9d65-78f5eea9c17f')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6d3f295-27, col_values=(('external_ids', {'iface-id': 'e6d3f295-2730-49ff-833f-fe9c55982a13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:20:de', 'vm-uuid': '9656e5d1-8fde-4a19-991c-211868fa5c91'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:22 user nova-compute[75071]: INFO os_vif [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:20:de,bridge_name='br-int',has_traffic_filtering=True,id=e6d3f295-2730-49ff-833f-fe9c55982a13,network=Network(a4b18234-057b-4055-9a64-f1ed0b9d3437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d3f295-27')
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:24:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] No VIF found with MAC fa:16:3e:b4:20:de, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:24:23 user nova-compute[75071]: DEBUG nova.network.neutron [req-54274473-7a79-452e-9d22-8538d646c9be req-4feb680b-9884-461d-a1ab-a8e1cbdbf603 service nova] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Updated VIF entry in instance network info cache for port e6d3f295-2730-49ff-833f-fe9c55982a13. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:24:23 user nova-compute[75071]: DEBUG nova.network.neutron [req-54274473-7a79-452e-9d22-8538d646c9be req-4feb680b-9884-461d-a1ab-a8e1cbdbf603 service nova] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Updating instance_info_cache with network_info: [{"id": "e6d3f295-2730-49ff-833f-fe9c55982a13", "address": "fa:16:3e:b4:20:de", "network": {"id": "a4b18234-057b-4055-9a64-f1ed0b9d3437", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a819537618b54160ae57eb9baebc65fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d3f295-27", "ovs_interfaceid": "e6d3f295-2730-49ff-833f-fe9c55982a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:24:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-54274473-7a79-452e-9d22-8538d646c9be req-4feb680b-9884-461d-a1ab-a8e1cbdbf603 service nova] Releasing lock "refresh_cache-9656e5d1-8fde-4a19-991c-211868fa5c91" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:24:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-dfcdee79-d3af-447a-a4fe-bddf668d773a req-5f7e6996-1b04-4d05-b058-da02373ba48e service nova] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Received event network-vif-plugged-e6d3f295-2730-49ff-833f-fe9c55982a13 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:24:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dfcdee79-d3af-447a-a4fe-bddf668d773a req-5f7e6996-1b04-4d05-b058-da02373ba48e service nova] Acquiring lock "9656e5d1-8fde-4a19-991c-211868fa5c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dfcdee79-d3af-447a-a4fe-bddf668d773a req-5f7e6996-1b04-4d05-b058-da02373ba48e service nova] Lock "9656e5d1-8fde-4a19-991c-211868fa5c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dfcdee79-d3af-447a-a4fe-bddf668d773a req-5f7e6996-1b04-4d05-b058-da02373ba48e service nova] Lock "9656e5d1-8fde-4a19-991c-211868fa5c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-dfcdee79-d3af-447a-a4fe-bddf668d773a req-5f7e6996-1b04-4d05-b058-da02373ba48e service nova] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] No waiting events found dispatching network-vif-plugged-e6d3f295-2730-49ff-833f-fe9c55982a13 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:24:24 user nova-compute[75071]: WARNING nova.compute.manager [req-dfcdee79-d3af-447a-a4fe-bddf668d773a req-5f7e6996-1b04-4d05-b058-da02373ba48e service nova] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Received unexpected event network-vif-plugged-e6d3f295-2730-49ff-833f-fe9c55982a13 for instance with vm_state building and task_state spawning.
Dec 05 12:24:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec9d2786-1477-4e9f-92e5-7f95e3c12b6e req-c3bfd6d3-fdc9-4bcd-a3fc-0c04f8855d1d service nova] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Received event network-vif-plugged-e6d3f295-2730-49ff-833f-fe9c55982a13 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:24:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec9d2786-1477-4e9f-92e5-7f95e3c12b6e req-c3bfd6d3-fdc9-4bcd-a3fc-0c04f8855d1d service nova] Acquiring lock "9656e5d1-8fde-4a19-991c-211868fa5c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec9d2786-1477-4e9f-92e5-7f95e3c12b6e req-c3bfd6d3-fdc9-4bcd-a3fc-0c04f8855d1d service nova] Lock "9656e5d1-8fde-4a19-991c-211868fa5c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec9d2786-1477-4e9f-92e5-7f95e3c12b6e req-c3bfd6d3-fdc9-4bcd-a3fc-0c04f8855d1d service nova] Lock "9656e5d1-8fde-4a19-991c-211868fa5c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec9d2786-1477-4e9f-92e5-7f95e3c12b6e req-c3bfd6d3-fdc9-4bcd-a3fc-0c04f8855d1d service nova] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] No waiting events found dispatching network-vif-plugged-e6d3f295-2730-49ff-833f-fe9c55982a13 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:24:26 user nova-compute[75071]: WARNING nova.compute.manager [req-ec9d2786-1477-4e9f-92e5-7f95e3c12b6e req-c3bfd6d3-fdc9-4bcd-a3fc-0c04f8855d1d service nova] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Received unexpected event network-vif-plugged-e6d3f295-2730-49ff-833f-fe9c55982a13 for instance with vm_state building and task_state spawning.
Dec 05 12:24:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:24:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:24:27 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Instance spawned successfully.
Dec 05 12:24:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:24:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:24:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:24:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:24:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:24:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:24:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:24:27 user nova-compute[75071]: INFO nova.compute.manager [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Took 6.86 seconds to spawn the instance on the hypervisor.
Dec 05 12:24:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:24:27 user nova-compute[75071]: INFO nova.compute.manager [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Took 7.72 seconds to build instance.
Dec 05 12:24:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fcaef3f6-08e4-4cdf-a4a2-4d6aede3fc04 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Lock "9656e5d1-8fde-4a19-991c-211868fa5c91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.873s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-58e239d5-cdd5-45b8-a748-ac8cd8c84311 req-753c1acb-e22e-4b9a-91e7-c35ecd3ae5b7 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received event network-changed-1219420b-24a0-435b-aaa4-283c51d9a847 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:24:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-58e239d5-cdd5-45b8-a748-ac8cd8c84311 req-753c1acb-e22e-4b9a-91e7-c35ecd3ae5b7 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Refreshing instance network info cache due to event network-changed-1219420b-24a0-435b-aaa4-283c51d9a847. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:24:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-58e239d5-cdd5-45b8-a748-ac8cd8c84311 req-753c1acb-e22e-4b9a-91e7-c35ecd3ae5b7 service nova] Acquiring lock "refresh_cache-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:24:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-58e239d5-cdd5-45b8-a748-ac8cd8c84311 req-753c1acb-e22e-4b9a-91e7-c35ecd3ae5b7 service nova] Acquired lock "refresh_cache-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:24:32 user nova-compute[75071]: DEBUG nova.network.neutron [req-58e239d5-cdd5-45b8-a748-ac8cd8c84311 req-753c1acb-e22e-4b9a-91e7-c35ecd3ae5b7 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Refreshing network info cache for port 1219420b-24a0-435b-aaa4-283c51d9a847 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:24:33 user nova-compute[75071]: DEBUG nova.network.neutron [req-58e239d5-cdd5-45b8-a748-ac8cd8c84311 req-753c1acb-e22e-4b9a-91e7-c35ecd3ae5b7 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Updated VIF entry in instance network info cache for port 1219420b-24a0-435b-aaa4-283c51d9a847. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:24:33 user nova-compute[75071]: DEBUG nova.network.neutron [req-58e239d5-cdd5-45b8-a748-ac8cd8c84311 req-753c1acb-e22e-4b9a-91e7-c35ecd3ae5b7 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Updating instance_info_cache with network_info: [{"id": "1219420b-24a0-435b-aaa4-283c51d9a847", "address": "fa:16:3e:f4:b1:b4", "network": {"id": "18d0b7e0-69a8-4771-8e3a-665d0b5d2c75", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1386912740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219420b-24", "ovs_interfaceid": "1219420b-24a0-435b-aaa4-283c51d9a847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:24:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-58e239d5-cdd5-45b8-a748-ac8cd8c84311 req-753c1acb-e22e-4b9a-91e7-c35ecd3ae5b7 service nova] Releasing lock "refresh_cache-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:24:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquiring lock "interface-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "interface-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:33 user nova-compute[75071]: DEBUG nova.objects.instance [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lazy-loading 'flavor' on Instance uuid 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:24:34 user nova-compute[75071]: DEBUG nova.objects.instance [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lazy-loading 'pci_requests' on Instance uuid 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:24:34 user nova-compute[75071]: DEBUG nova.objects.base [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Object Instance<26cff7c2-b2a8-4a33-a2a0-3a63a2073d21> lazy-loaded attributes: flavor,pci_requests {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:24:34 user nova-compute[75071]: DEBUG nova.network.neutron [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:24:34 user nova-compute[75071]: DEBUG nova.policy [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a361c08c15664fbd880f06b487d62aa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6041024288a84808858ed4938f83fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:24:35 user nova-compute[75071]: DEBUG nova.network.neutron [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Successfully created port: 797d5492-5f6c-4838-8957-0e25ae77c86d {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:24:36 user nova-compute[75071]: DEBUG nova.network.neutron [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Successfully updated port: 797d5492-5f6c-4838-8957-0e25ae77c86d {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:24:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquiring lock "refresh_cache-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:24:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquired lock "refresh_cache-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:24:36 user nova-compute[75071]: DEBUG nova.network.neutron [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:24:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-4dbb25a1-fda0-4131-a2f7-7345af077b78 req-cc5cd5a2-dffa-4ff1-ab2a-932edbdb36b2 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received event network-changed-797d5492-5f6c-4838-8957-0e25ae77c86d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:24:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-4dbb25a1-fda0-4131-a2f7-7345af077b78 req-cc5cd5a2-dffa-4ff1-ab2a-932edbdb36b2 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Refreshing instance network info cache due to event network-changed-797d5492-5f6c-4838-8957-0e25ae77c86d. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:24:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4dbb25a1-fda0-4131-a2f7-7345af077b78 req-cc5cd5a2-dffa-4ff1-ab2a-932edbdb36b2 service nova] Acquiring lock "refresh_cache-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Updating instance_info_cache with network_info: [{"id": "1219420b-24a0-435b-aaa4-283c51d9a847", "address": "fa:16:3e:f4:b1:b4", "network": {"id": "18d0b7e0-69a8-4771-8e3a-665d0b5d2c75", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1386912740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219420b-24", "ovs_interfaceid": "1219420b-24a0-435b-aaa4-283c51d9a847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "797d5492-5f6c-4838-8957-0e25ae77c86d", "address": "fa:16:3e:f8:08:dc", "network": {"id": "e1b36d20-1610-4f57-b9e8-0d05b9422626", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-904919460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d5492-5f", "ovs_interfaceid": "797d5492-5f6c-4838-8957-0e25ae77c86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Releasing lock "refresh_cache-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4dbb25a1-fda0-4131-a2f7-7345af077b78 req-cc5cd5a2-dffa-4ff1-ab2a-932edbdb36b2 service nova] Acquired lock "refresh_cache-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG nova.network.neutron [req-4dbb25a1-fda0-4131-a2f7-7345af077b78 req-cc5cd5a2-dffa-4ff1-ab2a-932edbdb36b2 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Refreshing network info cache for port 797d5492-5f6c-4838-8957-0e25ae77c86d {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1053518687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1053518687',id=20,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz9ElrhNZZvItqxGapQtmVbaKvJMnHtVQyBhczgKvaO8d/GBJ06KdbJMsPoiJPdFlj8W+R0Nu4rD1BhABN0XoGYod9pe9msGHytqCXlWqPOlmLX9S/AlygQdInxVYWU+Q==',key_name='tempest-keypair-1649114374',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:22:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6041024288a84808858ed4938f83fee5',ramdisk_id='',reservation_id='r-v4p52h60',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1076524669',owner_user_name='tempest-TaggedAttachmentsTest-1076524669-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a361c08c15664fbd880f06b487d62aa6',uuid=26cff7c2-b2a8-4a33-a2a0-3a63a2073d21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "797d5492-5f6c-4838-8957-0e25ae77c86d", "address": "fa:16:3e:f8:08:dc", "network": {"id": "e1b36d20-1610-4f57-b9e8-0d05b9422626", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-904919460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d5492-5f", "ovs_interfaceid": "797d5492-5f6c-4838-8957-0e25ae77c86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Converting VIF {"id": "797d5492-5f6c-4838-8957-0e25ae77c86d", "address": "fa:16:3e:f8:08:dc", "network": {"id": "e1b36d20-1610-4f57-b9e8-0d05b9422626", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-904919460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d5492-5f", "ovs_interfaceid": "797d5492-5f6c-4838-8957-0e25ae77c86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:08:dc,bridge_name='br-int',has_traffic_filtering=True,id=797d5492-5f6c-4838-8957-0e25ae77c86d,network=Network(e1b36d20-1610-4f57-b9e8-0d05b9422626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap797d5492-5f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG os_vif [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:08:dc,bridge_name='br-int',has_traffic_filtering=True,id=797d5492-5f6c-4838-8957-0e25ae77c86d,network=Network(e1b36d20-1610-4f57-b9e8-0d05b9422626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap797d5492-5f') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60b95b61-c0bd-57bc-a780-1340d10e2b9e', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap797d5492-5f, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap797d5492-5f, col_values=(('qos', UUID('28cf0491-0fbe-4a85-b5e7-73fdc5302ec8')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap797d5492-5f, col_values=(('external_ids', {'iface-id': '797d5492-5f6c-4838-8957-0e25ae77c86d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:08:dc', 'vm-uuid': '26cff7c2-b2a8-4a33-a2a0-3a63a2073d21'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:37 user nova-compute[75071]: INFO os_vif [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:08:dc,bridge_name='br-int',has_traffic_filtering=True,id=797d5492-5f6c-4838-8957-0e25ae77c86d,network=Network(e1b36d20-1610-4f57-b9e8-0d05b9422626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap797d5492-5f')
Dec 05 12:24:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1053518687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1053518687',id=20,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz9ElrhNZZvItqxGapQtmVbaKvJMnHtVQyBhczgKvaO8d/GBJ06KdbJMsPoiJPdFlj8W+R0Nu4rD1BhABN0XoGYod9pe9msGHytqCXlWqPOlmLX9S/AlygQdInxVYWU+Q==',key_name='tempest-keypair-1649114374',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:22:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6041024288a84808858ed4938f83fee5',ramdisk_id='',reservation_id='r-v4p52h60',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1076524669',owner_user_name='tempest-TaggedAttachmentsTest-1076524669-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a361c08c15664fbd880f06b487d62aa6',uuid=26cff7c2-b2a8-4a33-a2a0-3a63a2073d21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "797d5492-5f6c-4838-8957-0e25ae77c86d", "address": "fa:16:3e:f8:08:dc", "network": {"id": "e1b36d20-1610-4f57-b9e8-0d05b9422626", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-904919460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d5492-5f", "ovs_interfaceid": "797d5492-5f6c-4838-8957-0e25ae77c86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Converting VIF {"id": "797d5492-5f6c-4838-8957-0e25ae77c86d", "address": "fa:16:3e:f8:08:dc", "network": {"id": "e1b36d20-1610-4f57-b9e8-0d05b9422626", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-904919460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d5492-5f", "ovs_interfaceid": "797d5492-5f6c-4838-8957-0e25ae77c86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:08:dc,bridge_name='br-int',has_traffic_filtering=True,id=797d5492-5f6c-4838-8957-0e25ae77c86d,network=Network(e1b36d20-1610-4f57-b9e8-0d05b9422626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap797d5492-5f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] attach device xml: <interface type="ethernet">
Dec 05 12:24:37 user nova-compute[75071]:   <mac address="fa:16:3e:f8:08:dc"/>
Dec 05 12:24:37 user nova-compute[75071]:   <model type="virtio"/>
Dec 05 12:24:37 user nova-compute[75071]:   <mtu size="1442"/>
Dec 05 12:24:37 user nova-compute[75071]:   <target dev="tap797d5492-5f"/>
Dec 05 12:24:37 user nova-compute[75071]: </interface>
Dec 05 12:24:37 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-dd38f773-5f7a-4856-a7c8-2294598f10e0 req-c707ffb3-4c82-4b1b-8d3a-a69548919efc service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received event network-vif-plugged-797d5492-5f6c-4838-8957-0e25ae77c86d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd38f773-5f7a-4856-a7c8-2294598f10e0 req-c707ffb3-4c82-4b1b-8d3a-a69548919efc service nova] Acquiring lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd38f773-5f7a-4856-a7c8-2294598f10e0 req-c707ffb3-4c82-4b1b-8d3a-a69548919efc service nova] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dd38f773-5f7a-4856-a7c8-2294598f10e0 req-c707ffb3-4c82-4b1b-8d3a-a69548919efc service nova] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-dd38f773-5f7a-4856-a7c8-2294598f10e0 req-c707ffb3-4c82-4b1b-8d3a-a69548919efc service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] No waiting events found dispatching network-vif-plugged-797d5492-5f6c-4838-8957-0e25ae77c86d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:24:38 user nova-compute[75071]: WARNING nova.compute.manager [req-dd38f773-5f7a-4856-a7c8-2294598f10e0 req-c707ffb3-4c82-4b1b-8d3a-a69548919efc service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received unexpected event network-vif-plugged-797d5492-5f6c-4838-8957-0e25ae77c86d for instance with vm_state active and task_state None.
Dec 05 12:24:38 user nova-compute[75071]: DEBUG nova.network.neutron [req-4dbb25a1-fda0-4131-a2f7-7345af077b78 req-cc5cd5a2-dffa-4ff1-ab2a-932edbdb36b2 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Updated VIF entry in instance network info cache for port 797d5492-5f6c-4838-8957-0e25ae77c86d. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG nova.network.neutron [req-4dbb25a1-fda0-4131-a2f7-7345af077b78 req-cc5cd5a2-dffa-4ff1-ab2a-932edbdb36b2 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Updating instance_info_cache with network_info: [{"id": "1219420b-24a0-435b-aaa4-283c51d9a847", "address": "fa:16:3e:f4:b1:b4", "network": {"id": "18d0b7e0-69a8-4771-8e3a-665d0b5d2c75", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1386912740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219420b-24", "ovs_interfaceid": "1219420b-24a0-435b-aaa4-283c51d9a847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "797d5492-5f6c-4838-8957-0e25ae77c86d", "address": "fa:16:3e:f8:08:dc", "network": {"id": "e1b36d20-1610-4f57-b9e8-0d05b9422626", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-904919460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d5492-5f", "ovs_interfaceid": "797d5492-5f6c-4838-8957-0e25ae77c86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4dbb25a1-fda0-4131-a2f7-7345af077b78 req-cc5cd5a2-dffa-4ff1-ab2a-932edbdb36b2 service nova] Releasing lock "refresh_cache-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] No BDM found with device name hda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] No VIF found with MAC fa:16:3e:f4:b1:b4, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:24:38 user nova-compute[75071]:   <nova:package version="0.0.0"/>
Dec 05 12:24:38 user nova-compute[75071]:   <nova:name>tempest-device-tagging-server-1053518687</nova:name>
Dec 05 12:24:38 user nova-compute[75071]:   <nova:creationTime>2023-12-05 12:24:38</nova:creationTime>
Dec 05 12:24:38 user nova-compute[75071]:   <nova:flavor name="m1.tiny">
Dec 05 12:24:38 user nova-compute[75071]:     <nova:memory>512</nova:memory>
Dec 05 12:24:38 user nova-compute[75071]:     <nova:disk>1</nova:disk>
Dec 05 12:24:38 user nova-compute[75071]:     <nova:swap>0</nova:swap>
Dec 05 12:24:38 user nova-compute[75071]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:24:38 user nova-compute[75071]:     <nova:vcpus>1</nova:vcpus>
Dec 05 12:24:38 user nova-compute[75071]:   </nova:flavor>
Dec 05 12:24:38 user nova-compute[75071]:   <nova:owner>
Dec 05 12:24:38 user nova-compute[75071]:     <nova:user uuid="a361c08c15664fbd880f06b487d62aa6">tempest-TaggedAttachmentsTest-1076524669-project-member</nova:user>
Dec 05 12:24:38 user nova-compute[75071]:     <nova:project uuid="6041024288a84808858ed4938f83fee5">tempest-TaggedAttachmentsTest-1076524669</nova:project>
Dec 05 12:24:38 user nova-compute[75071]:   </nova:owner>
Dec 05 12:24:38 user nova-compute[75071]:   <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:24:38 user nova-compute[75071]:   <nova:ports>
Dec 05 12:24:38 user nova-compute[75071]:     <nova:port uuid="1219420b-24a0-435b-aaa4-283c51d9a847">
Dec 05 12:24:38 user nova-compute[75071]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 12:24:38 user nova-compute[75071]:     </nova:port>
Dec 05 12:24:38 user nova-compute[75071]:     <nova:port uuid="797d5492-5f6c-4838-8957-0e25ae77c86d">
Dec 05 12:24:38 user nova-compute[75071]:       <nova:ip type="fixed" address="10.10.10.236" ipVersion="4"/>
Dec 05 12:24:38 user nova-compute[75071]:     </nova:port>
Dec 05 12:24:38 user nova-compute[75071]:   </nova:ports>
Dec 05 12:24:38 user nova-compute[75071]: </nova:instance>
Dec 05 12:24:38 user nova-compute[75071]:  {{(pid=75071) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-87010485-ea14-4c24-b88a-052a57c8d381 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "interface-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.598s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquiring lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG nova.objects.instance [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lazy-loading 'flavor' on Instance uuid 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquiring lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:38 user nova-compute[75071]: INFO nova.compute.manager [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Attaching volume 5e82a56c-5b91-4937-9268-9a7173458202 to /dev/vdb
Dec 05 12:24:38 user nova-compute[75071]: DEBUG os_brick.utils [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27cc135-2df5-4727-8f72-7c01203410ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba97576-50e7-4424-82f5-9ad17fa94d0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:24:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[694005f6-21aa-414a-a8a3-37172c9de9c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:24:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf8f097-3ebd-49ee-9d7d-c9659c9de89a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:24:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:24:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:24:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:24:39 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:24:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af54ce6-af86-40e3-a60f-324512f106ff]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:24:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:24:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:24:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:24:39 user nova-compute[75071]: DEBUG os_brick.utils [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:24:39 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Updating existing volume attachment record: ed1171ab-d0ca-4d8b-901a-b67155d235be {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:24:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-d1c9cacc-2897-4deb-890a-1f155fcd57e4 req-e94c8b5c-3c49-44cd-a9d8-c2ac46bffea1 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received event network-vif-plugged-797d5492-5f6c-4838-8957-0e25ae77c86d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:24:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d1c9cacc-2897-4deb-890a-1f155fcd57e4 req-e94c8b5c-3c49-44cd-a9d8-c2ac46bffea1 service nova] Acquiring lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d1c9cacc-2897-4deb-890a-1f155fcd57e4 req-e94c8b5c-3c49-44cd-a9d8-c2ac46bffea1 service nova] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d1c9cacc-2897-4deb-890a-1f155fcd57e4 req-e94c8b5c-3c49-44cd-a9d8-c2ac46bffea1 service nova] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-d1c9cacc-2897-4deb-890a-1f155fcd57e4 req-e94c8b5c-3c49-44cd-a9d8-c2ac46bffea1 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] No waiting events found dispatching network-vif-plugged-797d5492-5f6c-4838-8957-0e25ae77c86d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:24:40 user nova-compute[75071]: WARNING nova.compute.manager [req-d1c9cacc-2897-4deb-890a-1f155fcd57e4 req-e94c8b5c-3c49-44cd-a9d8-c2ac46bffea1 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received unexpected event network-vif-plugged-797d5492-5f6c-4838-8957-0e25ae77c86d for instance with vm_state active and task_state None.
Dec 05 12:24:41 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:24:41 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:24:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:42 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:24:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:42 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:24:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:24:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:48 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:24:48 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:24:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=7215MB free_disk=25.115779876708984GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e08be776-0fa9-4871-86eb-2093530c00f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 62efa94c-ae01-48aa-b3d3-0d23d159801c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance cad9a071-e232-4629-a3cc-9cb9d3fe9333 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 17348e17-fde4-49b9-a79d-8361724acc4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 386e93a2-2435-4d5f-bee2-fdb5f52fd476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9656e5d1-8fde-4a19-991c-211868fa5c91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:24:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.591s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQSIcLMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:24:49 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:24:49 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:24:49 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb452c42-b237-4946-b9c4-161dbe1e827e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:24:49 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[83817996-db1c-4479-b3a4-ad3688a26084]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202] added
Dec 05 12:24:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bfb883-4902-43ed-a58d-fa5b89d32f49]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1f7da1-13cf-4869-be26-734e9541c7d3]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQSIcLMo {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pQSIcLMo" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b6886c-949a-4429-ac87-263637e452ad]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pQSIcLMo'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[752d7eb9-5cc2-4a50-9695-d32caca471af]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdabec23-92bb-4ddb-bda3-e2c7f463d411]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:24:49 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:24:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:24:49 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:24:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[78726307-3966-4b66-8cfa-b2024a7d489d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202, portal: 172.16.0.220,3260]
Dec 05 12:24:49 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202, portal: 172.16.0.220,3260] successful.
Dec 05 12:24:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[404e7459-9923-481e-a2fd-c0713b0b10bb]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda9149b-7338-474b-877d-17b8faad43dd]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:24:49 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:24:49 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 (non-flash)
Dec 05 12:24:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:24:49 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:24:49 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 (non-flash)
Dec 05 12:24:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b0120b-a93c-4743-af62-a50bc1f15d8c]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:24:49 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:24:50 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updating instance_info_cache with network_info: [{"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:24:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:24:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:24:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:24:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:24:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:24:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:24:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:24:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:24:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:24:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQSIcLMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:24:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:24:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23637336436313865', 'path': '/dev/sdd'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:24:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637336436313865', 'path': '/dev/sdd'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:24:50 user nova-compute[75071]: DEBUG nova.objects.instance [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lazy-loading 'flavor' on Instance uuid 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:24:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:24:50 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:24:50 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Dec 05 12:24:50 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:24:50 user nova-compute[75071]:   <serial>5e82a56c-5b91-4937-9268-9a7173458202</serial>
Dec 05 12:24:50 user nova-compute[75071]: </disk>
Dec 05 12:24:50 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:24:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:24:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] No BDM found with device name hda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:24:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] No VIF found with MAC fa:16:3e:f4:b1:b4, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:24:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-331a1fff-83eb-432e-ae88-be38c7e5b283 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.410s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:24:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquiring lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:52 user nova-compute[75071]: INFO nova.compute.manager [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Detaching volume 5e82a56c-5b91-4937-9268-9a7173458202
Dec 05 12:24:52 user nova-compute[75071]: INFO nova.virt.block_device [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Attempting to driver detach volume 5e82a56c-5b91-4937-9268-9a7173458202 from mountpoint /dev/vdb
Dec 05 12:24:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Attempting to detach device vdb from instance 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:24:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:24:52 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:24:52 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Dec 05 12:24:52 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:24:52 user nova-compute[75071]:   <serial>5e82a56c-5b91-4937-9268-9a7173458202</serial>
Dec 05 12:24:52 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 05 12:24:52 user nova-compute[75071]: </disk>
Dec 05 12:24:52 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:24:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Successfully detached device vdb from instance 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 from the persistent domain config.
Dec 05 12:24:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:24:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:24:52 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:24:52 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Dec 05 12:24:52 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:24:52 user nova-compute[75071]:   <serial>5e82a56c-5b91-4937-9268-9a7173458202</serial>
Dec 05 12:24:52 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 05 12:24:52 user nova-compute[75071]: </disk>
Dec 05 12:24:52 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:24:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:24:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "62efa94c-ae01-48aa-b3d3-0d23d159801c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:24:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:24:56 user nova-compute[75071]: INFO nova.compute.manager [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Detaching volume cc309cdc-014c-42c9-b515-3a094b0638be
Dec 05 12:24:56 user nova-compute[75071]: INFO nova.virt.block_device [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Attempting to driver detach volume cc309cdc-014c-42c9-b515-3a094b0638be from mountpoint /dev/vdb
Dec 05 12:24:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Attempting to detach device vdb from instance 62efa94c-ae01-48aa-b3d3-0d23d159801c from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:24:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:24:56 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:24:56 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:24:56 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:24:56 user nova-compute[75071]:   <serial>cc309cdc-014c-42c9-b515-3a094b0638be</serial>
Dec 05 12:24:56 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 12:24:56 user nova-compute[75071]: </disk>
Dec 05 12:24:56 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:24:56 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Successfully detached device vdb from instance 62efa94c-ae01-48aa-b3d3-0d23d159801c from the persistent domain config.
Dec 05 12:24:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 62efa94c-ae01-48aa-b3d3-0d23d159801c from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:24:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:24:56 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:24:56 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:24:56 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:24:56 user nova-compute[75071]:   <serial>cc309cdc-014c-42c9-b515-3a094b0638be</serial>
Dec 05 12:24:56 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 12:24:56 user nova-compute[75071]: </disk>
Dec 05 12:24:56 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:24:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 62efa94c-ae01-48aa-b3d3-0d23d159801c {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:24:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:24:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-33f73d67-dcd3-44fc-a4e9-0801da2de17f req-62318b64-3636-4275-9e99-f254b5863d63 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received event network-changed-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:25:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-33f73d67-dcd3-44fc-a4e9-0801da2de17f req-62318b64-3636-4275-9e99-f254b5863d63 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Refreshing instance network info cache due to event network-changed-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:25:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-33f73d67-dcd3-44fc-a4e9-0801da2de17f req-62318b64-3636-4275-9e99-f254b5863d63 service nova] Acquiring lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:25:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-33f73d67-dcd3-44fc-a4e9-0801da2de17f req-62318b64-3636-4275-9e99-f254b5863d63 service nova] Acquired lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:25:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-33f73d67-dcd3-44fc-a4e9-0801da2de17f req-62318b64-3636-4275-9e99-f254b5863d63 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Refreshing network info cache for port a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:25:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-33f73d67-dcd3-44fc-a4e9-0801da2de17f req-62318b64-3636-4275-9e99-f254b5863d63 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Updated VIF entry in instance network info cache for port a8db5130-7bc3-414c-b8bf-469e4fa0eb7b. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:25:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-33f73d67-dcd3-44fc-a4e9-0801da2de17f req-62318b64-3636-4275-9e99-f254b5863d63 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Updating instance_info_cache with network_info: [{"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:25:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-33f73d67-dcd3-44fc-a4e9-0801da2de17f req-62318b64-3636-4275-9e99-f254b5863d63 service nova] Releasing lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:25:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:13 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 is timed out.
Dec 05 12:25:13 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Successfully detached device vdb from instance 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 from the live domain config.
Dec 05 12:25:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pQSIcLMo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:25:13 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f31f60-2fe8-43fb-8b9b-50cc4cc9a070]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:25:13 user nova-compute[75071]: No targets found.
Dec 05 12:25:13 user nova-compute[75071]: iSNS:
Dec 05 12:25:13 user nova-compute[75071]: No targets found.
Dec 05 12:25:13 user nova-compute[75071]: STATIC:
Dec 05 12:25:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:25:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:25:13 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:25:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202
Dec 05 12:25:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:25:13 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:25:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be
Dec 05 12:25:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:25:13 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:25:13 user nova-compute[75071]: FIRMWARE:
Dec 05 12:25:13 user nova-compute[75071]: No targets found.
Dec 05 12:25:13 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:25:13 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:25:13 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d82a4c1-fd0b-47ce-b933-a634b0fc0fe8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d668684-7411-4b13-978d-9d3ca4dd9741]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:25:13 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:25:13 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 (non-flash)
Dec 05 12:25:13 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:25:13 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:25:13 user nova-compute[75071]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 (non-flash)
Dec 05 12:25:13 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f826414d240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202'): ({'sdd'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Removing single pathed devices sdd {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd8f1e6-5526-4b24-9f89-6828b9c4d706]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e50885-49d2-403b-9721-fdebde5e89c5]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Flushing IO for device /dev/sdd {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa0f0f9-74ee-4bc8-b537-ad24691ad477]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fb03f7-e650-49bb-beec-95e931b973da]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[336d4d5a-63f9-4438-aae4-bfcd5db07d77]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e0003b-7e5c-4e93-8e25-15a7ec126fe6]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202, portal: 172.16.0.220,3260]
Dec 05 12:25:13 user nova-compute[75071]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202, portal: 172.16.0.220,3260] successful.
Dec 05 12:25:13 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e82a56c-5b91-4937-9268-9a7173458202 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[865fe2fe-0e0b-46d0-9f5a-30459a2e2560]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] <== disconnect_volume: return (315ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:25:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:25:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:25:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:25:14 user nova-compute[75071]: INFO nova.compute.claims [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Claim successful on node user
Dec 05 12:25:14 user nova-compute[75071]: DEBUG nova.objects.instance [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lazy-loading 'flavor' on Instance uuid 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:25:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bed4ee87-c6f3-4380-bdec-cead9e76a7e1 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.864s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:14 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:25:14 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:25:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:25:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:25:14 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:25:14 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:25:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:25:14 user nova-compute[75071]: DEBUG nova.policy [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '809ec3faecd845e0ada2fc55ee6a8f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30662558d734f36ac8edbe9532d0d8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:25:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:25:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:25:14 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Creating image(s)
Dec 05 12:25:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "/opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "/opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "/opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.227s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquiring lock "interface-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-797d5492-5f6c-4838-8957-0e25ae77c86d" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "interface-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-797d5492-5f6c-4838-8957-0e25ae77c86d" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.objects.instance [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lazy-loading 'flavor' on Instance uuid 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1053518687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1053518687',id=20,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz9ElrhNZZvItqxGapQtmVbaKvJMnHtVQyBhczgKvaO8d/GBJ06KdbJMsPoiJPdFlj8W+R0Nu4rD1BhABN0XoGYod9pe9msGHytqCXlWqPOlmLX9S/AlygQdInxVYWU+Q==',key_name='tempest-keypair-1649114374',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:22:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6041024288a84808858ed4938f83fee5',ramdisk_id='',reservation_id='r-v4p52h60',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1076524669',owner_user_name='tempest-TaggedAttachmentsTest-1076524669-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a361c08c15664fbd880f06b487d62aa6',uuid=26cff7c2-b2a8-4a33-a2a0-3a63a2073d21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "797d5492-5f6c-4838-8957-0e25ae77c86d", "address": "fa:16:3e:f8:08:dc", "network": {"id": "e1b36d20-1610-4f57-b9e8-0d05b9422626", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-904919460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d5492-5f", "ovs_interfaceid": "797d5492-5f6c-4838-8957-0e25ae77c86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Converting VIF {"id": "797d5492-5f6c-4838-8957-0e25ae77c86d", "address": "fa:16:3e:f8:08:dc", "network": {"id": "e1b36d20-1610-4f57-b9e8-0d05b9422626", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-904919460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d5492-5f", "ovs_interfaceid": "797d5492-5f6c-4838-8957-0e25ae77c86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:08:dc,bridge_name='br-int',has_traffic_filtering=True,id=797d5492-5f6c-4838-8957-0e25ae77c86d,network=Network(e1b36d20-1610-4f57-b9e8-0d05b9422626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap797d5492-5f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f8:08:dc"/><model type="virtio"/><mtu size="1442"/><target dev="tap797d5492-5f"/></interface> {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f8:08:dc"/><model type="virtio"/><mtu size="1442"/><target dev="tap797d5492-5f"/></interface> {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Attempting to detach device tap797d5492-5f from instance 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] detach device xml: <interface type="ethernet">
Dec 05 12:25:15 user nova-compute[75071]:   <mac address="fa:16:3e:f8:08:dc"/>
Dec 05 12:25:15 user nova-compute[75071]:   <model type="virtio"/>
Dec 05 12:25:15 user nova-compute[75071]:   <mtu size="1442"/>
Dec 05 12:25:15 user nova-compute[75071]:   <target dev="tap797d5492-5f"/>
Dec 05 12:25:15 user nova-compute[75071]: </interface>
Dec 05 12:25:15 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f8:08:dc"/><model type="virtio"/><mtu size="1442"/><target dev="tap797d5492-5f"/></interface> {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f8:08:dc"/><model type="virtio"/><mtu size="1442"/><target dev="tap797d5492-5f"/></interface>not found in domain: <domain type='kvm' id='23'>
Dec 05 12:25:15 user nova-compute[75071]:   <name>instance-00000014</name>
Dec 05 12:25:15 user nova-compute[75071]:   <uuid>26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</uuid>
Dec 05 12:25:15 user nova-compute[75071]:   <metadata>
Dec 05 12:25:15 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:25:15 user nova-compute[75071]:   <nova:package version="0.0.0"/>
Dec 05 12:25:15 user nova-compute[75071]:   <nova:name>tempest-device-tagging-server-1053518687</nova:name>
Dec 05 12:25:15 user nova-compute[75071]:   <nova:creationTime>2023-12-05 12:24:38</nova:creationTime>
Dec 05 12:25:15 user nova-compute[75071]:   <nova:flavor name="m1.tiny">
Dec 05 12:25:15 user nova-compute[75071]:     <nova:memory>512</nova:memory>
Dec 05 12:25:15 user nova-compute[75071]:     <nova:disk>1</nova:disk>
Dec 05 12:25:15 user nova-compute[75071]:     <nova:swap>0</nova:swap>
Dec 05 12:25:15 user nova-compute[75071]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:25:15 user nova-compute[75071]:     <nova:vcpus>1</nova:vcpus>
Dec 05 12:25:15 user nova-compute[75071]:   </nova:flavor>
Dec 05 12:25:15 user nova-compute[75071]:   <nova:owner>
Dec 05 12:25:15 user nova-compute[75071]:     <nova:user uuid="a361c08c15664fbd880f06b487d62aa6">tempest-TaggedAttachmentsTest-1076524669-project-member</nova:user>
Dec 05 12:25:15 user nova-compute[75071]:     <nova:project uuid="6041024288a84808858ed4938f83fee5">tempest-TaggedAttachmentsTest-1076524669</nova:project>
Dec 05 12:25:15 user nova-compute[75071]:   </nova:owner>
Dec 05 12:25:15 user nova-compute[75071]:   <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:25:15 user nova-compute[75071]:   <nova:ports>
Dec 05 12:25:15 user nova-compute[75071]:     <nova:port uuid="1219420b-24a0-435b-aaa4-283c51d9a847">
Dec 05 12:25:15 user nova-compute[75071]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 12:25:15 user nova-compute[75071]:     </nova:port>
Dec 05 12:25:15 user nova-compute[75071]:     <nova:port uuid="797d5492-5f6c-4838-8957-0e25ae77c86d">
Dec 05 12:25:15 user nova-compute[75071]:       <nova:ip type="fixed" address="10.10.10.236" ipVersion="4"/>
Dec 05 12:25:15 user nova-compute[75071]:     </nova:port>
Dec 05 12:25:15 user nova-compute[75071]:   </nova:ports>
Dec 05 12:25:15 user nova-compute[75071]: </nova:instance>
Dec 05 12:25:15 user nova-compute[75071]:   </metadata>
Dec 05 12:25:15 user nova-compute[75071]:   <memory unit='KiB'>524288</memory>
Dec 05 12:25:15 user nova-compute[75071]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 05 12:25:15 user nova-compute[75071]:   <vcpu placement='static'>1</vcpu>
Dec 05 12:25:15 user nova-compute[75071]:   <resource>
Dec 05 12:25:15 user nova-compute[75071]:     <partition>/machine</partition>
Dec 05 12:25:15 user nova-compute[75071]:   </resource>
Dec 05 12:25:15 user nova-compute[75071]:   <sysinfo type='smbios'>
Dec 05 12:25:15 user nova-compute[75071]:     <system>
Dec 05 12:25:15 user nova-compute[75071]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 05 12:25:15 user nova-compute[75071]:       <entry name='product'>OpenStack Nova</entry>
Dec 05 12:25:15 user nova-compute[75071]:       <entry name='version'>0.0.0</entry>
Dec 05 12:25:15 user nova-compute[75071]:       <entry name='serial'>26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</entry>
Dec 05 12:25:15 user nova-compute[75071]:       <entry name='uuid'>26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</entry>
Dec 05 12:25:15 user nova-compute[75071]:       <entry name='family'>Virtual Machine</entry>
Dec 05 12:25:15 user nova-compute[75071]:     </system>
Dec 05 12:25:15 user nova-compute[75071]:   </sysinfo>
Dec 05 12:25:15 user nova-compute[75071]:   <os>
Dec 05 12:25:15 user nova-compute[75071]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 05 12:25:15 user nova-compute[75071]:     <boot dev='hd'/>
Dec 05 12:25:15 user nova-compute[75071]:     <smbios mode='sysinfo'/>
Dec 05 12:25:15 user nova-compute[75071]:   </os>
Dec 05 12:25:15 user nova-compute[75071]:   <features>
Dec 05 12:25:15 user nova-compute[75071]:     <acpi/>
Dec 05 12:25:15 user nova-compute[75071]:     <apic/>
Dec 05 12:25:15 user nova-compute[75071]:     <vmcoreinfo state='on'/>
Dec 05 12:25:15 user nova-compute[75071]:   </features>
Dec 05 12:25:15 user nova-compute[75071]:   <cpu mode='custom' match='exact' check='full'>
Dec 05 12:25:15 user nova-compute[75071]:     <model fallback='forbid'>Nehalem</model>
Dec 05 12:25:15 user nova-compute[75071]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 05 12:25:15 user nova-compute[75071]:     <feature policy='require' name='vme'/>
Dec 05 12:25:15 user nova-compute[75071]:     <feature policy='require' name='x2apic'/>
Dec 05 12:25:15 user nova-compute[75071]:     <feature policy='require' name='hypervisor'/>
Dec 05 12:25:15 user nova-compute[75071]:   </cpu>
Dec 05 12:25:15 user nova-compute[75071]:   <clock offset='utc'>
Dec 05 12:25:15 user nova-compute[75071]:     <timer name='pit' tickpolicy='delay'/>
Dec 05 12:25:15 user nova-compute[75071]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 05 12:25:15 user nova-compute[75071]:     <timer name='hpet' present='no'/>
Dec 05 12:25:15 user nova-compute[75071]:   </clock>
Dec 05 12:25:15 user nova-compute[75071]:   <on_poweroff>destroy</on_poweroff>
Dec 05 12:25:15 user nova-compute[75071]:   <on_reboot>restart</on_reboot>
Dec 05 12:25:15 user nova-compute[75071]:   <on_crash>destroy</on_crash>
Dec 05 12:25:15 user nova-compute[75071]:   <devices>
Dec 05 12:25:15 user nova-compute[75071]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 05 12:25:15 user nova-compute[75071]:     <disk type='file' device='disk'>
Dec 05 12:25:15 user nova-compute[75071]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 05 12:25:15 user nova-compute[75071]:       <source file='/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk' index='2'/>
Dec 05 12:25:15 user nova-compute[75071]:       <backingStore type='file' index='3'>
Dec 05 12:25:15 user nova-compute[75071]:         <format type='raw'/>
Dec 05 12:25:15 user nova-compute[75071]:         <source file='/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18'/>
Dec 05 12:25:15 user nova-compute[75071]:         <backingStore/>
Dec 05 12:25:15 user nova-compute[75071]:       </backingStore>
Dec 05 12:25:15 user nova-compute[75071]:       <target dev='vda' bus='virtio'/>
Dec 05 12:25:15 user nova-compute[75071]:       <alias name='virtio-disk0'/>
Dec 05 12:25:15 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 05 12:25:15 user nova-compute[75071]:     </disk>
Dec 05 12:25:15 user nova-compute[75071]:     <disk type='file' device='cdrom'>
Dec 05 12:25:15 user nova-compute[75071]:       <driver name='qemu' type='raw' cache='none'/>
Dec 05 12:25:15 user nova-compute[75071]:       <source file='/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk.config' index='1'/>
Dec 05 12:25:15 user nova-compute[75071]:       <backingStore/>
Dec 05 12:25:15 user nova-compute[75071]:       <target dev='hda' bus='ide'/>
Dec 05 12:25:15 user nova-compute[75071]:       <readonly/>
Dec 05 12:25:15 user nova-compute[75071]:       <alias name='ide0-0-0'/>
Dec 05 12:25:15 user nova-compute[75071]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 05 12:25:15 user nova-compute[75071]:     </disk>
Dec 05 12:25:15 user nova-compute[75071]:     <controller type='usb' index='0' model='none'>
Dec 05 12:25:15 user nova-compute[75071]:       <alias name='usb'/>
Dec 05 12:25:15 user nova-compute[75071]:     </controller>
Dec 05 12:25:15 user nova-compute[75071]:     <controller type='pci' index='0' model='pci-root'>
Dec 05 12:25:15 user nova-compute[75071]:       <alias name='pci.0'/>
Dec 05 12:25:15 user nova-compute[75071]:     </controller>
Dec 05 12:25:15 user nova-compute[75071]:     <controller type='ide' index='0'>
Dec 05 12:25:15 user nova-compute[75071]:       <alias name='ide'/>
Dec 05 12:25:15 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 05 12:25:15 user nova-compute[75071]:     </controller>
Dec 05 12:25:15 user nova-compute[75071]:     <interface type='ethernet'>
Dec 05 12:25:15 user nova-compute[75071]:       <mac address='fa:16:3e:f4:b1:b4'/>
Dec 05 12:25:15 user nova-compute[75071]:       <target dev='tap1219420b-24'/>
Dec 05 12:25:15 user nova-compute[75071]:       <model type='virtio'/>
Dec 05 12:25:15 user nova-compute[75071]:       <mtu size='1442'/>
Dec 05 12:25:15 user nova-compute[75071]:       <alias name='net0'/>
Dec 05 12:25:15 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 05 12:25:15 user nova-compute[75071]:     </interface>
Dec 05 12:25:15 user nova-compute[75071]:     <interface type='ethernet'>
Dec 05 12:25:15 user nova-compute[75071]:       <mac address='fa:16:3e:f8:08:dc'/>
Dec 05 12:25:15 user nova-compute[75071]:       <target dev='tap797d5492-5f'/>
Dec 05 12:25:15 user nova-compute[75071]:       <model type='virtio'/>
Dec 05 12:25:15 user nova-compute[75071]:       <mtu size='1442'/>
Dec 05 12:25:15 user nova-compute[75071]:       <alias name='net1'/>
Dec 05 12:25:15 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Dec 05 12:25:15 user nova-compute[75071]:     </interface>
Dec 05 12:25:15 user nova-compute[75071]:     <serial type='pty'>
Dec 05 12:25:15 user nova-compute[75071]:       <source path='/dev/pts/10'/>
Dec 05 12:25:15 user nova-compute[75071]:       <log file='/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/console.log' append='off'/>
Dec 05 12:25:15 user nova-compute[75071]:       <target type='isa-serial' port='0'>
Dec 05 12:25:15 user nova-compute[75071]:         <model name='isa-serial'/>
Dec 05 12:25:15 user nova-compute[75071]:       </target>
Dec 05 12:25:15 user nova-compute[75071]:       <alias name='serial0'/>
Dec 05 12:25:15 user nova-compute[75071]:     </serial>
Dec 05 12:25:15 user nova-compute[75071]:     <console type='pty' tty='/dev/pts/10'>
Dec 05 12:25:15 user nova-compute[75071]:       <source path='/dev/pts/10'/>
Dec 05 12:25:15 user nova-compute[75071]:       <log file='/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/console.log' append='off'/>
Dec 05 12:25:15 user nova-compute[75071]:       <target type='serial' port='0'/>
Dec 05 12:25:15 user nova-compute[75071]:       <alias name='serial0'/>
Dec 05 12:25:15 user nova-compute[75071]:     </console>
Dec 05 12:25:15 user nova-compute[75071]:     <input type='mouse' bus='ps2'>
Dec 05 12:25:15 user nova-compute[75071]:       <alias name='input0'/>
Dec 05 12:25:15 user nova-compute[75071]:     </input>
Dec 05 12:25:15 user nova-compute[75071]:     <input type='keyboard' bus='ps2'>
Dec 05 12:25:15 user nova-compute[75071]:       <alias name='input1'/>
Dec 05 12:25:15 user nova-compute[75071]:     </input>
Dec 05 12:25:15 user nova-compute[75071]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Dec 05 12:25:15 user nova-compute[75071]:       <listen type='address' address='0.0.0.0'/>
Dec 05 12:25:15 user nova-compute[75071]:     </graphics>
Dec 05 12:25:15 user nova-compute[75071]:     <audio id='1' type='none'/>
Dec 05 12:25:15 user nova-compute[75071]:     <video>
Dec 05 12:25:15 user nova-compute[75071]:       <model type='virtio' heads='1' primary='yes'/>
Dec 05 12:25:15 user nova-compute[75071]:       <alias name='video0'/>
Dec 05 12:25:15 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 05 12:25:15 user nova-compute[75071]:     </video>
Dec 05 12:25:15 user nova-compute[75071]:     <memballoon model='virtio'>
Dec 05 12:25:15 user nova-compute[75071]:       <stats period='10'/>
Dec 05 12:25:15 user nova-compute[75071]:       <alias name='balloon0'/>
Dec 05 12:25:15 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 05 12:25:15 user nova-compute[75071]:     </memballoon>
Dec 05 12:25:15 user nova-compute[75071]:     <rng model='virtio'>
Dec 05 12:25:15 user nova-compute[75071]:       <backend model='random'>/dev/urandom</backend>
Dec 05 12:25:15 user nova-compute[75071]:       <alias name='rng0'/>
Dec 05 12:25:15 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 05 12:25:15 user nova-compute[75071]:     </rng>
Dec 05 12:25:15 user nova-compute[75071]:   </devices>
Dec 05 12:25:15 user nova-compute[75071]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 05 12:25:15 user nova-compute[75071]:     <label>libvirt-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</label>
Dec 05 12:25:15 user nova-compute[75071]:     <imagelabel>libvirt-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</imagelabel>
Dec 05 12:25:15 user nova-compute[75071]:   </seclabel>
Dec 05 12:25:15 user nova-compute[75071]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 05 12:25:15 user nova-compute[75071]:     <label>+64055:+108</label>
Dec 05 12:25:15 user nova-compute[75071]:     <imagelabel>+64055:+108</imagelabel>
Dec 05 12:25:15 user nova-compute[75071]:   </seclabel>
Dec 05 12:25:15 user nova-compute[75071]: </domain>
Dec 05 12:25:15 user nova-compute[75071]:  {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 05 12:25:15 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Successfully detached device tap797d5492-5f from instance 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 from the persistent domain config.
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] (1/8): Attempting to detach device tap797d5492-5f with device alias net1 from instance 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] detach device xml: <interface type="ethernet">
Dec 05 12:25:15 user nova-compute[75071]:   <mac address="fa:16:3e:f8:08:dc"/>
Dec 05 12:25:15 user nova-compute[75071]:   <model type="virtio"/>
Dec 05 12:25:15 user nova-compute[75071]:   <mtu size="1442"/>
Dec 05 12:25:15 user nova-compute[75071]:   <target dev="tap797d5492-5f"/>
Dec 05 12:25:15 user nova-compute[75071]: </interface>
Dec 05 12:25:15 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.221s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk 1073741824" returned: 0 in 0.056s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Successfully created port: 5c0e15bb-4937-4f6a-8642-65fec78c2156 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.205s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Start waiting for the detach event from libvirt for device tap797d5492-5f with device alias net1 for instance 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:15 user nova-compute[75071]: INFO nova.compute.manager [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Shelving
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Cannot resize image /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Ensure instance console log exists: /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.compute.manager [req-749062c5-f2d5-4aa0-b365-1382c7ffd5ef req-f3d1a4a9-51df-4814-991c-0c149fd2e293 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received event network-vif-unplugged-797d5492-5f6c-4838-8957-0e25ae77c86d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-749062c5-f2d5-4aa0-b365-1382c7ffd5ef req-f3d1a4a9-51df-4814-991c-0c149fd2e293 service nova] Acquiring lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-749062c5-f2d5-4aa0-b365-1382c7ffd5ef req-f3d1a4a9-51df-4814-991c-0c149fd2e293 service nova] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-749062c5-f2d5-4aa0-b365-1382c7ffd5ef req-f3d1a4a9-51df-4814-991c-0c149fd2e293 service nova] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:15 user nova-compute[75071]: DEBUG nova.compute.manager [req-749062c5-f2d5-4aa0-b365-1382c7ffd5ef req-f3d1a4a9-51df-4814-991c-0c149fd2e293 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] No waiting events found dispatching network-vif-unplugged-797d5492-5f6c-4838-8957-0e25ae77c86d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:25:15 user nova-compute[75071]: WARNING nova.compute.manager [req-749062c5-f2d5-4aa0-b365-1382c7ffd5ef req-f3d1a4a9-51df-4814-991c-0c149fd2e293 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received unexpected event network-vif-unplugged-797d5492-5f6c-4838-8957-0e25ae77c86d for instance with vm_state active and task_state None.
Dec 05 12:25:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:16 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Instance destroyed successfully.
Dec 05 12:25:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-0dfcc8e6-5684-4374-aedb-08820a16cd35 req-e75e1e88-85f4-4136-9c8b-4b5a927a064b service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received event network-vif-unplugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0dfcc8e6-5684-4374-aedb-08820a16cd35 req-e75e1e88-85f4-4136-9c8b-4b5a927a064b service nova] Acquiring lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0dfcc8e6-5684-4374-aedb-08820a16cd35 req-e75e1e88-85f4-4136-9c8b-4b5a927a064b service nova] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0dfcc8e6-5684-4374-aedb-08820a16cd35 req-e75e1e88-85f4-4136-9c8b-4b5a927a064b service nova] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-0dfcc8e6-5684-4374-aedb-08820a16cd35 req-e75e1e88-85f4-4136-9c8b-4b5a927a064b service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] No waiting events found dispatching network-vif-unplugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:25:16 user nova-compute[75071]: WARNING nova.compute.manager [req-0dfcc8e6-5684-4374-aedb-08820a16cd35 req-e75e1e88-85f4-4136-9c8b-4b5a927a064b service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received unexpected event network-vif-unplugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b for instance with vm_state active and task_state shelving.
Dec 05 12:25:16 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Beginning cold snapshot process
Dec 05 12:25:16 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 62efa94c-ae01-48aa-b3d3-0d23d159801c is timed out.
Dec 05 12:25:16 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Successfully detached device vdb from instance 62efa94c-ae01-48aa-b3d3-0d23d159801c from the live domain config.
Dec 05 12:25:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hoTiarDB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:25:16 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:25:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e666b72a-9fd6-42f3-b399-c4c1c9767350]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:25:16 user nova-compute[75071]: No targets found.
Dec 05 12:25:16 user nova-compute[75071]: iSNS:
Dec 05 12:25:16 user nova-compute[75071]: No targets found.
Dec 05 12:25:16 user nova-compute[75071]: STATIC:
Dec 05 12:25:16 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:25:16 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:25:16 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:25:16 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be
Dec 05 12:25:16 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:25:16 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:25:16 user nova-compute[75071]: FIRMWARE:
Dec 05 12:25:16 user nova-compute[75071]: No targets found.
Dec 05 12:25:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:25:16 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:25:16 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7b0764-69cd-41f6-ad5d-2c805104cd68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbaf451-06b2-4799-a896-baa9d6caca27]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:25:16 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:25:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:25:16 user nova-compute[75071]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be (non-flash)
Dec 05 12:25:16 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f826412feb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a52b2c9-5c6b-428f-82b7-9a6354b58e03]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk /opt/stack/data/nova/instances/snapshots/tmpn4pg4px1/b93bd7e70cb64d0a91769ced4a658ec9 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[530b2fc0-a18c-41a1-941e-943b8357a7f2]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54bb44b-bd8e-408b-86e1-a0262c350a3d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:25:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b259a921-a93f-408a-83bc-4b15a6bc02c0]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Successfully updated port: 5c0e15bb-4937-4f6a-8642-65fec78c2156 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[85765e16-e120-4730-b521-b7f1b77f03ff]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "refresh_cache-a99a0331-1d77-4b71-9ef7-0794778b3ef1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquired lock "refresh_cache-a99a0331-1d77-4b71-9ef7-0794778b3ef1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b04750-ce2f-4cc9-9c5f-c477743ce645]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be, portal: 172.16.0.220,3260]
Dec 05 12:25:17 user nova-compute[75071]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be, portal: 172.16.0.220,3260] successful.
Dec 05 12:25:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc309cdc-014c-42c9-b515-3a094b0638be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe12f04-331c-4bbb-a599-7d6d66b85ab1]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] <== disconnect_volume: return (385ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Updating instance_info_cache with network_info: [{"id": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "address": "fa:16:3e:8e:c8:78", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0e15bb-49", "ovs_interfaceid": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Releasing lock "refresh_cache-a99a0331-1d77-4b71-9ef7-0794778b3ef1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Instance network_info: |[{"id": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "address": "fa:16:3e:8e:c8:78", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0e15bb-49", "ovs_interfaceid": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Start _get_guest_xml network_info=[{"id": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "address": "fa:16:3e:8e:c8:78", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0e15bb-49", "ovs_interfaceid": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:25:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:25:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:25:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-643004812',display_name='tempest-TestStampPattern-server-643004812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-643004812',id=25,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5oir8WHtqBRqryIYkB3I8UlaFk+dqU7IU6/ODmrxiWXhJiAujDIqqNL9Se9MN5Cfk4XMMDLRzpXzZGmiliVEnSL3Carc5WXCaALVz8WrwdnaIjjhGdD2iq63mJ07QOLA==',key_name='tempest-TestStampPattern-141813427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b30662558d734f36ac8edbe9532d0d8a',ramdisk_id='',reservation_id='r-tl3l904b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-979532490',owner_user_name='tempest-TestStampPattern-979532490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:25:15Z,user_data=None,user_id='809ec3faecd845e0ada2fc55ee6a8f39',uuid=a99a0331-1d77-4b71-9ef7-0794778b3ef1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "address": "fa:16:3e:8e:c8:78", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0e15bb-49", "ovs_interfaceid": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Converting VIF {"id": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "address": "fa:16:3e:8e:c8:78", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0e15bb-49", "ovs_interfaceid": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:c8:78,bridge_name='br-int',has_traffic_filtering=True,id=5c0e15bb-4937-4f6a-8642-65fec78c2156,network=Network(cbf3c2f9-f756-4283-b6d9-236fb2d2faed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c0e15bb-49') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lazy-loading 'pci_devices' on Instance uuid a99a0331-1d77-4b71-9ef7-0794778b3ef1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:25:17 user nova-compute[75071]:   <uuid>a99a0331-1d77-4b71-9ef7-0794778b3ef1</uuid>
Dec 05 12:25:17 user nova-compute[75071]:   <name>instance-00000019</name>
Dec 05 12:25:17 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:25:17 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:25:17 user nova-compute[75071]:   <metadata>
Dec 05 12:25:17 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:25:17 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:25:17 user nova-compute[75071]:       <nova:name>tempest-TestStampPattern-server-643004812</nova:name>
Dec 05 12:25:17 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:25:17</nova:creationTime>
Dec 05 12:25:17 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:25:17 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:25:17 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:25:17 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:25:17 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:25:17 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:25:17 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:25:17 user nova-compute[75071]:       <nova:owner>
Dec 05 12:25:17 user nova-compute[75071]:         <nova:user uuid="809ec3faecd845e0ada2fc55ee6a8f39">tempest-TestStampPattern-979532490-project-member</nova:user>
Dec 05 12:25:17 user nova-compute[75071]:         <nova:project uuid="b30662558d734f36ac8edbe9532d0d8a">tempest-TestStampPattern-979532490</nova:project>
Dec 05 12:25:17 user nova-compute[75071]:       </nova:owner>
Dec 05 12:25:17 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:25:17 user nova-compute[75071]:       <nova:ports>
Dec 05 12:25:17 user nova-compute[75071]:         <nova:port uuid="5c0e15bb-4937-4f6a-8642-65fec78c2156">
Dec 05 12:25:17 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 05 12:25:17 user nova-compute[75071]:         </nova:port>
Dec 05 12:25:17 user nova-compute[75071]:       </nova:ports>
Dec 05 12:25:17 user nova-compute[75071]:     </nova:instance>
Dec 05 12:25:17 user nova-compute[75071]:   </metadata>
Dec 05 12:25:17 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:25:17 user nova-compute[75071]:     <system>
Dec 05 12:25:17 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:25:17 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:25:17 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:25:17 user nova-compute[75071]:       <entry name="serial">a99a0331-1d77-4b71-9ef7-0794778b3ef1</entry>
Dec 05 12:25:17 user nova-compute[75071]:       <entry name="uuid">a99a0331-1d77-4b71-9ef7-0794778b3ef1</entry>
Dec 05 12:25:17 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:25:17 user nova-compute[75071]:     </system>
Dec 05 12:25:17 user nova-compute[75071]:   </sysinfo>
Dec 05 12:25:17 user nova-compute[75071]:   <os>
Dec 05 12:25:17 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:25:17 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:25:17 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:25:17 user nova-compute[75071]:   </os>
Dec 05 12:25:17 user nova-compute[75071]:   <features>
Dec 05 12:25:17 user nova-compute[75071]:     <acpi/>
Dec 05 12:25:17 user nova-compute[75071]:     <apic/>
Dec 05 12:25:17 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:25:17 user nova-compute[75071]:   </features>
Dec 05 12:25:17 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:25:17 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:25:17 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:25:17 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:25:17 user nova-compute[75071]:   </clock>
Dec 05 12:25:17 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:25:17 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:25:17 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:25:17 user nova-compute[75071]:   </cpu>
Dec 05 12:25:17 user nova-compute[75071]:   <devices>
Dec 05 12:25:17 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:25:17 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:25:17 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk"/>
Dec 05 12:25:17 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:25:17 user nova-compute[75071]:     </disk>
Dec 05 12:25:17 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:25:17 user nova-compute[75071]:       <mac address="fa:16:3e:8e:c8:78"/>
Dec 05 12:25:17 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:25:17 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:25:17 user nova-compute[75071]:       <target dev="tap5c0e15bb-49"/>
Dec 05 12:25:17 user nova-compute[75071]:     </interface>
Dec 05 12:25:17 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:25:17 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/console.log" append="off"/>
Dec 05 12:25:17 user nova-compute[75071]:     </serial>
Dec 05 12:25:17 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:25:17 user nova-compute[75071]:     <video>
Dec 05 12:25:17 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:25:17 user nova-compute[75071]:     </video>
Dec 05 12:25:17 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:25:17 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:25:17 user nova-compute[75071]:     </rng>
Dec 05 12:25:17 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:25:17 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:25:17 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:25:17 user nova-compute[75071]:     </memballoon>
Dec 05 12:25:17 user nova-compute[75071]:   </devices>
Dec 05 12:25:17 user nova-compute[75071]: </domain>
Dec 05 12:25:17 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:25:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-643004812',display_name='tempest-TestStampPattern-server-643004812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-643004812',id=25,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5oir8WHtqBRqryIYkB3I8UlaFk+dqU7IU6/ODmrxiWXhJiAujDIqqNL9Se9MN5Cfk4XMMDLRzpXzZGmiliVEnSL3Carc5WXCaALVz8WrwdnaIjjhGdD2iq63mJ07QOLA==',key_name='tempest-TestStampPattern-141813427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b30662558d734f36ac8edbe9532d0d8a',ramdisk_id='',reservation_id='r-tl3l904b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-979532490',owner_user_name='tempest-TestStampPattern-979532490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:25:15Z,user_data=None,user_id='809ec3faecd845e0ada2fc55ee6a8f39',uuid=a99a0331-1d77-4b71-9ef7-0794778b3ef1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "address": "fa:16:3e:8e:c8:78", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0e15bb-49", "ovs_interfaceid": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Converting VIF {"id": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "address": "fa:16:3e:8e:c8:78", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0e15bb-49", "ovs_interfaceid": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:c8:78,bridge_name='br-int',has_traffic_filtering=True,id=5c0e15bb-4937-4f6a-8642-65fec78c2156,network=Network(cbf3c2f9-f756-4283-b6d9-236fb2d2faed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c0e15bb-49') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG os_vif [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:c8:78,bridge_name='br-int',has_traffic_filtering=True,id=5c0e15bb-4937-4f6a-8642-65fec78c2156,network=Network(cbf3c2f9-f756-4283-b6d9-236fb2d2faed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c0e15bb-49') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48467114-75b7-5a5b-91b1-c48ce9e6b632', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c0e15bb-49, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c0e15bb-49, col_values=(('qos', UUID('2d27837f-1e2c-41c0-aa8a-698d135edad0')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c0e15bb-49, col_values=(('external_ids', {'iface-id': '5c0e15bb-4937-4f6a-8642-65fec78c2156', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:c8:78', 'vm-uuid': 'a99a0331-1d77-4b71-9ef7-0794778b3ef1'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:17 user nova-compute[75071]: INFO os_vif [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:c8:78,bridge_name='br-int',has_traffic_filtering=True,id=5c0e15bb-4937-4f6a-8642-65fec78c2156,network=Network(cbf3c2f9-f756-4283-b6d9-236fb2d2faed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c0e15bb-49')
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] No VIF found with MAC fa:16:3e:8e:c8:78, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:25:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk /opt/stack/data/nova/instances/snapshots/tmpn4pg4px1/b93bd7e70cb64d0a91769ced4a658ec9" returned: 0 in 0.945s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:17 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Snapshot extracted, beginning image upload
Dec 05 12:25:18 user nova-compute[75071]: DEBUG nova.objects.instance [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lazy-loading 'flavor' on Instance uuid 62efa94c-ae01-48aa-b3d3-0d23d159801c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:25:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-6802012c-080c-4cac-9da1-1ee32ca294d6 req-fd454abe-fb4f-434e-b623-62fafec73f61 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received event network-vif-plugged-797d5492-5f6c-4838-8957-0e25ae77c86d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:25:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6802012c-080c-4cac-9da1-1ee32ca294d6 req-fd454abe-fb4f-434e-b623-62fafec73f61 service nova] Acquiring lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6802012c-080c-4cac-9da1-1ee32ca294d6 req-fd454abe-fb4f-434e-b623-62fafec73f61 service nova] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6802012c-080c-4cac-9da1-1ee32ca294d6 req-fd454abe-fb4f-434e-b623-62fafec73f61 service nova] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-6802012c-080c-4cac-9da1-1ee32ca294d6 req-fd454abe-fb4f-434e-b623-62fafec73f61 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] No waiting events found dispatching network-vif-plugged-797d5492-5f6c-4838-8957-0e25ae77c86d {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:25:18 user nova-compute[75071]: WARNING nova.compute.manager [req-6802012c-080c-4cac-9da1-1ee32ca294d6 req-fd454abe-fb4f-434e-b623-62fafec73f61 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received unexpected event network-vif-plugged-797d5492-5f6c-4838-8957-0e25ae77c86d for instance with vm_state active and task_state None.
Dec 05 12:25:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e69ceecd-d2c8-4ea9-869c-b98b3a603ea9 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.906s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-4d390f02-c3ea-4bfc-9ec9-0b4047e3c6af req-ea01f53d-6783-4d1b-ae7e-953c7d086066 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received event network-vif-plugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:25:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4d390f02-c3ea-4bfc-9ec9-0b4047e3c6af req-ea01f53d-6783-4d1b-ae7e-953c7d086066 service nova] Acquiring lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4d390f02-c3ea-4bfc-9ec9-0b4047e3c6af req-ea01f53d-6783-4d1b-ae7e-953c7d086066 service nova] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4d390f02-c3ea-4bfc-9ec9-0b4047e3c6af req-ea01f53d-6783-4d1b-ae7e-953c7d086066 service nova] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-4d390f02-c3ea-4bfc-9ec9-0b4047e3c6af req-ea01f53d-6783-4d1b-ae7e-953c7d086066 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] No waiting events found dispatching network-vif-plugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:25:18 user nova-compute[75071]: WARNING nova.compute.manager [req-4d390f02-c3ea-4bfc-9ec9-0b4047e3c6af req-ea01f53d-6783-4d1b-ae7e-953c7d086066 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received unexpected event network-vif-plugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b for instance with vm_state active and task_state shelving_image_uploading.
Dec 05 12:25:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-4d390f02-c3ea-4bfc-9ec9-0b4047e3c6af req-ea01f53d-6783-4d1b-ae7e-953c7d086066 service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Received event network-changed-5c0e15bb-4937-4f6a-8642-65fec78c2156 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:25:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-4d390f02-c3ea-4bfc-9ec9-0b4047e3c6af req-ea01f53d-6783-4d1b-ae7e-953c7d086066 service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Refreshing instance network info cache due to event network-changed-5c0e15bb-4937-4f6a-8642-65fec78c2156. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:25:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4d390f02-c3ea-4bfc-9ec9-0b4047e3c6af req-ea01f53d-6783-4d1b-ae7e-953c7d086066 service nova] Acquiring lock "refresh_cache-a99a0331-1d77-4b71-9ef7-0794778b3ef1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:25:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4d390f02-c3ea-4bfc-9ec9-0b4047e3c6af req-ea01f53d-6783-4d1b-ae7e-953c7d086066 service nova] Acquired lock "refresh_cache-a99a0331-1d77-4b71-9ef7-0794778b3ef1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:25:18 user nova-compute[75071]: DEBUG nova.network.neutron [req-4d390f02-c3ea-4bfc-9ec9-0b4047e3c6af req-ea01f53d-6783-4d1b-ae7e-953c7d086066 service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Refreshing network info cache for port 5c0e15bb-4937-4f6a-8642-65fec78c2156 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:25:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:19 user nova-compute[75071]: DEBUG nova.network.neutron [req-4d390f02-c3ea-4bfc-9ec9-0b4047e3c6af req-ea01f53d-6783-4d1b-ae7e-953c7d086066 service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Updated VIF entry in instance network info cache for port 5c0e15bb-4937-4f6a-8642-65fec78c2156. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:25:19 user nova-compute[75071]: DEBUG nova.network.neutron [req-4d390f02-c3ea-4bfc-9ec9-0b4047e3c6af req-ea01f53d-6783-4d1b-ae7e-953c7d086066 service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Updating instance_info_cache with network_info: [{"id": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "address": "fa:16:3e:8e:c8:78", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0e15bb-49", "ovs_interfaceid": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:25:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4d390f02-c3ea-4bfc-9ec9-0b4047e3c6af req-ea01f53d-6783-4d1b-ae7e-953c7d086066 service nova] Releasing lock "refresh_cache-a99a0331-1d77-4b71-9ef7-0794778b3ef1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:25:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-2b7efd86-2862-4efd-b8e8-c955de2d8783 req-677ea5ca-4f03-43d9-a2a4-a177c9dc4cf2 service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Received event network-vif-plugged-5c0e15bb-4937-4f6a-8642-65fec78c2156 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:25:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2b7efd86-2862-4efd-b8e8-c955de2d8783 req-677ea5ca-4f03-43d9-a2a4-a177c9dc4cf2 service nova] Acquiring lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2b7efd86-2862-4efd-b8e8-c955de2d8783 req-677ea5ca-4f03-43d9-a2a4-a177c9dc4cf2 service nova] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2b7efd86-2862-4efd-b8e8-c955de2d8783 req-677ea5ca-4f03-43d9-a2a4-a177c9dc4cf2 service nova] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-2b7efd86-2862-4efd-b8e8-c955de2d8783 req-677ea5ca-4f03-43d9-a2a4-a177c9dc4cf2 service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] No waiting events found dispatching network-vif-plugged-5c0e15bb-4937-4f6a-8642-65fec78c2156 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:25:19 user nova-compute[75071]: WARNING nova.compute.manager [req-2b7efd86-2862-4efd-b8e8-c955de2d8783 req-677ea5ca-4f03-43d9-a2a4-a177c9dc4cf2 service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Received unexpected event network-vif-plugged-5c0e15bb-4937-4f6a-8642-65fec78c2156 for instance with vm_state building and task_state spawning.
Dec 05 12:25:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:21 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Snapshot image upload complete
Dec 05 12:25:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:25:21 user nova-compute[75071]: INFO nova.compute.manager [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Shelve offloading
Dec 05 12:25:21 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Instance destroyed successfully.
Dec 05 12:25:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:25:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:25:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquired lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:25:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:25:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Updating instance_info_cache with network_info: [{"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:25:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Releasing lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:25:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-75ed5577-e624-4a89-a32e-24471a81d3fa req-04b13bc2-2770-4cbc-9769-142021aeb17c service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Received event network-vif-plugged-5c0e15bb-4937-4f6a-8642-65fec78c2156 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:25:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-75ed5577-e624-4a89-a32e-24471a81d3fa req-04b13bc2-2770-4cbc-9769-142021aeb17c service nova] Acquiring lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-75ed5577-e624-4a89-a32e-24471a81d3fa req-04b13bc2-2770-4cbc-9769-142021aeb17c service nova] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-75ed5577-e624-4a89-a32e-24471a81d3fa req-04b13bc2-2770-4cbc-9769-142021aeb17c service nova] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-75ed5577-e624-4a89-a32e-24471a81d3fa req-04b13bc2-2770-4cbc-9769-142021aeb17c service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] No waiting events found dispatching network-vif-plugged-5c0e15bb-4937-4f6a-8642-65fec78c2156 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:25:21 user nova-compute[75071]: WARNING nova.compute.manager [req-75ed5577-e624-4a89-a32e-24471a81d3fa req-04b13bc2-2770-4cbc-9769-142021aeb17c service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Received unexpected event network-vif-plugged-5c0e15bb-4937-4f6a-8642-65fec78c2156 for instance with vm_state building and task_state spawning.
Dec 05 12:25:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:25:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:25:21 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Instance spawned successfully.
Dec 05 12:25:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:25:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:25:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:25:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:25:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:25:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:25:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:25:21 user nova-compute[75071]: INFO nova.compute.manager [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Took 6.77 seconds to spawn the instance on the hypervisor.
Dec 05 12:25:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:25:21 user nova-compute[75071]: INFO nova.compute.manager [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Took 7.68 seconds to build instance.
Dec 05 12:25:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1a5191f7-9906-42ca-a2a4-35febb28acd4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.817s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Instance destroyed successfully.
Dec 05 12:25:22 user nova-compute[75071]: DEBUG nova.objects.instance [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'resources' on Instance uuid cad9a071-e232-4629-a3cc-9cb9d3fe9333 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-6013421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-6013421',id=21,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4ojfp9xi4tIHEe5RUJWGaicVoCqfOcH9OAOng/6HjRCsqOv8KiR+xZvXDUbR4ocmbrJ48luSYFcwek/7Ldu8YJzwjPZxeE+cTAt0k9n2mCG+3kSNO0REXWDGwoZVYSrA==',key_name='tempest-keypair-399432094',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:23:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='36cda9a88b434e66ad6d8ac75790d141',ramdisk_id='',reservation_id='r-xmrtzxbg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1822750901',owner_user_name='tempest-AttachVolumeShelveTestJSON-1822750901-project-member',shelved_at='2023-12-05T12:25:21.025990',shelved_host='user',shelved_image_id='77a7b7cc-5988-456d-8643-d255f10239e6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:25:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a70218d8181040818ed8290e743bd2db',uuid=cad9a071-e232-4629-a3cc-9cb9d3fe9333,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converting VIF {"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:89,bridge_name='br-int',has_traffic_filtering=True,id=a8db5130-7bc3-414c-b8bf-469e4fa0eb7b,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db5130-7b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG os_vif [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:89,bridge_name='br-int',has_traffic_filtering=True,id=a8db5130-7bc3-414c-b8bf-469e4fa0eb7b,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db5130-7b') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8db5130-7b, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eff389ca-3ac4-412c-ac70-8bc8a2175be0) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-801e131d-2bf8-471c-98ba-6cd81b3cfbde req-ae4da035-df0f-4cb8-af35-8783dbac0872 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received event network-changed-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-801e131d-2bf8-471c-98ba-6cd81b3cfbde req-ae4da035-df0f-4cb8-af35-8783dbac0872 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Refreshing instance network info cache due to event network-changed-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-801e131d-2bf8-471c-98ba-6cd81b3cfbde req-ae4da035-df0f-4cb8-af35-8783dbac0872 service nova] Acquiring lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-801e131d-2bf8-471c-98ba-6cd81b3cfbde req-ae4da035-df0f-4cb8-af35-8783dbac0872 service nova] Acquired lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG nova.network.neutron [req-801e131d-2bf8-471c-98ba-6cd81b3cfbde req-ae4da035-df0f-4cb8-af35-8783dbac0872 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Refreshing network info cache for port a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:22 user nova-compute[75071]: INFO os_vif [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:89,bridge_name='br-int',has_traffic_filtering=True,id=a8db5130-7bc3-414c-b8bf-469e4fa0eb7b,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db5130-7b')
Dec 05 12:25:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Deleting instance files /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333_del
Dec 05 12:25:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Deletion of /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333_del complete
Dec 05 12:25:22 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Deleted allocations for instance cad9a071-e232-4629-a3cc-9cb9d3fe9333
Dec 05 12:25:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG nova.objects.instance [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'numa_topology' on Instance uuid cad9a071-e232-4629-a3cc-9cb9d3fe9333 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG nova.objects.base [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Object Instance<cad9a071-e232-4629-a3cc-9cb9d3fe9333> lazy-loaded attributes: resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG nova.network.neutron [req-801e131d-2bf8-471c-98ba-6cd81b3cfbde req-ae4da035-df0f-4cb8-af35-8783dbac0872 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Updated VIF entry in instance network info cache for port a8db5130-7bc3-414c-b8bf-469e4fa0eb7b. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG nova.network.neutron [req-801e131d-2bf8-471c-98ba-6cd81b3cfbde req-ae4da035-df0f-4cb8-af35-8783dbac0872 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Updating instance_info_cache with network_info: [{"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa8db5130-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-801e131d-2bf8-471c-98ba-6cd81b3cfbde req-ae4da035-df0f-4cb8-af35-8783dbac0872 service nova] Releasing lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-64124d14-60a3-42fd-9674-c3ce3e902494 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.862s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:35 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Waiting for libvirt event about the detach of device tap797d5492-5f with device alias net1 from instance 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 is timed out.
Dec 05 12:25:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f8:08:dc"/><model type="virtio"/><mtu size="1442"/><target dev="tap797d5492-5f"/></interface> {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 05 12:25:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f8:08:dc"/><model type="virtio"/><mtu size="1442"/><target dev="tap797d5492-5f"/></interface>not found in domain: <domain type='kvm' id='23'>
Dec 05 12:25:35 user nova-compute[75071]:   <name>instance-00000014</name>
Dec 05 12:25:35 user nova-compute[75071]:   <uuid>26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</uuid>
Dec 05 12:25:35 user nova-compute[75071]:   <metadata>
Dec 05 12:25:35 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:25:35 user nova-compute[75071]:   <nova:package version="0.0.0"/>
Dec 05 12:25:35 user nova-compute[75071]:   <nova:name>tempest-device-tagging-server-1053518687</nova:name>
Dec 05 12:25:35 user nova-compute[75071]:   <nova:creationTime>2023-12-05 12:24:38</nova:creationTime>
Dec 05 12:25:35 user nova-compute[75071]:   <nova:flavor name="m1.tiny">
Dec 05 12:25:35 user nova-compute[75071]:     <nova:memory>512</nova:memory>
Dec 05 12:25:35 user nova-compute[75071]:     <nova:disk>1</nova:disk>
Dec 05 12:25:35 user nova-compute[75071]:     <nova:swap>0</nova:swap>
Dec 05 12:25:35 user nova-compute[75071]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:25:35 user nova-compute[75071]:     <nova:vcpus>1</nova:vcpus>
Dec 05 12:25:35 user nova-compute[75071]:   </nova:flavor>
Dec 05 12:25:35 user nova-compute[75071]:   <nova:owner>
Dec 05 12:25:35 user nova-compute[75071]:     <nova:user uuid="a361c08c15664fbd880f06b487d62aa6">tempest-TaggedAttachmentsTest-1076524669-project-member</nova:user>
Dec 05 12:25:35 user nova-compute[75071]:     <nova:project uuid="6041024288a84808858ed4938f83fee5">tempest-TaggedAttachmentsTest-1076524669</nova:project>
Dec 05 12:25:35 user nova-compute[75071]:   </nova:owner>
Dec 05 12:25:35 user nova-compute[75071]:   <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:25:35 user nova-compute[75071]:   <nova:ports>
Dec 05 12:25:35 user nova-compute[75071]:     <nova:port uuid="1219420b-24a0-435b-aaa4-283c51d9a847">
Dec 05 12:25:35 user nova-compute[75071]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 12:25:35 user nova-compute[75071]:     </nova:port>
Dec 05 12:25:35 user nova-compute[75071]:     <nova:port uuid="797d5492-5f6c-4838-8957-0e25ae77c86d">
Dec 05 12:25:35 user nova-compute[75071]:       <nova:ip type="fixed" address="10.10.10.236" ipVersion="4"/>
Dec 05 12:25:35 user nova-compute[75071]:     </nova:port>
Dec 05 12:25:35 user nova-compute[75071]:   </nova:ports>
Dec 05 12:25:35 user nova-compute[75071]: </nova:instance>
Dec 05 12:25:35 user nova-compute[75071]:   </metadata>
Dec 05 12:25:35 user nova-compute[75071]:   <memory unit='KiB'>524288</memory>
Dec 05 12:25:35 user nova-compute[75071]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 05 12:25:35 user nova-compute[75071]:   <vcpu placement='static'>1</vcpu>
Dec 05 12:25:35 user nova-compute[75071]:   <resource>
Dec 05 12:25:35 user nova-compute[75071]:     <partition>/machine</partition>
Dec 05 12:25:35 user nova-compute[75071]:   </resource>
Dec 05 12:25:35 user nova-compute[75071]:   <sysinfo type='smbios'>
Dec 05 12:25:35 user nova-compute[75071]:     <system>
Dec 05 12:25:35 user nova-compute[75071]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 05 12:25:35 user nova-compute[75071]:       <entry name='product'>OpenStack Nova</entry>
Dec 05 12:25:35 user nova-compute[75071]:       <entry name='version'>0.0.0</entry>
Dec 05 12:25:35 user nova-compute[75071]:       <entry name='serial'>26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</entry>
Dec 05 12:25:35 user nova-compute[75071]:       <entry name='uuid'>26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</entry>
Dec 05 12:25:35 user nova-compute[75071]:       <entry name='family'>Virtual Machine</entry>
Dec 05 12:25:35 user nova-compute[75071]:     </system>
Dec 05 12:25:35 user nova-compute[75071]:   </sysinfo>
Dec 05 12:25:35 user nova-compute[75071]:   <os>
Dec 05 12:25:35 user nova-compute[75071]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 05 12:25:35 user nova-compute[75071]:     <boot dev='hd'/>
Dec 05 12:25:35 user nova-compute[75071]:     <smbios mode='sysinfo'/>
Dec 05 12:25:35 user nova-compute[75071]:   </os>
Dec 05 12:25:35 user nova-compute[75071]:   <features>
Dec 05 12:25:35 user nova-compute[75071]:     <acpi/>
Dec 05 12:25:35 user nova-compute[75071]:     <apic/>
Dec 05 12:25:35 user nova-compute[75071]:     <vmcoreinfo state='on'/>
Dec 05 12:25:35 user nova-compute[75071]:   </features>
Dec 05 12:25:35 user nova-compute[75071]:   <cpu mode='custom' match='exact' check='full'>
Dec 05 12:25:35 user nova-compute[75071]:     <model fallback='forbid'>Nehalem</model>
Dec 05 12:25:35 user nova-compute[75071]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 05 12:25:35 user nova-compute[75071]:     <feature policy='require' name='vme'/>
Dec 05 12:25:35 user nova-compute[75071]:     <feature policy='require' name='x2apic'/>
Dec 05 12:25:35 user nova-compute[75071]:     <feature policy='require' name='hypervisor'/>
Dec 05 12:25:35 user nova-compute[75071]:   </cpu>
Dec 05 12:25:35 user nova-compute[75071]:   <clock offset='utc'>
Dec 05 12:25:35 user nova-compute[75071]:     <timer name='pit' tickpolicy='delay'/>
Dec 05 12:25:35 user nova-compute[75071]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 05 12:25:35 user nova-compute[75071]:     <timer name='hpet' present='no'/>
Dec 05 12:25:35 user nova-compute[75071]:   </clock>
Dec 05 12:25:35 user nova-compute[75071]:   <on_poweroff>destroy</on_poweroff>
Dec 05 12:25:35 user nova-compute[75071]:   <on_reboot>restart</on_reboot>
Dec 05 12:25:35 user nova-compute[75071]:   <on_crash>destroy</on_crash>
Dec 05 12:25:35 user nova-compute[75071]:   <devices>
Dec 05 12:25:35 user nova-compute[75071]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 05 12:25:35 user nova-compute[75071]:     <disk type='file' device='disk'>
Dec 05 12:25:35 user nova-compute[75071]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 05 12:25:35 user nova-compute[75071]:       <source file='/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk' index='2'/>
Dec 05 12:25:35 user nova-compute[75071]:       <backingStore type='file' index='3'>
Dec 05 12:25:35 user nova-compute[75071]:         <format type='raw'/>
Dec 05 12:25:35 user nova-compute[75071]:         <source file='/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18'/>
Dec 05 12:25:35 user nova-compute[75071]:         <backingStore/>
Dec 05 12:25:35 user nova-compute[75071]:       </backingStore>
Dec 05 12:25:35 user nova-compute[75071]:       <target dev='vda' bus='virtio'/>
Dec 05 12:25:35 user nova-compute[75071]:       <alias name='virtio-disk0'/>
Dec 05 12:25:35 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 05 12:25:35 user nova-compute[75071]:     </disk>
Dec 05 12:25:35 user nova-compute[75071]:     <disk type='file' device='cdrom'>
Dec 05 12:25:35 user nova-compute[75071]:       <driver name='qemu' type='raw' cache='none'/>
Dec 05 12:25:35 user nova-compute[75071]:       <source file='/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk.config' index='1'/>
Dec 05 12:25:35 user nova-compute[75071]:       <backingStore/>
Dec 05 12:25:35 user nova-compute[75071]:       <target dev='hda' bus='ide'/>
Dec 05 12:25:35 user nova-compute[75071]:       <readonly/>
Dec 05 12:25:35 user nova-compute[75071]:       <alias name='ide0-0-0'/>
Dec 05 12:25:35 user nova-compute[75071]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 05 12:25:35 user nova-compute[75071]:     </disk>
Dec 05 12:25:35 user nova-compute[75071]:     <controller type='usb' index='0' model='none'>
Dec 05 12:25:35 user nova-compute[75071]:       <alias name='usb'/>
Dec 05 12:25:35 user nova-compute[75071]:     </controller>
Dec 05 12:25:35 user nova-compute[75071]:     <controller type='pci' index='0' model='pci-root'>
Dec 05 12:25:35 user nova-compute[75071]:       <alias name='pci.0'/>
Dec 05 12:25:35 user nova-compute[75071]:     </controller>
Dec 05 12:25:35 user nova-compute[75071]:     <controller type='ide' index='0'>
Dec 05 12:25:35 user nova-compute[75071]:       <alias name='ide'/>
Dec 05 12:25:35 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 05 12:25:35 user nova-compute[75071]:     </controller>
Dec 05 12:25:35 user nova-compute[75071]:     <interface type='ethernet'>
Dec 05 12:25:35 user nova-compute[75071]:       <mac address='fa:16:3e:f4:b1:b4'/>
Dec 05 12:25:35 user nova-compute[75071]:       <target dev='tap1219420b-24'/>
Dec 05 12:25:35 user nova-compute[75071]:       <model type='virtio'/>
Dec 05 12:25:35 user nova-compute[75071]:       <mtu size='1442'/>
Dec 05 12:25:35 user nova-compute[75071]:       <alias name='net0'/>
Dec 05 12:25:35 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 05 12:25:35 user nova-compute[75071]:     </interface>
Dec 05 12:25:35 user nova-compute[75071]:     <serial type='pty'>
Dec 05 12:25:35 user nova-compute[75071]:       <source path='/dev/pts/10'/>
Dec 05 12:25:35 user nova-compute[75071]:       <log file='/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/console.log' append='off'/>
Dec 05 12:25:35 user nova-compute[75071]:       <target type='isa-serial' port='0'>
Dec 05 12:25:35 user nova-compute[75071]:         <model name='isa-serial'/>
Dec 05 12:25:35 user nova-compute[75071]:       </target>
Dec 05 12:25:35 user nova-compute[75071]:       <alias name='serial0'/>
Dec 05 12:25:35 user nova-compute[75071]:     </serial>
Dec 05 12:25:35 user nova-compute[75071]:     <console type='pty' tty='/dev/pts/10'>
Dec 05 12:25:35 user nova-compute[75071]:       <source path='/dev/pts/10'/>
Dec 05 12:25:35 user nova-compute[75071]:       <log file='/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/console.log' append='off'/>
Dec 05 12:25:35 user nova-compute[75071]:       <target type='serial' port='0'/>
Dec 05 12:25:35 user nova-compute[75071]:       <alias name='serial0'/>
Dec 05 12:25:35 user nova-compute[75071]:     </console>
Dec 05 12:25:35 user nova-compute[75071]:     <input type='mouse' bus='ps2'>
Dec 05 12:25:35 user nova-compute[75071]:       <alias name='input0'/>
Dec 05 12:25:35 user nova-compute[75071]:     </input>
Dec 05 12:25:35 user nova-compute[75071]:     <input type='keyboard' bus='ps2'>
Dec 05 12:25:35 user nova-compute[75071]:       <alias name='input1'/>
Dec 05 12:25:35 user nova-compute[75071]:     </input>
Dec 05 12:25:35 user nova-compute[75071]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Dec 05 12:25:35 user nova-compute[75071]:       <listen type='address' address='0.0.0.0'/>
Dec 05 12:25:35 user nova-compute[75071]:     </graphics>
Dec 05 12:25:35 user nova-compute[75071]:     <audio id='1' type='none'/>
Dec 05 12:25:35 user nova-compute[75071]:     <video>
Dec 05 12:25:35 user nova-compute[75071]:       <model type='virtio' heads='1' primary='yes'/>
Dec 05 12:25:35 user nova-compute[75071]:       <alias name='video0'/>
Dec 05 12:25:35 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 05 12:25:35 user nova-compute[75071]:     </video>
Dec 05 12:25:35 user nova-compute[75071]:     <memballoon model='virtio'>
Dec 05 12:25:35 user nova-compute[75071]:       <stats period='10'/>
Dec 05 12:25:35 user nova-compute[75071]:       <alias name='balloon0'/>
Dec 05 12:25:35 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 05 12:25:35 user nova-compute[75071]:     </memballoon>
Dec 05 12:25:35 user nova-compute[75071]:     <rng model='virtio'>
Dec 05 12:25:35 user nova-compute[75071]:       <backend model='random'>/dev/urandom</backend>
Dec 05 12:25:35 user nova-compute[75071]:       <alias name='rng0'/>
Dec 05 12:25:35 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 05 12:25:35 user nova-compute[75071]:     </rng>
Dec 05 12:25:35 user nova-compute[75071]:   </devices>
Dec 05 12:25:35 user nova-compute[75071]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 05 12:25:35 user nova-compute[75071]:     <label>libvirt-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</label>
Dec 05 12:25:35 user nova-compute[75071]:     <imagelabel>libvirt-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</imagelabel>
Dec 05 12:25:35 user nova-compute[75071]:   </seclabel>
Dec 05 12:25:35 user nova-compute[75071]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 05 12:25:35 user nova-compute[75071]:     <label>+64055:+108</label>
Dec 05 12:25:35 user nova-compute[75071]:     <imagelabel>+64055:+108</imagelabel>
Dec 05 12:25:35 user nova-compute[75071]:   </seclabel>
Dec 05 12:25:35 user nova-compute[75071]: </domain>
Dec 05 12:25:35 user nova-compute[75071]:  {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 05 12:25:35 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Successfully detached device tap797d5492-5f from instance 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 from the live domain config.
Dec 05 12:25:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1053518687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1053518687',id=20,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz9ElrhNZZvItqxGapQtmVbaKvJMnHtVQyBhczgKvaO8d/GBJ06KdbJMsPoiJPdFlj8W+R0Nu4rD1BhABN0XoGYod9pe9msGHytqCXlWqPOlmLX9S/AlygQdInxVYWU+Q==',key_name='tempest-keypair-1649114374',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:22:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6041024288a84808858ed4938f83fee5',ramdisk_id='',reservation_id='r-v4p52h60',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1076524669',owner_user_name='tempest-TaggedAttachmentsTest-1076524669-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a361c08c15664fbd880f06b487d62aa6',uuid=26cff7c2-b2a8-4a33-a2a0-3a63a2073d21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "797d5492-5f6c-4838-8957-0e25ae77c86d", "address": "fa:16:3e:f8:08:dc", "network": {"id": "e1b36d20-1610-4f57-b9e8-0d05b9422626", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-904919460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d5492-5f", "ovs_interfaceid": "797d5492-5f6c-4838-8957-0e25ae77c86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:25:35 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Converting VIF {"id": "797d5492-5f6c-4838-8957-0e25ae77c86d", "address": "fa:16:3e:f8:08:dc", "network": {"id": "e1b36d20-1610-4f57-b9e8-0d05b9422626", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-904919460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d5492-5f", "ovs_interfaceid": "797d5492-5f6c-4838-8957-0e25ae77c86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:25:35 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:08:dc,bridge_name='br-int',has_traffic_filtering=True,id=797d5492-5f6c-4838-8957-0e25ae77c86d,network=Network(e1b36d20-1610-4f57-b9e8-0d05b9422626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap797d5492-5f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:25:35 user nova-compute[75071]: DEBUG os_vif [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:08:dc,bridge_name='br-int',has_traffic_filtering=True,id=797d5492-5f6c-4838-8957-0e25ae77c86d,network=Network(e1b36d20-1610-4f57-b9e8-0d05b9422626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap797d5492-5f') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:25:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap797d5492-5f, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:25:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:25:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28cf0491-0fbe-4a85-b5e7-73fdc5302ec8) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:25:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:35 user nova-compute[75071]: INFO os_vif [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:08:dc,bridge_name='br-int',has_traffic_filtering=True,id=797d5492-5f6c-4838-8957-0e25ae77c86d,network=Network(e1b36d20-1610-4f57-b9e8-0d05b9422626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap797d5492-5f')
Dec 05 12:25:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:25:35 user nova-compute[75071]:   <nova:package version="0.0.0"/>
Dec 05 12:25:35 user nova-compute[75071]:   <nova:name>tempest-device-tagging-server-1053518687</nova:name>
Dec 05 12:25:35 user nova-compute[75071]:   <nova:creationTime>2023-12-05 12:25:35</nova:creationTime>
Dec 05 12:25:35 user nova-compute[75071]:   <nova:flavor name="m1.tiny">
Dec 05 12:25:35 user nova-compute[75071]:     <nova:memory>512</nova:memory>
Dec 05 12:25:35 user nova-compute[75071]:     <nova:disk>1</nova:disk>
Dec 05 12:25:35 user nova-compute[75071]:     <nova:swap>0</nova:swap>
Dec 05 12:25:35 user nova-compute[75071]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:25:35 user nova-compute[75071]:     <nova:vcpus>1</nova:vcpus>
Dec 05 12:25:35 user nova-compute[75071]:   </nova:flavor>
Dec 05 12:25:35 user nova-compute[75071]:   <nova:owner>
Dec 05 12:25:35 user nova-compute[75071]:     <nova:user uuid="a361c08c15664fbd880f06b487d62aa6">tempest-TaggedAttachmentsTest-1076524669-project-member</nova:user>
Dec 05 12:25:35 user nova-compute[75071]:     <nova:project uuid="6041024288a84808858ed4938f83fee5">tempest-TaggedAttachmentsTest-1076524669</nova:project>
Dec 05 12:25:35 user nova-compute[75071]:   </nova:owner>
Dec 05 12:25:35 user nova-compute[75071]:   <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:25:35 user nova-compute[75071]:   <nova:ports>
Dec 05 12:25:35 user nova-compute[75071]:     <nova:port uuid="1219420b-24a0-435b-aaa4-283c51d9a847">
Dec 05 12:25:35 user nova-compute[75071]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 12:25:35 user nova-compute[75071]:     </nova:port>
Dec 05 12:25:35 user nova-compute[75071]:   </nova:ports>
Dec 05 12:25:35 user nova-compute[75071]: </nova:instance>
Dec 05 12:25:35 user nova-compute[75071]:  {{(pid=75071) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received event network-vif-deleted-797d5492-5f6c-4838-8957-0e25ae77c86d {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:25:36 user nova-compute[75071]: INFO nova.compute.manager [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Neutron deleted interface 797d5492-5f6c-4838-8957-0e25ae77c86d; detaching it from the instance and deleting it from the info cache
Dec 05 12:25:36 user nova-compute[75071]: DEBUG nova.network.neutron [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Updating instance_info_cache with network_info: [{"id": "1219420b-24a0-435b-aaa4-283c51d9a847", "address": "fa:16:3e:f4:b1:b4", "network": {"id": "18d0b7e0-69a8-4771-8e3a-665d0b5d2c75", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1386912740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219420b-24", "ovs_interfaceid": "1219420b-24a0-435b-aaa4-283c51d9a847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquiring lock "refresh_cache-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquired lock "refresh_cache-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG nova.network.neutron [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG nova.objects.instance [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] Lazy-loading 'system_metadata' on Instance uuid 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG nova.objects.instance [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] Lazy-loading 'flavor' on Instance uuid 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG nova.objects.base [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] Object Instance<26cff7c2-b2a8-4a33-a2a0-3a63a2073d21> lazy-loaded attributes: system_metadata,flavor {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1053518687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1053518687',id=20,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz9ElrhNZZvItqxGapQtmVbaKvJMnHtVQyBhczgKvaO8d/GBJ06KdbJMsPoiJPdFlj8W+R0Nu4rD1BhABN0XoGYod9pe9msGHytqCXlWqPOlmLX9S/AlygQdInxVYWU+Q==',key_name='tempest-keypair-1649114374',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:22:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6041024288a84808858ed4938f83fee5',ramdisk_id='',reservation_id='r-v4p52h60',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1076524669',owner_user_name='tempest-TaggedAttachmentsTest-1076524669-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a361c08c15664fbd880f06b487d62aa6',uuid=26cff7c2-b2a8-4a33-a2a0-3a63a2073d21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "797d5492-5f6c-4838-8957-0e25ae77c86d", "address": "fa:16:3e:f8:08:dc", "network": {"id": "e1b36d20-1610-4f57-b9e8-0d05b9422626", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-904919460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d5492-5f", "ovs_interfaceid": "797d5492-5f6c-4838-8957-0e25ae77c86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG nova.network.os_vif_util [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] Converting VIF {"id": "797d5492-5f6c-4838-8957-0e25ae77c86d", "address": "fa:16:3e:f8:08:dc", "network": {"id": "e1b36d20-1610-4f57-b9e8-0d05b9422626", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-904919460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d5492-5f", "ovs_interfaceid": "797d5492-5f6c-4838-8957-0e25ae77c86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG nova.network.os_vif_util [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:08:dc,bridge_name='br-int',has_traffic_filtering=True,id=797d5492-5f6c-4838-8957-0e25ae77c86d,network=Network(e1b36d20-1610-4f57-b9e8-0d05b9422626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap797d5492-5f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f8:08:dc"/><model type="virtio"/><mtu size="1442"/><target dev="tap797d5492-5f"/></interface> {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f8:08:dc"/><model type="virtio"/><mtu size="1442"/><target dev="tap797d5492-5f"/></interface>not found in domain: <domain type='kvm' id='23'>
Dec 05 12:25:36 user nova-compute[75071]:   <name>instance-00000014</name>
Dec 05 12:25:36 user nova-compute[75071]:   <uuid>26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</uuid>
Dec 05 12:25:36 user nova-compute[75071]:   <metadata>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:25:36 user nova-compute[75071]:   <nova:package version="0.0.0"/>
Dec 05 12:25:36 user nova-compute[75071]:   <nova:name>tempest-device-tagging-server-1053518687</nova:name>
Dec 05 12:25:36 user nova-compute[75071]:   <nova:creationTime>2023-12-05 12:25:35</nova:creationTime>
Dec 05 12:25:36 user nova-compute[75071]:   <nova:flavor name="m1.tiny">
Dec 05 12:25:36 user nova-compute[75071]:     <nova:memory>512</nova:memory>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:disk>1</nova:disk>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:swap>0</nova:swap>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:vcpus>1</nova:vcpus>
Dec 05 12:25:36 user nova-compute[75071]:   </nova:flavor>
Dec 05 12:25:36 user nova-compute[75071]:   <nova:owner>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:user uuid="a361c08c15664fbd880f06b487d62aa6">tempest-TaggedAttachmentsTest-1076524669-project-member</nova:user>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:project uuid="6041024288a84808858ed4938f83fee5">tempest-TaggedAttachmentsTest-1076524669</nova:project>
Dec 05 12:25:36 user nova-compute[75071]:   </nova:owner>
Dec 05 12:25:36 user nova-compute[75071]:   <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:25:36 user nova-compute[75071]:   <nova:ports>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:port uuid="1219420b-24a0-435b-aaa4-283c51d9a847">
Dec 05 12:25:36 user nova-compute[75071]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 12:25:36 user nova-compute[75071]:     </nova:port>
Dec 05 12:25:36 user nova-compute[75071]:   </nova:ports>
Dec 05 12:25:36 user nova-compute[75071]: </nova:instance>
Dec 05 12:25:36 user nova-compute[75071]:   </metadata>
Dec 05 12:25:36 user nova-compute[75071]:   <memory unit='KiB'>524288</memory>
Dec 05 12:25:36 user nova-compute[75071]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 05 12:25:36 user nova-compute[75071]:   <vcpu placement='static'>1</vcpu>
Dec 05 12:25:36 user nova-compute[75071]:   <resource>
Dec 05 12:25:36 user nova-compute[75071]:     <partition>/machine</partition>
Dec 05 12:25:36 user nova-compute[75071]:   </resource>
Dec 05 12:25:36 user nova-compute[75071]:   <sysinfo type='smbios'>
Dec 05 12:25:36 user nova-compute[75071]:     <system>
Dec 05 12:25:36 user nova-compute[75071]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 05 12:25:36 user nova-compute[75071]:       <entry name='product'>OpenStack Nova</entry>
Dec 05 12:25:36 user nova-compute[75071]:       <entry name='version'>0.0.0</entry>
Dec 05 12:25:36 user nova-compute[75071]:       <entry name='serial'>26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</entry>
Dec 05 12:25:36 user nova-compute[75071]:       <entry name='uuid'>26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</entry>
Dec 05 12:25:36 user nova-compute[75071]:       <entry name='family'>Virtual Machine</entry>
Dec 05 12:25:36 user nova-compute[75071]:     </system>
Dec 05 12:25:36 user nova-compute[75071]:   </sysinfo>
Dec 05 12:25:36 user nova-compute[75071]:   <os>
Dec 05 12:25:36 user nova-compute[75071]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 05 12:25:36 user nova-compute[75071]:     <boot dev='hd'/>
Dec 05 12:25:36 user nova-compute[75071]:     <smbios mode='sysinfo'/>
Dec 05 12:25:36 user nova-compute[75071]:   </os>
Dec 05 12:25:36 user nova-compute[75071]:   <features>
Dec 05 12:25:36 user nova-compute[75071]:     <acpi/>
Dec 05 12:25:36 user nova-compute[75071]:     <apic/>
Dec 05 12:25:36 user nova-compute[75071]:     <vmcoreinfo state='on'/>
Dec 05 12:25:36 user nova-compute[75071]:   </features>
Dec 05 12:25:36 user nova-compute[75071]:   <cpu mode='custom' match='exact' check='full'>
Dec 05 12:25:36 user nova-compute[75071]:     <model fallback='forbid'>Nehalem</model>
Dec 05 12:25:36 user nova-compute[75071]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 05 12:25:36 user nova-compute[75071]:     <feature policy='require' name='vme'/>
Dec 05 12:25:36 user nova-compute[75071]:     <feature policy='require' name='x2apic'/>
Dec 05 12:25:36 user nova-compute[75071]:     <feature policy='require' name='hypervisor'/>
Dec 05 12:25:36 user nova-compute[75071]:   </cpu>
Dec 05 12:25:36 user nova-compute[75071]:   <clock offset='utc'>
Dec 05 12:25:36 user nova-compute[75071]:     <timer name='pit' tickpolicy='delay'/>
Dec 05 12:25:36 user nova-compute[75071]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 05 12:25:36 user nova-compute[75071]:     <timer name='hpet' present='no'/>
Dec 05 12:25:36 user nova-compute[75071]:   </clock>
Dec 05 12:25:36 user nova-compute[75071]:   <on_poweroff>destroy</on_poweroff>
Dec 05 12:25:36 user nova-compute[75071]:   <on_reboot>restart</on_reboot>
Dec 05 12:25:36 user nova-compute[75071]:   <on_crash>destroy</on_crash>
Dec 05 12:25:36 user nova-compute[75071]:   <devices>
Dec 05 12:25:36 user nova-compute[75071]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 05 12:25:36 user nova-compute[75071]:     <disk type='file' device='disk'>
Dec 05 12:25:36 user nova-compute[75071]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 05 12:25:36 user nova-compute[75071]:       <source file='/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk' index='2'/>
Dec 05 12:25:36 user nova-compute[75071]:       <backingStore type='file' index='3'>
Dec 05 12:25:36 user nova-compute[75071]:         <format type='raw'/>
Dec 05 12:25:36 user nova-compute[75071]:         <source file='/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18'/>
Dec 05 12:25:36 user nova-compute[75071]:         <backingStore/>
Dec 05 12:25:36 user nova-compute[75071]:       </backingStore>
Dec 05 12:25:36 user nova-compute[75071]:       <target dev='vda' bus='virtio'/>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='virtio-disk0'/>
Dec 05 12:25:36 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </disk>
Dec 05 12:25:36 user nova-compute[75071]:     <disk type='file' device='cdrom'>
Dec 05 12:25:36 user nova-compute[75071]:       <driver name='qemu' type='raw' cache='none'/>
Dec 05 12:25:36 user nova-compute[75071]:       <source file='/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk.config' index='1'/>
Dec 05 12:25:36 user nova-compute[75071]:       <backingStore/>
Dec 05 12:25:36 user nova-compute[75071]:       <target dev='hda' bus='ide'/>
Dec 05 12:25:36 user nova-compute[75071]:       <readonly/>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='ide0-0-0'/>
Dec 05 12:25:36 user nova-compute[75071]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </disk>
Dec 05 12:25:36 user nova-compute[75071]:     <controller type='usb' index='0' model='none'>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='usb'/>
Dec 05 12:25:36 user nova-compute[75071]:     </controller>
Dec 05 12:25:36 user nova-compute[75071]:     <controller type='pci' index='0' model='pci-root'>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='pci.0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </controller>
Dec 05 12:25:36 user nova-compute[75071]:     <controller type='ide' index='0'>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='ide'/>
Dec 05 12:25:36 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 05 12:25:36 user nova-compute[75071]:     </controller>
Dec 05 12:25:36 user nova-compute[75071]:     <interface type='ethernet'>
Dec 05 12:25:36 user nova-compute[75071]:       <mac address='fa:16:3e:f4:b1:b4'/>
Dec 05 12:25:36 user nova-compute[75071]:       <target dev='tap1219420b-24'/>
Dec 05 12:25:36 user nova-compute[75071]:       <model type='virtio'/>
Dec 05 12:25:36 user nova-compute[75071]:       <mtu size='1442'/>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='net0'/>
Dec 05 12:25:36 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </interface>
Dec 05 12:25:36 user nova-compute[75071]:     <serial type='pty'>
Dec 05 12:25:36 user nova-compute[75071]:       <source path='/dev/pts/10'/>
Dec 05 12:25:36 user nova-compute[75071]:       <log file='/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/console.log' append='off'/>
Dec 05 12:25:36 user nova-compute[75071]:       <target type='isa-serial' port='0'>
Dec 05 12:25:36 user nova-compute[75071]:         <model name='isa-serial'/>
Dec 05 12:25:36 user nova-compute[75071]:       </target>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='serial0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </serial>
Dec 05 12:25:36 user nova-compute[75071]:     <console type='pty' tty='/dev/pts/10'>
Dec 05 12:25:36 user nova-compute[75071]:       <source path='/dev/pts/10'/>
Dec 05 12:25:36 user nova-compute[75071]:       <log file='/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/console.log' append='off'/>
Dec 05 12:25:36 user nova-compute[75071]:       <target type='serial' port='0'/>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='serial0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </console>
Dec 05 12:25:36 user nova-compute[75071]:     <input type='mouse' bus='ps2'>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='input0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </input>
Dec 05 12:25:36 user nova-compute[75071]:     <input type='keyboard' bus='ps2'>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='input1'/>
Dec 05 12:25:36 user nova-compute[75071]:     </input>
Dec 05 12:25:36 user nova-compute[75071]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Dec 05 12:25:36 user nova-compute[75071]:       <listen type='address' address='0.0.0.0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </graphics>
Dec 05 12:25:36 user nova-compute[75071]:     <audio id='1' type='none'/>
Dec 05 12:25:36 user nova-compute[75071]:     <video>
Dec 05 12:25:36 user nova-compute[75071]:       <model type='virtio' heads='1' primary='yes'/>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='video0'/>
Dec 05 12:25:36 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </video>
Dec 05 12:25:36 user nova-compute[75071]:     <memballoon model='virtio'>
Dec 05 12:25:36 user nova-compute[75071]:       <stats period='10'/>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='balloon0'/>
Dec 05 12:25:36 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </memballoon>
Dec 05 12:25:36 user nova-compute[75071]:     <rng model='virtio'>
Dec 05 12:25:36 user nova-compute[75071]:       <backend model='random'>/dev/urandom</backend>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='rng0'/>
Dec 05 12:25:36 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </rng>
Dec 05 12:25:36 user nova-compute[75071]:   </devices>
Dec 05 12:25:36 user nova-compute[75071]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 05 12:25:36 user nova-compute[75071]:     <label>libvirt-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</label>
Dec 05 12:25:36 user nova-compute[75071]:     <imagelabel>libvirt-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</imagelabel>
Dec 05 12:25:36 user nova-compute[75071]:   </seclabel>
Dec 05 12:25:36 user nova-compute[75071]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 05 12:25:36 user nova-compute[75071]:     <label>+64055:+108</label>
Dec 05 12:25:36 user nova-compute[75071]:     <imagelabel>+64055:+108</imagelabel>
Dec 05 12:25:36 user nova-compute[75071]:   </seclabel>
Dec 05 12:25:36 user nova-compute[75071]: </domain>
Dec 05 12:25:36 user nova-compute[75071]:  {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f8:08:dc"/><model type="virtio"/><mtu size="1442"/><target dev="tap797d5492-5f"/></interface> {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f8:08:dc"/><model type="virtio"/><mtu size="1442"/><target dev="tap797d5492-5f"/></interface>not found in domain: <domain type='kvm' id='23'>
Dec 05 12:25:36 user nova-compute[75071]:   <name>instance-00000014</name>
Dec 05 12:25:36 user nova-compute[75071]:   <uuid>26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</uuid>
Dec 05 12:25:36 user nova-compute[75071]:   <metadata>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:25:36 user nova-compute[75071]:   <nova:package version="0.0.0"/>
Dec 05 12:25:36 user nova-compute[75071]:   <nova:name>tempest-device-tagging-server-1053518687</nova:name>
Dec 05 12:25:36 user nova-compute[75071]:   <nova:creationTime>2023-12-05 12:25:35</nova:creationTime>
Dec 05 12:25:36 user nova-compute[75071]:   <nova:flavor name="m1.tiny">
Dec 05 12:25:36 user nova-compute[75071]:     <nova:memory>512</nova:memory>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:disk>1</nova:disk>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:swap>0</nova:swap>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:vcpus>1</nova:vcpus>
Dec 05 12:25:36 user nova-compute[75071]:   </nova:flavor>
Dec 05 12:25:36 user nova-compute[75071]:   <nova:owner>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:user uuid="a361c08c15664fbd880f06b487d62aa6">tempest-TaggedAttachmentsTest-1076524669-project-member</nova:user>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:project uuid="6041024288a84808858ed4938f83fee5">tempest-TaggedAttachmentsTest-1076524669</nova:project>
Dec 05 12:25:36 user nova-compute[75071]:   </nova:owner>
Dec 05 12:25:36 user nova-compute[75071]:   <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:25:36 user nova-compute[75071]:   <nova:ports>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:port uuid="1219420b-24a0-435b-aaa4-283c51d9a847">
Dec 05 12:25:36 user nova-compute[75071]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 12:25:36 user nova-compute[75071]:     </nova:port>
Dec 05 12:25:36 user nova-compute[75071]:   </nova:ports>
Dec 05 12:25:36 user nova-compute[75071]: </nova:instance>
Dec 05 12:25:36 user nova-compute[75071]:   </metadata>
Dec 05 12:25:36 user nova-compute[75071]:   <memory unit='KiB'>524288</memory>
Dec 05 12:25:36 user nova-compute[75071]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 05 12:25:36 user nova-compute[75071]:   <vcpu placement='static'>1</vcpu>
Dec 05 12:25:36 user nova-compute[75071]:   <resource>
Dec 05 12:25:36 user nova-compute[75071]:     <partition>/machine</partition>
Dec 05 12:25:36 user nova-compute[75071]:   </resource>
Dec 05 12:25:36 user nova-compute[75071]:   <sysinfo type='smbios'>
Dec 05 12:25:36 user nova-compute[75071]:     <system>
Dec 05 12:25:36 user nova-compute[75071]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 05 12:25:36 user nova-compute[75071]:       <entry name='product'>OpenStack Nova</entry>
Dec 05 12:25:36 user nova-compute[75071]:       <entry name='version'>0.0.0</entry>
Dec 05 12:25:36 user nova-compute[75071]:       <entry name='serial'>26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</entry>
Dec 05 12:25:36 user nova-compute[75071]:       <entry name='uuid'>26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</entry>
Dec 05 12:25:36 user nova-compute[75071]:       <entry name='family'>Virtual Machine</entry>
Dec 05 12:25:36 user nova-compute[75071]:     </system>
Dec 05 12:25:36 user nova-compute[75071]:   </sysinfo>
Dec 05 12:25:36 user nova-compute[75071]:   <os>
Dec 05 12:25:36 user nova-compute[75071]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 05 12:25:36 user nova-compute[75071]:     <boot dev='hd'/>
Dec 05 12:25:36 user nova-compute[75071]:     <smbios mode='sysinfo'/>
Dec 05 12:25:36 user nova-compute[75071]:   </os>
Dec 05 12:25:36 user nova-compute[75071]:   <features>
Dec 05 12:25:36 user nova-compute[75071]:     <acpi/>
Dec 05 12:25:36 user nova-compute[75071]:     <apic/>
Dec 05 12:25:36 user nova-compute[75071]:     <vmcoreinfo state='on'/>
Dec 05 12:25:36 user nova-compute[75071]:   </features>
Dec 05 12:25:36 user nova-compute[75071]:   <cpu mode='custom' match='exact' check='full'>
Dec 05 12:25:36 user nova-compute[75071]:     <model fallback='forbid'>Nehalem</model>
Dec 05 12:25:36 user nova-compute[75071]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 05 12:25:36 user nova-compute[75071]:     <feature policy='require' name='vme'/>
Dec 05 12:25:36 user nova-compute[75071]:     <feature policy='require' name='x2apic'/>
Dec 05 12:25:36 user nova-compute[75071]:     <feature policy='require' name='hypervisor'/>
Dec 05 12:25:36 user nova-compute[75071]:   </cpu>
Dec 05 12:25:36 user nova-compute[75071]:   <clock offset='utc'>
Dec 05 12:25:36 user nova-compute[75071]:     <timer name='pit' tickpolicy='delay'/>
Dec 05 12:25:36 user nova-compute[75071]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 05 12:25:36 user nova-compute[75071]:     <timer name='hpet' present='no'/>
Dec 05 12:25:36 user nova-compute[75071]:   </clock>
Dec 05 12:25:36 user nova-compute[75071]:   <on_poweroff>destroy</on_poweroff>
Dec 05 12:25:36 user nova-compute[75071]:   <on_reboot>restart</on_reboot>
Dec 05 12:25:36 user nova-compute[75071]:   <on_crash>destroy</on_crash>
Dec 05 12:25:36 user nova-compute[75071]:   <devices>
Dec 05 12:25:36 user nova-compute[75071]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 05 12:25:36 user nova-compute[75071]:     <disk type='file' device='disk'>
Dec 05 12:25:36 user nova-compute[75071]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 05 12:25:36 user nova-compute[75071]:       <source file='/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk' index='2'/>
Dec 05 12:25:36 user nova-compute[75071]:       <backingStore type='file' index='3'>
Dec 05 12:25:36 user nova-compute[75071]:         <format type='raw'/>
Dec 05 12:25:36 user nova-compute[75071]:         <source file='/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18'/>
Dec 05 12:25:36 user nova-compute[75071]:         <backingStore/>
Dec 05 12:25:36 user nova-compute[75071]:       </backingStore>
Dec 05 12:25:36 user nova-compute[75071]:       <target dev='vda' bus='virtio'/>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='virtio-disk0'/>
Dec 05 12:25:36 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </disk>
Dec 05 12:25:36 user nova-compute[75071]:     <disk type='file' device='cdrom'>
Dec 05 12:25:36 user nova-compute[75071]:       <driver name='qemu' type='raw' cache='none'/>
Dec 05 12:25:36 user nova-compute[75071]:       <source file='/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk.config' index='1'/>
Dec 05 12:25:36 user nova-compute[75071]:       <backingStore/>
Dec 05 12:25:36 user nova-compute[75071]:       <target dev='hda' bus='ide'/>
Dec 05 12:25:36 user nova-compute[75071]:       <readonly/>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='ide0-0-0'/>
Dec 05 12:25:36 user nova-compute[75071]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </disk>
Dec 05 12:25:36 user nova-compute[75071]:     <controller type='usb' index='0' model='none'>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='usb'/>
Dec 05 12:25:36 user nova-compute[75071]:     </controller>
Dec 05 12:25:36 user nova-compute[75071]:     <controller type='pci' index='0' model='pci-root'>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='pci.0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </controller>
Dec 05 12:25:36 user nova-compute[75071]:     <controller type='ide' index='0'>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='ide'/>
Dec 05 12:25:36 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 05 12:25:36 user nova-compute[75071]:     </controller>
Dec 05 12:25:36 user nova-compute[75071]:     <interface type='ethernet'>
Dec 05 12:25:36 user nova-compute[75071]:       <mac address='fa:16:3e:f4:b1:b4'/>
Dec 05 12:25:36 user nova-compute[75071]:       <target dev='tap1219420b-24'/>
Dec 05 12:25:36 user nova-compute[75071]:       <model type='virtio'/>
Dec 05 12:25:36 user nova-compute[75071]:       <mtu size='1442'/>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='net0'/>
Dec 05 12:25:36 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </interface>
Dec 05 12:25:36 user nova-compute[75071]:     <serial type='pty'>
Dec 05 12:25:36 user nova-compute[75071]:       <source path='/dev/pts/10'/>
Dec 05 12:25:36 user nova-compute[75071]:       <log file='/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/console.log' append='off'/>
Dec 05 12:25:36 user nova-compute[75071]:       <target type='isa-serial' port='0'>
Dec 05 12:25:36 user nova-compute[75071]:         <model name='isa-serial'/>
Dec 05 12:25:36 user nova-compute[75071]:       </target>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='serial0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </serial>
Dec 05 12:25:36 user nova-compute[75071]:     <console type='pty' tty='/dev/pts/10'>
Dec 05 12:25:36 user nova-compute[75071]:       <source path='/dev/pts/10'/>
Dec 05 12:25:36 user nova-compute[75071]:       <log file='/opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/console.log' append='off'/>
Dec 05 12:25:36 user nova-compute[75071]:       <target type='serial' port='0'/>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='serial0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </console>
Dec 05 12:25:36 user nova-compute[75071]:     <input type='mouse' bus='ps2'>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='input0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </input>
Dec 05 12:25:36 user nova-compute[75071]:     <input type='keyboard' bus='ps2'>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='input1'/>
Dec 05 12:25:36 user nova-compute[75071]:     </input>
Dec 05 12:25:36 user nova-compute[75071]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Dec 05 12:25:36 user nova-compute[75071]:       <listen type='address' address='0.0.0.0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </graphics>
Dec 05 12:25:36 user nova-compute[75071]:     <audio id='1' type='none'/>
Dec 05 12:25:36 user nova-compute[75071]:     <video>
Dec 05 12:25:36 user nova-compute[75071]:       <model type='virtio' heads='1' primary='yes'/>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='video0'/>
Dec 05 12:25:36 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </video>
Dec 05 12:25:36 user nova-compute[75071]:     <memballoon model='virtio'>
Dec 05 12:25:36 user nova-compute[75071]:       <stats period='10'/>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='balloon0'/>
Dec 05 12:25:36 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </memballoon>
Dec 05 12:25:36 user nova-compute[75071]:     <rng model='virtio'>
Dec 05 12:25:36 user nova-compute[75071]:       <backend model='random'>/dev/urandom</backend>
Dec 05 12:25:36 user nova-compute[75071]:       <alias name='rng0'/>
Dec 05 12:25:36 user nova-compute[75071]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 05 12:25:36 user nova-compute[75071]:     </rng>
Dec 05 12:25:36 user nova-compute[75071]:   </devices>
Dec 05 12:25:36 user nova-compute[75071]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 05 12:25:36 user nova-compute[75071]:     <label>libvirt-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</label>
Dec 05 12:25:36 user nova-compute[75071]:     <imagelabel>libvirt-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21</imagelabel>
Dec 05 12:25:36 user nova-compute[75071]:   </seclabel>
Dec 05 12:25:36 user nova-compute[75071]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 05 12:25:36 user nova-compute[75071]:     <label>+64055:+108</label>
Dec 05 12:25:36 user nova-compute[75071]:     <imagelabel>+64055:+108</imagelabel>
Dec 05 12:25:36 user nova-compute[75071]:   </seclabel>
Dec 05 12:25:36 user nova-compute[75071]: </domain>
Dec 05 12:25:36 user nova-compute[75071]:  {{(pid=75071) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 05 12:25:36 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Detaching interface fa:16:3e:f8:08:dc failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap797d5492-5f' not found.
Dec 05 12:25:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1053518687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1053518687',id=20,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz9ElrhNZZvItqxGapQtmVbaKvJMnHtVQyBhczgKvaO8d/GBJ06KdbJMsPoiJPdFlj8W+R0Nu4rD1BhABN0XoGYod9pe9msGHytqCXlWqPOlmLX9S/AlygQdInxVYWU+Q==',key_name='tempest-keypair-1649114374',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:22:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6041024288a84808858ed4938f83fee5',ramdisk_id='',reservation_id='r-v4p52h60',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1076524669',owner_user_name='tempest-TaggedAttachmentsTest-1076524669-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a361c08c15664fbd880f06b487d62aa6',uuid=26cff7c2-b2a8-4a33-a2a0-3a63a2073d21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "797d5492-5f6c-4838-8957-0e25ae77c86d", "address": "fa:16:3e:f8:08:dc", "network": {"id": "e1b36d20-1610-4f57-b9e8-0d05b9422626", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-904919460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d5492-5f", "ovs_interfaceid": "797d5492-5f6c-4838-8957-0e25ae77c86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG nova.network.os_vif_util [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] Converting VIF {"id": "797d5492-5f6c-4838-8957-0e25ae77c86d", "address": "fa:16:3e:f8:08:dc", "network": {"id": "e1b36d20-1610-4f57-b9e8-0d05b9422626", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-904919460", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.236", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d5492-5f", "ovs_interfaceid": "797d5492-5f6c-4838-8957-0e25ae77c86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG nova.network.os_vif_util [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:08:dc,bridge_name='br-int',has_traffic_filtering=True,id=797d5492-5f6c-4838-8957-0e25ae77c86d,network=Network(e1b36d20-1610-4f57-b9e8-0d05b9422626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap797d5492-5f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG os_vif [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:08:dc,bridge_name='br-int',has_traffic_filtering=True,id=797d5492-5f6c-4838-8957-0e25ae77c86d,network=Network(e1b36d20-1610-4f57-b9e8-0d05b9422626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap797d5492-5f') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap797d5492-5f, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:25:36 user nova-compute[75071]: INFO os_vif [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:08:dc,bridge_name='br-int',has_traffic_filtering=True,id=797d5492-5f6c-4838-8957-0e25ae77c86d,network=Network(e1b36d20-1610-4f57-b9e8-0d05b9422626),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap797d5492-5f')
Dec 05 12:25:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [req-9f8ce2ef-dc56-4f65-a15a-c71ab97e93ad req-0779a4e8-dcb1-47dd-978a-261be423bad1 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:25:36 user nova-compute[75071]:   <nova:package version="0.0.0"/>
Dec 05 12:25:36 user nova-compute[75071]:   <nova:name>tempest-device-tagging-server-1053518687</nova:name>
Dec 05 12:25:36 user nova-compute[75071]:   <nova:creationTime>2023-12-05 12:25:36</nova:creationTime>
Dec 05 12:25:36 user nova-compute[75071]:   <nova:flavor name="m1.tiny">
Dec 05 12:25:36 user nova-compute[75071]:     <nova:memory>512</nova:memory>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:disk>1</nova:disk>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:swap>0</nova:swap>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:vcpus>1</nova:vcpus>
Dec 05 12:25:36 user nova-compute[75071]:   </nova:flavor>
Dec 05 12:25:36 user nova-compute[75071]:   <nova:owner>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:user uuid="a361c08c15664fbd880f06b487d62aa6">tempest-TaggedAttachmentsTest-1076524669-project-member</nova:user>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:project uuid="6041024288a84808858ed4938f83fee5">tempest-TaggedAttachmentsTest-1076524669</nova:project>
Dec 05 12:25:36 user nova-compute[75071]:   </nova:owner>
Dec 05 12:25:36 user nova-compute[75071]:   <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:25:36 user nova-compute[75071]:   <nova:ports>
Dec 05 12:25:36 user nova-compute[75071]:     <nova:port uuid="1219420b-24a0-435b-aaa4-283c51d9a847">
Dec 05 12:25:36 user nova-compute[75071]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 12:25:36 user nova-compute[75071]:     </nova:port>
Dec 05 12:25:36 user nova-compute[75071]:   </nova:ports>
Dec 05 12:25:36 user nova-compute[75071]: </nova:instance>
Dec 05 12:25:36 user nova-compute[75071]:  {{(pid=75071) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 05 12:25:36 user nova-compute[75071]: INFO nova.network.neutron [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Port 797d5492-5f6c-4838-8957-0e25ae77c86d from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Dec 05 12:25:36 user nova-compute[75071]: DEBUG nova.network.neutron [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Updating instance_info_cache with network_info: [{"id": "1219420b-24a0-435b-aaa4-283c51d9a847", "address": "fa:16:3e:f4:b1:b4", "network": {"id": "18d0b7e0-69a8-4771-8e3a-665d0b5d2c75", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1386912740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219420b-24", "ovs_interfaceid": "1219420b-24a0-435b-aaa4-283c51d9a847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Releasing lock "refresh_cache-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:25:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-27c0ecd4-fa0f-4c7c-ad83-fd2a4eae3c34 tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "interface-26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-797d5492-5f6c-4838-8957-0e25ae77c86d" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.525s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-3f788a1c-4f60-426c-b4df-661cabe68f82 req-97f9740a-c76a-4191-804c-10030af98f2c service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Received event network-changed-fd5c707a-6b81-4c59-87d0-8204082e274a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:25:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-3f788a1c-4f60-426c-b4df-661cabe68f82 req-97f9740a-c76a-4191-804c-10030af98f2c service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Refreshing instance network info cache due to event network-changed-fd5c707a-6b81-4c59-87d0-8204082e274a. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:25:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3f788a1c-4f60-426c-b4df-661cabe68f82 req-97f9740a-c76a-4191-804c-10030af98f2c service nova] Acquiring lock "refresh_cache-17348e17-fde4-49b9-a79d-8361724acc4f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:25:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3f788a1c-4f60-426c-b4df-661cabe68f82 req-97f9740a-c76a-4191-804c-10030af98f2c service nova] Acquired lock "refresh_cache-17348e17-fde4-49b9-a79d-8361724acc4f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:25:37 user nova-compute[75071]: DEBUG nova.network.neutron [req-3f788a1c-4f60-426c-b4df-661cabe68f82 req-97f9740a-c76a-4191-804c-10030af98f2c service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Refreshing network info cache for port fd5c707a-6b81-4c59-87d0-8204082e274a {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:25:37 user nova-compute[75071]: DEBUG nova.network.neutron [req-3f788a1c-4f60-426c-b4df-661cabe68f82 req-97f9740a-c76a-4191-804c-10030af98f2c service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Updated VIF entry in instance network info cache for port fd5c707a-6b81-4c59-87d0-8204082e274a. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:25:37 user nova-compute[75071]: DEBUG nova.network.neutron [req-3f788a1c-4f60-426c-b4df-661cabe68f82 req-97f9740a-c76a-4191-804c-10030af98f2c service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Updating instance_info_cache with network_info: [{"id": "fd5c707a-6b81-4c59-87d0-8204082e274a", "address": "fa:16:3e:4f:0f:1c", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5c707a-6b", "ovs_interfaceid": "fd5c707a-6b81-4c59-87d0-8204082e274a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:25:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3f788a1c-4f60-426c-b4df-661cabe68f82 req-97f9740a-c76a-4191-804c-10030af98f2c service nova] Releasing lock "refresh_cache-17348e17-fde4-49b9-a79d-8361724acc4f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:25:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "17348e17-fde4-49b9-a79d-8361724acc4f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "17348e17-fde4-49b9-a79d-8361724acc4f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:39 user nova-compute[75071]: DEBUG nova.objects.instance [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lazy-loading 'flavor' on Instance uuid 17348e17-fde4-49b9-a79d-8361724acc4f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:25:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "17348e17-fde4-49b9-a79d-8361724acc4f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "17348e17-fde4-49b9-a79d-8361724acc4f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "17348e17-fde4-49b9-a79d-8361724acc4f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:40 user nova-compute[75071]: INFO nova.compute.manager [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Attaching volume 8d98c578-f422-4d01-a4e7-b72702b3a23b to /dev/vdb
Dec 05 12:25:40 user nova-compute[75071]: DEBUG os_brick.utils [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0405952b-bead-4c81-8d01-b76594ccf86a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5aae3b-d4ec-423f-8310-7f609c1c861f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55a6956-5148-424f-95e9-ad4c0e511c22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb468509-1db7-4099-903a-d5ac6c60331c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:25:40 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:25:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdd07c1-daac-4191-b657-92c8174d3272]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG os_brick.utils [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Updating existing volume attachment record: 1025b82d-b34c-4d36-bd10-c1b351352a63 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:25:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:42 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:25:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:43 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:25:43 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:25:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:43 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:25:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "62efa94c-ae01-48aa-b3d3-0d23d159801c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:46 user nova-compute[75071]: INFO nova.compute.manager [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Terminating instance
Dec 05 12:25:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-1d0a814a-5d8d-42c9-ac13-26b66e431711 req-e1b4a51a-b6b6-49c1-86f3-10fa080c48bd service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Received event network-vif-unplugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1d0a814a-5d8d-42c9-ac13-26b66e431711 req-e1b4a51a-b6b6-49c1-86f3-10fa080c48bd service nova] Acquiring lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1d0a814a-5d8d-42c9-ac13-26b66e431711 req-e1b4a51a-b6b6-49c1-86f3-10fa080c48bd service nova] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1d0a814a-5d8d-42c9-ac13-26b66e431711 req-e1b4a51a-b6b6-49c1-86f3-10fa080c48bd service nova] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-1d0a814a-5d8d-42c9-ac13-26b66e431711 req-e1b4a51a-b6b6-49c1-86f3-10fa080c48bd service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] No waiting events found dispatching network-vif-unplugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-1d0a814a-5d8d-42c9-ac13-26b66e431711 req-e1b4a51a-b6b6-49c1-86f3-10fa080c48bd service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Received event network-vif-unplugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:47 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Instance destroyed successfully.
Dec 05 12:25:47 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lazy-loading 'resources' on Instance uuid 62efa94c-ae01-48aa-b3d3-0d23d159801c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T12:19:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1207590253',display_name='tempest-ServerActionsTestOtherA-server-233404088',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1207590253',id=13,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk/2CR5ryCdFhnzY7TEoYapKL803/W+14EuHBFh/Bn1ydNJw/5MkJqSTVw47d32v20VlRqVYqCUpZ+R3KOMF8XfpJIXjWBmPbrx5vIAMBConykgFyc0rPSXZyqCSasrlQ==',key_name='tempest-keypair-858510286',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:22:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59b6bfae34944fcfbd49d2f18b232ec8',ramdisk_id='',reservation_id='r-6o3c9k6r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1523780015',owner_user_name='tempest-ServerActionsTestOtherA-1523780015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e73e24d5b1489c813f06690b12eef4',uuid=62efa94c-ae01-48aa-b3d3-0d23d159801c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "address": "fa:16:3e:8f:a8:2b", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9ba38-13", "ovs_interfaceid": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converting VIF {"id": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "address": "fa:16:3e:8f:a8:2b", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfd9ba38-13", "ovs_interfaceid": "dfd9ba38-13c3-423b-81d9-8fd813ca2acd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=dfd9ba38-13c3-423b-81d9-8fd813ca2acd,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9ba38-13') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG os_vif [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=dfd9ba38-13c3-423b-81d9-8fd813ca2acd,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9ba38-13') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfd9ba38-13, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a42cfc3-f77b-4d79-bd61-a838baaa2f9f) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:47 user nova-compute[75071]: INFO os_vif [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=dfd9ba38-13c3-423b-81d9-8fd813ca2acd,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfd9ba38-13')
Dec 05 12:25:47 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Deleting instance files /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c_del
Dec 05 12:25:47 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Deletion of /opt/stack/data/nova/instances/62efa94c-ae01-48aa-b3d3-0d23d159801c_del complete
Dec 05 12:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:47 user nova-compute[75071]: INFO nova.compute.manager [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Took 1.18 seconds to destroy the instance on the hypervisor.
Dec 05 12:25:47 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:25:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-3c5b1b4a-c493-477d-b0a0-35fbc37b7836 req-084b45a1-2077-4feb-bb37-f44d031d492b service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Received event network-vif-plugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:25:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3c5b1b4a-c493-477d-b0a0-35fbc37b7836 req-084b45a1-2077-4feb-bb37-f44d031d492b service nova] Acquiring lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3c5b1b4a-c493-477d-b0a0-35fbc37b7836 req-084b45a1-2077-4feb-bb37-f44d031d492b service nova] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3c5b1b4a-c493-477d-b0a0-35fbc37b7836 req-084b45a1-2077-4feb-bb37-f44d031d492b service nova] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-3c5b1b4a-c493-477d-b0a0-35fbc37b7836 req-084b45a1-2077-4feb-bb37-f44d031d492b service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] No waiting events found dispatching network-vif-plugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:25:48 user nova-compute[75071]: WARNING nova.compute.manager [req-3c5b1b4a-c493-477d-b0a0-35fbc37b7836 req-084b45a1-2077-4feb-bb37-f44d031d492b service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Received unexpected event network-vif-plugged-dfd9ba38-13c3-423b-81d9-8fd813ca2acd for instance with vm_state active and task_state deleting.
Dec 05 12:25:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-3c5b1b4a-c493-477d-b0a0-35fbc37b7836 req-084b45a1-2077-4feb-bb37-f44d031d492b service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Received event network-vif-deleted-dfd9ba38-13c3-423b-81d9-8fd813ca2acd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:25:48 user nova-compute[75071]: INFO nova.compute.manager [req-3c5b1b4a-c493-477d-b0a0-35fbc37b7836 req-084b45a1-2077-4feb-bb37-f44d031d492b service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Neutron deleted interface dfd9ba38-13c3-423b-81d9-8fd813ca2acd; detaching it from the instance and deleting it from the info cache
Dec 05 12:25:48 user nova-compute[75071]: DEBUG nova.network.neutron [req-3c5b1b4a-c493-477d-b0a0-35fbc37b7836 req-084b45a1-2077-4feb-bb37-f44d031d492b service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:25:48 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:25:48 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:25:48 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:25:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=7362MB free_disk=25.03388214111328GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:25:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:48 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Took 1.24 seconds to deallocate network for instance.
Dec 05 12:25:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-3c5b1b4a-c493-477d-b0a0-35fbc37b7836 req-084b45a1-2077-4feb-bb37-f44d031d492b service nova] [instance: 62efa94c-ae01-48aa-b3d3-0d23d159801c] Detach interface failed, port_id=dfd9ba38-13c3-423b-81d9-8fd813ca2acd, reason: Instance 62efa94c-ae01-48aa-b3d3-0d23d159801c could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lazy-loading 'flavor' on Instance uuid 386e93a2-2435-4d5f-bee2-fdb5f52fd476 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e08be776-0fa9-4871-86eb-2093530c00f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 62efa94c-ae01-48aa-b3d3-0d23d159801c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 17348e17-fde4-49b9-a79d-8361724acc4f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 386e93a2-2435-4d5f-bee2-fdb5f52fd476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9656e5d1-8fde-4a19-991c-211868fa5c91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance a99a0331-1d77-4b71-9ef7-0794778b3ef1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:49 user nova-compute[75071]: INFO nova.compute.manager [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Attaching volume 17e7e797-0041-4e40-93bc-c90c42e45a98 to /dev/vdb
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.utils [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b522464e-a911-42cf-826b-23547b6eb16a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c616a59a-bb09-4b77-9eae-1f63dfbe5dc6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4045c871-71de-4f70-af36-26ffd8106e61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2403e5b-fb28-4006-9d26-2d82544c2985]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:25:49 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8c38c0-e2a5-40b2-a196-cbcd20f15e1b]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.utils [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Updating existing volume attachment record: 52c4fe08-8d92-4fda-8a37-d9f7b2e4fa27 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.669s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.591s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uiXHkbtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:25:49 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:25:49 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:25:49 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a3bf95-c22d-4933-b6a1-e18a0e578115]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:25:49 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef7e7b6-cdc1-43b9-be5a-d999420e30dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b] added
Dec 05 12:25:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[639fa676-5cd0-41e5-9c35-1a564e97c2e7]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afa03ee-c8fb-4643-802b-6aff17a9565f]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uiXHkbtF {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uiXHkbtF" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfed8c44-56b8-4fab-bc84-fa30932306a5]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uiXHkbtF'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaca479-0d8c-40f6-948f-0a4359b4157c]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b54c2bd-416a-4e7a-885f-2030b2cc2902]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:25:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:25:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c6c948-86c0-4f85-8d2c-67e2baa2b46f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b, portal: 172.16.0.220,3260]
Dec 05 12:25:49 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b, portal: 172.16.0.220,3260] successful.
Dec 05 12:25:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a9cff7-c2ac-4bf8-83b3-108eb36dd067]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[513e29b6-c080-4a30-98b8-042add233d06]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:25:49 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b (non-flash)
Dec 05 12:25:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:25:49 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b (non-flash)
Dec 05 12:25:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5787f314-cb4a-4421-a56b-6ed64561c83c]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uiXHkbtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:25:49 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:25:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:50 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Deleted allocations for instance 62efa94c-ae01-48aa-b3d3-0d23d159801c
Dec 05 12:25:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a3acb37a-9d10-4c98-b108-0f5a08100346 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "62efa94c-ae01-48aa-b3d3-0d23d159801c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.648s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:25:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:25:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:25:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:25:50 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:25:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:25:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23165616264326539', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:25:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165616264326539', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:25:50 user nova-compute[75071]: DEBUG nova.objects.instance [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lazy-loading 'flavor' on Instance uuid 17348e17-fde4-49b9-a79d-8361724acc4f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:25:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:25:51 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:25:51 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:25:51 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:25:51 user nova-compute[75071]:   <serial>8d98c578-f422-4d01-a4e7-b72702b3a23b</serial>
Dec 05 12:25:51 user nova-compute[75071]: </disk>
Dec 05 12:25:51 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:25:51 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Updating instance_info_cache with network_info: [{"id": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "address": "fa:16:3e:53:ed:01", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd15e936-54", "ovs_interfaceid": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:25:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:25:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:25:51 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:25:51 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:25:51 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:25:51 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:25:51 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:25:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:25:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:25:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:25:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] No VIF found with MAC fa:16:3e:4f:0f:1c, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:25:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-942965d8-d8e4-4b7d-9027-ac7950aaedbf tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "17348e17-fde4-49b9-a79d-8361724acc4f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.470s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:25:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "17348e17-fde4-49b9-a79d-8361724acc4f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:25:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "17348e17-fde4-49b9-a79d-8361724acc4f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:25:52 user nova-compute[75071]: INFO nova.compute.manager [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Detaching volume 8d98c578-f422-4d01-a4e7-b72702b3a23b
Dec 05 12:25:52 user nova-compute[75071]: INFO nova.virt.block_device [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Attempting to driver detach volume 8d98c578-f422-4d01-a4e7-b72702b3a23b from mountpoint /dev/vdb
Dec 05 12:25:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Attempting to detach device vdb from instance 17348e17-fde4-49b9-a79d-8361724acc4f from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:25:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:25:52 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:25:52 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:25:52 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:25:52 user nova-compute[75071]:   <serial>8d98c578-f422-4d01-a4e7-b72702b3a23b</serial>
Dec 05 12:25:52 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:25:52 user nova-compute[75071]: </disk>
Dec 05 12:25:52 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:25:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Successfully detached device vdb from instance 17348e17-fde4-49b9-a79d-8361724acc4f from the persistent domain config.
Dec 05 12:25:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 17348e17-fde4-49b9-a79d-8361724acc4f from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:25:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:25:52 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:25:52 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:25:52 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:25:52 user nova-compute[75071]:   <serial>8d98c578-f422-4d01-a4e7-b72702b3a23b</serial>
Dec 05 12:25:52 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:25:52 user nova-compute[75071]: </disk>
Dec 05 12:25:52 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:25:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 17348e17-fde4-49b9-a79d-8361724acc4f {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:25:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgSTEoiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:25:58 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:25:58 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:25:58 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[492a32f9-bf05-4ed0-b922-f684e2d3574e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:25:58 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bf6146-fc72-4c91-a476-f6e04ea3bf53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98] added
Dec 05 12:25:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ade2a9-62fc-4179-833f-98e617493b83]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9417e34-15d9-446b-a81d-80da9a5ff746]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XgSTEoiP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XgSTEoiP" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[118053f8-df11-475a-8341-fa91441b0fbb]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XgSTEoiP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f8ad19-04e8-4cf7-b81d-bf5e432daabd]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e76839-e2e0-4f5c-9880-675449bcdbf7]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:25:58 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b (non-flash)
Dec 05 12:25:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:25:58 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b (non-flash)
Dec 05 12:25:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[052b35e6-c44d-435b-8832-6560938419cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98, portal: 172.16.0.220,3260]
Dec 05 12:25:58 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98, portal: 172.16.0.220,3260] successful.
Dec 05 12:25:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[566f0eff-3fb8-4a77-ac07-bd917a1ba7ce]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3810985c-4ad3-408d-a802-9b273cbfcfab]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:25:58 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b (non-flash)
Dec 05 12:25:58 user nova-compute[75071]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:25:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:25:58 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b (non-flash)
Dec 05 12:25:58 user nova-compute[75071]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:25:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d6dfb5-a2e2-48bf-bdf2-11e048665af9]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:25:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgSTEoiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:25:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:25:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23333356430306237', 'path': '/dev/sdd'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:25:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333356430306237', 'path': '/dev/sdd'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:25:59 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lazy-loading 'flavor' on Instance uuid 386e93a2-2435-4d5f-bee2-fdb5f52fd476 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:25:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:25:59 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:25:59 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Dec 05 12:25:59 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:25:59 user nova-compute[75071]:   <serial>17e7e797-0041-4e40-93bc-c90c42e45a98</serial>
Dec 05 12:25:59 user nova-compute[75071]: </disk>
Dec 05 12:25:59 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:26:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:26:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:26:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] No VIF found with MAC fa:16:3e:c5:10:6a, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:26:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6600893f-6611-43cd-8120-75745d0b415d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.075s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG nova.objects.instance [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lazy-loading 'flavor' on Instance uuid c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:02 user nova-compute[75071]: INFO nova.compute.manager [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Attaching volume 48cf8d9f-f91d-4855-b810-453ede3eb546 to /dev/vdb
Dec 05 12:26:02 user nova-compute[75071]: DEBUG os_brick.utils [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e64fd3-678e-4b79-ad0f-bd901e6241eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7745d34a-699f-4131-a75d-4580467d91d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2a4bf7-23cd-4381-88d1-ac762aa148c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ca1bad-767a-43e7-a5ea-8f6e8d6db5aa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:26:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:26:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:26:03 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:26:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56f0d67-1c88-4485-8895-a742e5554ecc]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:26:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:26:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:26:03 user nova-compute[75071]: DEBUG os_brick.utils [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] <== get_connector_properties: return (103ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:26:03 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Updating existing volume attachment record: 047ff9ec-bae3-4043-924d-b0315e92e752 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquiring lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquiring lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:06 user nova-compute[75071]: INFO nova.compute.manager [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Terminating instance
Dec 05 12:26:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-7d76e45c-d0b4-44a5-a0ba-b0d43a6fd9ea req-1ed11b2d-f1ef-46b5-a6f7-040028f1aa4d service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received event network-vif-unplugged-1219420b-24a0-435b-aaa4-283c51d9a847 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7d76e45c-d0b4-44a5-a0ba-b0d43a6fd9ea req-1ed11b2d-f1ef-46b5-a6f7-040028f1aa4d service nova] Acquiring lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7d76e45c-d0b4-44a5-a0ba-b0d43a6fd9ea req-1ed11b2d-f1ef-46b5-a6f7-040028f1aa4d service nova] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7d76e45c-d0b4-44a5-a0ba-b0d43a6fd9ea req-1ed11b2d-f1ef-46b5-a6f7-040028f1aa4d service nova] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-7d76e45c-d0b4-44a5-a0ba-b0d43a6fd9ea req-1ed11b2d-f1ef-46b5-a6f7-040028f1aa4d service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] No waiting events found dispatching network-vif-unplugged-1219420b-24a0-435b-aaa4-283c51d9a847 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-7d76e45c-d0b4-44a5-a0ba-b0d43a6fd9ea req-1ed11b2d-f1ef-46b5-a6f7-040028f1aa4d service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received event network-vif-unplugged-1219420b-24a0-435b-aaa4-283c51d9a847 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Instance destroyed successfully.
Dec 05 12:26:06 user nova-compute[75071]: DEBUG nova.objects.instance [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lazy-loading 'resources' on Instance uuid 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-05T12:22:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1053518687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1053518687',id=20,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEz9ElrhNZZvItqxGapQtmVbaKvJMnHtVQyBhczgKvaO8d/GBJ06KdbJMsPoiJPdFlj8W+R0Nu4rD1BhABN0XoGYod9pe9msGHytqCXlWqPOlmLX9S/AlygQdInxVYWU+Q==',key_name='tempest-keypair-1649114374',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:22:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6041024288a84808858ed4938f83fee5',ramdisk_id='',reservation_id='r-v4p52h60',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1076524669',owner_user_name='tempest-TaggedAttachmentsTest-1076524669-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:22:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a361c08c15664fbd880f06b487d62aa6',uuid=26cff7c2-b2a8-4a33-a2a0-3a63a2073d21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1219420b-24a0-435b-aaa4-283c51d9a847", "address": "fa:16:3e:f4:b1:b4", "network": {"id": "18d0b7e0-69a8-4771-8e3a-665d0b5d2c75", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1386912740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219420b-24", "ovs_interfaceid": "1219420b-24a0-435b-aaa4-283c51d9a847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Converting VIF {"id": "1219420b-24a0-435b-aaa4-283c51d9a847", "address": "fa:16:3e:f4:b1:b4", "network": {"id": "18d0b7e0-69a8-4771-8e3a-665d0b5d2c75", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1386912740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6041024288a84808858ed4938f83fee5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1219420b-24", "ovs_interfaceid": "1219420b-24a0-435b-aaa4-283c51d9a847", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:b1:b4,bridge_name='br-int',has_traffic_filtering=True,id=1219420b-24a0-435b-aaa4-283c51d9a847,network=Network(18d0b7e0-69a8-4771-8e3a-665d0b5d2c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219420b-24') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG os_vif [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:b1:b4,bridge_name='br-int',has_traffic_filtering=True,id=1219420b-24a0-435b-aaa4-283c51d9a847,network=Network(18d0b7e0-69a8-4771-8e3a-665d0b5d2c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219420b-24') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1219420b-24, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb365763-5bb8-40fd-a9d1-24913665e08d) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:26:06 user nova-compute[75071]: INFO os_vif [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:b1:b4,bridge_name='br-int',has_traffic_filtering=True,id=1219420b-24a0-435b-aaa4-283c51d9a847,network=Network(18d0b7e0-69a8-4771-8e3a-665d0b5d2c75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1219420b-24')
Dec 05 12:26:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Deleting instance files /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21_del
Dec 05 12:26:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Deletion of /opt/stack/data/nova/instances/26cff7c2-b2a8-4a33-a2a0-3a63a2073d21_del complete
Dec 05 12:26:06 user nova-compute[75071]: INFO nova.compute.manager [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 05 12:26:06 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:26:06 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:26:07 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:26:07 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Took 1.01 seconds to deallocate network for instance.
Dec 05 12:26:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-09014457-f8d3-49b3-8c1b-d73fc9a84040 req-31da82fe-b833-4caf-afb2-11ec102c9caa service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received event network-changed-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-09014457-f8d3-49b3-8c1b-d73fc9a84040 req-31da82fe-b833-4caf-afb2-11ec102c9caa service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Refreshing instance network info cache due to event network-changed-580a2511-2f94-4e37-af8e-3a3b72654b35. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:26:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-09014457-f8d3-49b3-8c1b-d73fc9a84040 req-31da82fe-b833-4caf-afb2-11ec102c9caa service nova] Acquiring lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:26:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-09014457-f8d3-49b3-8c1b-d73fc9a84040 req-31da82fe-b833-4caf-afb2-11ec102c9caa service nova] Acquired lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:26:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-09014457-f8d3-49b3-8c1b-d73fc9a84040 req-31da82fe-b833-4caf-afb2-11ec102c9caa service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Refreshing network info cache for port 580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:26:08 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:26:08 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:26:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:08 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Deleted allocations for instance 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21
Dec 05 12:26:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-e12dc29e-061b-4844-bf73-f29b1ea637f1 req-a2204cca-535b-47a8-be3a-c296965faf49 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received event network-vif-plugged-1219420b-24a0-435b-aaa4-283c51d9a847 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e12dc29e-061b-4844-bf73-f29b1ea637f1 req-a2204cca-535b-47a8-be3a-c296965faf49 service nova] Acquiring lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e12dc29e-061b-4844-bf73-f29b1ea637f1 req-a2204cca-535b-47a8-be3a-c296965faf49 service nova] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e12dc29e-061b-4844-bf73-f29b1ea637f1 req-a2204cca-535b-47a8-be3a-c296965faf49 service nova] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-e12dc29e-061b-4844-bf73-f29b1ea637f1 req-a2204cca-535b-47a8-be3a-c296965faf49 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] No waiting events found dispatching network-vif-plugged-1219420b-24a0-435b-aaa4-283c51d9a847 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:26:08 user nova-compute[75071]: WARNING nova.compute.manager [req-e12dc29e-061b-4844-bf73-f29b1ea637f1 req-a2204cca-535b-47a8-be3a-c296965faf49 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received unexpected event network-vif-plugged-1219420b-24a0-435b-aaa4-283c51d9a847 for instance with vm_state deleted and task_state None.
Dec 05 12:26:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-e12dc29e-061b-4844-bf73-f29b1ea637f1 req-a2204cca-535b-47a8-be3a-c296965faf49 service nova] [instance: 26cff7c2-b2a8-4a33-a2a0-3a63a2073d21] Received event network-vif-deleted-1219420b-24a0-435b-aaa4-283c51d9a847 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-517e5d9a-d0af-4551-b293-d7d2e74ef72d tempest-TaggedAttachmentsTest-1076524669 tempest-TaggedAttachmentsTest-1076524669-project-member] Lock "26cff7c2-b2a8-4a33-a2a0-3a63a2073d21" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.375s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-09014457-f8d3-49b3-8c1b-d73fc9a84040 req-31da82fe-b833-4caf-afb2-11ec102c9caa service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Updated VIF entry in instance network info cache for port 580a2511-2f94-4e37-af8e-3a3b72654b35. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:26:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-09014457-f8d3-49b3-8c1b-d73fc9a84040 req-31da82fe-b833-4caf-afb2-11ec102c9caa service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Updating instance_info_cache with network_info: [{"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:26:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-09014457-f8d3-49b3-8c1b-d73fc9a84040 req-31da82fe-b833-4caf-afb2-11ec102c9caa service nova] Releasing lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Acquiring lock "9656e5d1-8fde-4a19-991c-211868fa5c91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Lock "9656e5d1-8fde-4a19-991c-211868fa5c91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Acquiring lock "9656e5d1-8fde-4a19-991c-211868fa5c91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Lock "9656e5d1-8fde-4a19-991c-211868fa5c91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Lock "9656e5d1-8fde-4a19-991c-211868fa5c91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:09 user nova-compute[75071]: INFO nova.compute.manager [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Terminating instance
Dec 05 12:26:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:26:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Instance destroyed successfully.
Dec 05 12:26:10 user nova-compute[75071]: DEBUG nova.objects.instance [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Lazy-loading 'resources' on Instance uuid 9656e5d1-8fde-4a19-991c-211868fa5c91 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1212614315',display_name='tempest-VolumesNegativeTest-instance-1212614315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1212614315',id=24,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:24:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3579bec934044881a26b5b396a8ab0d2',ramdisk_id='',reservation_id='r-l50wh9s0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-102609202',owner_user_name='tempest-VolumesNegativeTest-102609202-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:24:27Z,user_data=None,user_id='aa483ae6045044f79ffd2b1abbc53b7f',uuid=9656e5d1-8fde-4a19-991c-211868fa5c91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6d3f295-2730-49ff-833f-fe9c55982a13", "address": "fa:16:3e:b4:20:de", "network": {"id": "a4b18234-057b-4055-9a64-f1ed0b9d3437", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a819537618b54160ae57eb9baebc65fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d3f295-27", "ovs_interfaceid": "e6d3f295-2730-49ff-833f-fe9c55982a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Converting VIF {"id": "e6d3f295-2730-49ff-833f-fe9c55982a13", "address": "fa:16:3e:b4:20:de", "network": {"id": "a4b18234-057b-4055-9a64-f1ed0b9d3437", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a819537618b54160ae57eb9baebc65fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6d3f295-27", "ovs_interfaceid": "e6d3f295-2730-49ff-833f-fe9c55982a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:20:de,bridge_name='br-int',has_traffic_filtering=True,id=e6d3f295-2730-49ff-833f-fe9c55982a13,network=Network(a4b18234-057b-4055-9a64-f1ed0b9d3437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d3f295-27') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG os_vif [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:20:de,bridge_name='br-int',has_traffic_filtering=True,id=e6d3f295-2730-49ff-833f-fe9c55982a13,network=Network(a4b18234-057b-4055-9a64-f1ed0b9d3437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d3f295-27') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6d3f295-27, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47714b83-3eba-49a4-9d65-78f5eea9c17f) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-4d1ab5d6-603c-4736-a3d8-4eac77087e25 req-73a78504-406c-460d-8764-f06dd7f42af2 service nova] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Received event network-vif-unplugged-e6d3f295-2730-49ff-833f-fe9c55982a13 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4d1ab5d6-603c-4736-a3d8-4eac77087e25 req-73a78504-406c-460d-8764-f06dd7f42af2 service nova] Acquiring lock "9656e5d1-8fde-4a19-991c-211868fa5c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4d1ab5d6-603c-4736-a3d8-4eac77087e25 req-73a78504-406c-460d-8764-f06dd7f42af2 service nova] Lock "9656e5d1-8fde-4a19-991c-211868fa5c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4d1ab5d6-603c-4736-a3d8-4eac77087e25 req-73a78504-406c-460d-8764-f06dd7f42af2 service nova] Lock "9656e5d1-8fde-4a19-991c-211868fa5c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-4d1ab5d6-603c-4736-a3d8-4eac77087e25 req-73a78504-406c-460d-8764-f06dd7f42af2 service nova] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] No waiting events found dispatching network-vif-unplugged-e6d3f295-2730-49ff-833f-fe9c55982a13 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-4d1ab5d6-603c-4736-a3d8-4eac77087e25 req-73a78504-406c-460d-8764-f06dd7f42af2 service nova] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Received event network-vif-unplugged-e6d3f295-2730-49ff-833f-fe9c55982a13 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:26:10 user nova-compute[75071]: INFO os_vif [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:20:de,bridge_name='br-int',has_traffic_filtering=True,id=e6d3f295-2730-49ff-833f-fe9c55982a13,network=Network(a4b18234-057b-4055-9a64-f1ed0b9d3437),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6d3f295-27')
Dec 05 12:26:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Deleting instance files /opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91_del
Dec 05 12:26:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Deletion of /opt/stack/data/nova/instances/9656e5d1-8fde-4a19-991c-211868fa5c91_del complete
Dec 05 12:26:10 user nova-compute[75071]: INFO nova.compute.manager [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Took 0.67 seconds to destroy the instance on the hypervisor.
Dec 05 12:26:10 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:26:10 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:26:11 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:26:11 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Took 0.52 seconds to deallocate network for instance.
Dec 05 12:26:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:11 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:26:11 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:26:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:11 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Deleted allocations for instance 9656e5d1-8fde-4a19-991c-211868fa5c91
Dec 05 12:26:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-59dcf1c9-e5b7-4850-8849-2583c8fe1ae2 tempest-VolumesNegativeTest-102609202 tempest-VolumesNegativeTest-102609202-project-member] Lock "9656e5d1-8fde-4a19-991c-211868fa5c91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.696s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-1e649f84-99dd-4a4f-ba45-faacd2e241cf req-cc4e70a2-e70a-4669-b8a2-1c6947b9f12a service nova] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Received event network-vif-plugged-e6d3f295-2730-49ff-833f-fe9c55982a13 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1e649f84-99dd-4a4f-ba45-faacd2e241cf req-cc4e70a2-e70a-4669-b8a2-1c6947b9f12a service nova] Acquiring lock "9656e5d1-8fde-4a19-991c-211868fa5c91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1e649f84-99dd-4a4f-ba45-faacd2e241cf req-cc4e70a2-e70a-4669-b8a2-1c6947b9f12a service nova] Lock "9656e5d1-8fde-4a19-991c-211868fa5c91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1e649f84-99dd-4a4f-ba45-faacd2e241cf req-cc4e70a2-e70a-4669-b8a2-1c6947b9f12a service nova] Lock "9656e5d1-8fde-4a19-991c-211868fa5c91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-1e649f84-99dd-4a4f-ba45-faacd2e241cf req-cc4e70a2-e70a-4669-b8a2-1c6947b9f12a service nova] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] No waiting events found dispatching network-vif-plugged-e6d3f295-2730-49ff-833f-fe9c55982a13 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:26:12 user nova-compute[75071]: WARNING nova.compute.manager [req-1e649f84-99dd-4a4f-ba45-faacd2e241cf req-cc4e70a2-e70a-4669-b8a2-1c6947b9f12a service nova] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Received unexpected event network-vif-plugged-e6d3f295-2730-49ff-833f-fe9c55982a13 for instance with vm_state deleted and task_state None.
Dec 05 12:26:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-1e649f84-99dd-4a4f-ba45-faacd2e241cf req-cc4e70a2-e70a-4669-b8a2-1c6947b9f12a service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received event network-changed-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-1e649f84-99dd-4a4f-ba45-faacd2e241cf req-cc4e70a2-e70a-4669-b8a2-1c6947b9f12a service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Refreshing instance network info cache due to event network-changed-580a2511-2f94-4e37-af8e-3a3b72654b35. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1e649f84-99dd-4a4f-ba45-faacd2e241cf req-cc4e70a2-e70a-4669-b8a2-1c6947b9f12a service nova] Acquiring lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1e649f84-99dd-4a4f-ba45-faacd2e241cf req-cc4e70a2-e70a-4669-b8a2-1c6947b9f12a service nova] Acquired lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG nova.network.neutron [req-1e649f84-99dd-4a4f-ba45-faacd2e241cf req-cc4e70a2-e70a-4669-b8a2-1c6947b9f12a service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Refreshing network info cache for port 580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNozAuVF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:26:12 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:26:12 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:26:12 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7867e372-1b66-4b9b-a535-c907a98bc405]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:26:12 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[074175f8-b119-4461-acc9-615f833d26d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546] added
Dec 05 12:26:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7320426b-2203-4523-aacb-373151499137]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd1bd94-60b4-4ebf-a2b1-9beb9a7985a0]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNozAuVF {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNozAuVF" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a788579-487c-4ccd-bbd1-105fc61eff81]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kNozAuVF'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fcb779-9688-4bd8-b041-294fdc7136de]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67a77ae-db8e-4ee6-9d4e-3474ceef4f0b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:26:12 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b (non-flash)
Dec 05 12:26:12 user nova-compute[75071]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:26:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:26:12 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b (non-flash)
Dec 05 12:26:12 user nova-compute[75071]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:26:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5174c90-d371-4628-9242-d9f3be401a99]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260]
Dec 05 12:26:12 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260] successful.
Dec 05 12:26:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[218cabbb-d5b1-4706-825f-bbaefecfdb19]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[17157c98-ba7c-4f37-8eab-93fe7d699fcc]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:26:12 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b (non-flash)
Dec 05 12:26:12 user nova-compute[75071]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:26:12 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:26:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:26:12 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b (non-flash)
Dec 05 12:26:12 user nova-compute[75071]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:26:12 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:26:12 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12b3d2e-f2c8-4809-89be-80c6947db6d2]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG nova.network.neutron [req-1e649f84-99dd-4a4f-ba45-faacd2e241cf req-cc4e70a2-e70a-4669-b8a2-1c6947b9f12a service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Updated VIF entry in instance network info cache for port 580a2511-2f94-4e37-af8e-3a3b72654b35. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG nova.network.neutron [req-1e649f84-99dd-4a4f-ba45-faacd2e241cf req-cc4e70a2-e70a-4669-b8a2-1c6947b9f12a service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Updating instance_info_cache with network_info: [{"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1e649f84-99dd-4a4f-ba45-faacd2e241cf req-cc4e70a2-e70a-4669-b8a2-1c6947b9f12a service nova] Releasing lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-1e649f84-99dd-4a4f-ba45-faacd2e241cf req-cc4e70a2-e70a-4669-b8a2-1c6947b9f12a service nova] [instance: 9656e5d1-8fde-4a19-991c-211868fa5c91] Received event network-vif-deleted-e6d3f295-2730-49ff-833f-fe9c55982a13 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:12 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 17348e17-fde4-49b9-a79d-8361724acc4f is timed out.
Dec 05 12:26:12 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Successfully detached device vdb from instance 17348e17-fde4-49b9-a79d-8361724acc4f from the live domain config.
Dec 05 12:26:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uiXHkbtF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:26:12 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:26:12 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNozAuVF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26530306139333763', 'path': '/dev/sde'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530306139333763', 'path': '/dev/sde'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.919s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG nova.objects.instance [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lazy-loading 'flavor' on Instance uuid c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e68f43b-0457-4f37-b3f0-6faf321da568]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:26:13 user nova-compute[75071]: No targets found.
Dec 05 12:26:13 user nova-compute[75071]: iSNS:
Dec 05 12:26:13 user nova-compute[75071]: No targets found.
Dec 05 12:26:13 user nova-compute[75071]: STATIC:
Dec 05 12:26:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98
Dec 05 12:26:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:26:13 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:26:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b
Dec 05 12:26:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:26:13 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:26:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:26:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:26:13 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:26:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546
Dec 05 12:26:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:26:13 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:26:13 user nova-compute[75071]: FIRMWARE:
Dec 05 12:26:13 user nova-compute[75071]: No targets found.
Dec 05 12:26:13 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:26:13 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:26:13 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:26:13 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:26:13 user nova-compute[75071]:   <source dev="/dev/sde"/>
Dec 05 12:26:13 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:26:13 user nova-compute[75071]:   <serial>48cf8d9f-f91d-4855-b810-453ede3eb546</serial>
Dec 05 12:26:13 user nova-compute[75071]: </disk>
Dec 05 12:26:13 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0a3b85-a778-4076-856f-00c537b97c1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3c32c4-771e-4a3b-8e11-3bfe4056f96b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:26:13 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b (non-flash)
Dec 05 12:26:13 user nova-compute[75071]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:26:13 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:26:13 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:26:13 user nova-compute[75071]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b (non-flash)
Dec 05 12:26:13 user nova-compute[75071]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:26:13 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:26:13 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f827c1dc8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf64715f-b9aa-4694-90a2-485eef43bbce]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[22de5860-6c51-4fad-8632-74e69a483d45]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c89604b-00d9-4767-ba82-cf1cfd37aafa]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6e5aa9-4bed-43f0-b680-f877fc6b5628]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6d5cc5-f092-4975-b770-1f4f32c007b0]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2702379e-5ce8-4dd8-9cce-8f4edc81eef0]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b, portal: 172.16.0.220,3260]
Dec 05 12:26:14 user nova-compute[75071]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b, portal: 172.16.0.220,3260] successful.
Dec 05 12:26:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d98c578-f422-4d01-a4e7-b72702b3a23b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1206e7d8-6b45-4042-9da1-d2989ff9351d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] <== disconnect_volume: return (1235ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] No VIF found with MAC fa:16:3e:de:d7:62, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:26:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5abecf14-20c4-4448-9d0a-2feee943233f tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.676s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:15 user nova-compute[75071]: DEBUG nova.objects.instance [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lazy-loading 'flavor' on Instance uuid 17348e17-fde4-49b9-a79d-8361724acc4f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:26:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf1746b7-87c8-481a-8d3f-4488fe427ac9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "17348e17-fde4-49b9-a79d-8361724acc4f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.850s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:15 user nova-compute[75071]: INFO nova.compute.manager [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Rebooting instance
Dec 05 12:26:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquired lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG nova.network.neutron [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Stashing vm_state: active {{(pid=75071) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG nova.network.neutron [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Updating instance_info_cache with network_info: [{"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Releasing lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG nova.compute.manager [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:26:16 user nova-compute[75071]: INFO nova.compute.claims [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Claim successful on node user
Dec 05 12:26:16 user nova-compute[75071]: INFO nova.compute.resource_tracker [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Updating resource usage from migration cb889f27-40cc-4594-8c24-ab4a23f7cda9
Dec 05 12:26:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.400s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:16 user nova-compute[75071]: INFO nova.compute.manager [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Migrating
Dec 05 12:26:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-b32c26d3-91fd-4612-84e4-26c5eecfcb5e req-d95f9810-c47d-4359-9c98-9a5f1330d5ae service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received event network-vif-unplugged-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b32c26d3-91fd-4612-84e4-26c5eecfcb5e req-d95f9810-c47d-4359-9c98-9a5f1330d5ae service nova] Acquiring lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b32c26d3-91fd-4612-84e4-26c5eecfcb5e req-d95f9810-c47d-4359-9c98-9a5f1330d5ae service nova] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b32c26d3-91fd-4612-84e4-26c5eecfcb5e req-d95f9810-c47d-4359-9c98-9a5f1330d5ae service nova] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-b32c26d3-91fd-4612-84e4-26c5eecfcb5e req-d95f9810-c47d-4359-9c98-9a5f1330d5ae service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] No waiting events found dispatching network-vif-unplugged-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:26:16 user nova-compute[75071]: WARNING nova.compute.manager [req-b32c26d3-91fd-4612-84e4-26c5eecfcb5e req-d95f9810-c47d-4359-9c98-9a5f1330d5ae service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received unexpected event network-vif-unplugged-580a2511-2f94-4e37-af8e-3a3b72654b35 for instance with vm_state active and task_state reboot_started_hard.
Dec 05 12:26:16 user nova-compute[75071]: INFO nova.compute.rpcapi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Dec 05 12:26:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquired lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:26:16 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Updating instance_info_cache with network_info: [{"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Releasing lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:26:17 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Instance destroyed successfully.
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.objects.instance [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lazy-loading 'resources' on Instance uuid 386e93a2-2435-4d5f-bee2-fdb5f52fd476 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1840068028',display_name='tempest-TestMinimumBasicScenario-server-1840068028',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1840068028',id=23,image_ref='dadec85f-a232-41ae-a859-c4f45f17f685',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgYMh9m/slisf+9eEjgMwJqp26BZoxHiS18Q50W2wVpua8bBzoOPb8JZBddNfzVLxaFl9d7uvsRsNK9UBDNxU25Bg3r71t7m+QxWjc+CF2KmO3pHsDIjEe7HS4xaBQ2gQ==',key_name='tempest-TestMinimumBasicScenario-459970224',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:24:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b9ac01e22eb428885981285a18f34fc',ramdisk_id='',reservation_id='r-oa91ac1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dadec85f-a232-41ae-a859-c4f45f17f685',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-901409176',owner_user_name='tempest-TestMinimumBasicScenario-901409176-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:26:17Z,user_data=None,user_id='1feef67013ea4c4db4be3a352eeaec7f',uuid=386e93a2-2435-4d5f-bee2-fdb5f52fd476,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Converting VIF {"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=580a2511-2f94-4e37-af8e-3a3b72654b35,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580a2511-2f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_vif [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=580a2511-2f94-4e37-af8e-3a3b72654b35,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580a2511-2f') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap580a2511-2f, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9136db2f-541e-4bd6-ad36-504e6adb4c87) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:17 user nova-compute[75071]: INFO os_vif [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=580a2511-2f94-4e37-af8e-3a3b72654b35,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580a2511-2f')
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgSTEoiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:26:17 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e429b6db-a612-4dfd-8615-436c00795ac9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:26:17 user nova-compute[75071]: No targets found.
Dec 05 12:26:17 user nova-compute[75071]: iSNS:
Dec 05 12:26:17 user nova-compute[75071]: No targets found.
Dec 05 12:26:17 user nova-compute[75071]: STATIC:
Dec 05 12:26:17 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98
Dec 05 12:26:17 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:26:17 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:26:17 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:26:17 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:26:17 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:26:17 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546
Dec 05 12:26:17 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:26:17 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:26:17 user nova-compute[75071]: FIRMWARE:
Dec 05 12:26:17 user nova-compute[75071]: No targets found.
Dec 05 12:26:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:26:17 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:26:17 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d198acb-4b3e-43cf-9f9a-a6fd1dae5f16]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Starting migrate_disk_and_power_off {{(pid=75071) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11481}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[46af32f5-9ccc-4c72-8b88-337f8971a9ac]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:26:17 user nova-compute[75071]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:26:17 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:26:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:26:17 user nova-compute[75071]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:26:17 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:26:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82742565f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98'): ({'sdd'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Removing single pathed devices sdd {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[af64f4fd-bc11-4982-9e0c-e9e9cbc88e91]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54adf18-d13b-4d8f-8f8a-2e4a0be37067]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Flushing IO for device /dev/sdd {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28195bf-7a9b-4990-9c50-587a95c87f55]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4eb78ac-585b-4044-b127-7180d0319291]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0862ec17-62a3-4946-b5ad-84f7a083090b]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[925bea0c-595e-4105-8f12-97fa39337169]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98, portal: 172.16.0.220,3260]
Dec 05 12:26:17 user nova-compute[75071]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98, portal: 172.16.0.220,3260] successful.
Dec 05 12:26:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[194504fc-042d-4a42-b84b-57dbf0f3c7f6]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] <== disconnect_volume: return (336ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Start _get_guest_xml network_info=[{"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dadec85f-a232-41ae-a859-c4f45f17f685,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'dadec85f-a232-41ae-a859-c4f45f17f685'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '52c4fe08-8d92-4fda-8a37-d9f7b2e4fa27', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgSTEoiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '386e93a2-2435-4d5f-bee2-fdb5f52fd476', 'attached_at': '', 'detached_at': '', 'volume_id': '17e7e797-0041-4e40-93bc-c90c42e45a98', 'serial': '17e7e797-0041-4e40-93bc-c90c42e45a98'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:26:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:26:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dadec85f-a232-41ae-a859-c4f45f17f685,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.objects.instance [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lazy-loading 'vcpu_model' on Instance uuid 386e93a2-2435-4d5f-bee2-fdb5f52fd476 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.objects.base [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Object Instance<386e93a2-2435-4d5f-bee2-fdb5f52fd476> lazy-loaded attributes: resources,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgSTEoiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:26:17 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:26:17 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:26:17 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac41f1b2-4b03-4184-b742-b9ba118d7006]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:26:17 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c398d1-adcf-4722-b707-f2c9f1acc7ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98] added
Dec 05 12:26:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[047e94fb-7fca-4587-a88b-e167ef798489]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d295870-d092-409c-b504-bfbe453ff1c1]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XgSTEoiP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XgSTEoiP" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd242b9b-a12e-4992-979a-7a95263c1640]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XgSTEoiP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9757c10f-aa50-42e1-8262-2eedf612d114]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[16827489-b7f0-4626-98d6-7d9fa3b3734a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:26:18 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:26:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:26:18 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:26:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e164fb47-03da-4cbc-8dfc-be50d6a6954d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98, portal: 172.16.0.220,3260]
Dec 05 12:26:18 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98, portal: 172.16.0.220,3260] successful.
Dec 05 12:26:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[919169a7-9cda-48d5-af99-84d8a192aa25]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c6777d-7a2f-4dda-bd8f-000024981b94]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:26:18 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:26:18 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:26:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:26:18 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:26:18 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:26:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dcdf24-4b49-4deb-973c-30314371476b]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgSTEoiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:26:18 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Instance destroyed successfully.
Dec 05 12:26:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:22:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-610057875',display_name='tempest-ServerActionsTestOtherB-server-610057875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-610057875',id=19,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD//5LMlmnSypPzSdRI5jpZ9XqSwL0meBfIrwjAimv5kjQelxMdWSK8Bf7Pi316SOZkmu0iNhVkGJ6EvGf+c87dPNcnj3FJiHI1f2q3NnaFYTTYG6q/U8Y9vdkHGXYuKCg==',key_name='tempest-keypair-186552237',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:22:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ee29a575739045dd9db612290cfa9620',ramdisk_id='',reservation_id='r-0dy2tt38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1001076821',owner_user_name='tempest-ServerActionsTestOtherB-1001076821-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:26:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a213d662f65e41fa8cc3a20e736ca757',uuid=c89c29d3-b60e-4dc5-a895-f9fe84ed69a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1949724505-network", "vif_mac": "fa:16:3e:de:d7:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Converting VIF {"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1949724505-network", "vif_mac": "fa:16:3e:de:d7:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG os_vif [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5077ca66-d7, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f8a5e4c-b4f9-4643-923b-44502424a2f3) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:18 user nova-compute[75071]: INFO os_vif [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7')
Dec 05 12:26:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNozAuVF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:26:18 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:26:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-9359801f-294c-4ad8-b4f3-a7ddf3eb2f13 req-e0648176-f061-479e-bdd8-ebc5b94c6ca3 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received event network-vif-plugged-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9359801f-294c-4ad8-b4f3-a7ddf3eb2f13 req-e0648176-f061-479e-bdd8-ebc5b94c6ca3 service nova] Acquiring lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9359801f-294c-4ad8-b4f3-a7ddf3eb2f13 req-e0648176-f061-479e-bdd8-ebc5b94c6ca3 service nova] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9359801f-294c-4ad8-b4f3-a7ddf3eb2f13 req-e0648176-f061-479e-bdd8-ebc5b94c6ca3 service nova] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-9359801f-294c-4ad8-b4f3-a7ddf3eb2f13 req-e0648176-f061-479e-bdd8-ebc5b94c6ca3 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] No waiting events found dispatching network-vif-plugged-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:26:18 user nova-compute[75071]: WARNING nova.compute.manager [req-9359801f-294c-4ad8-b4f3-a7ddf3eb2f13 req-e0648176-f061-479e-bdd8-ebc5b94c6ca3 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received unexpected event network-vif-plugged-580a2511-2f94-4e37-af8e-3a3b72654b35 for instance with vm_state active and task_state reboot_started_hard.
Dec 05 12:26:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-9359801f-294c-4ad8-b4f3-a7ddf3eb2f13 req-e0648176-f061-479e-bdd8-ebc5b94c6ca3 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-unplugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9359801f-294c-4ad8-b4f3-a7ddf3eb2f13 req-e0648176-f061-479e-bdd8-ebc5b94c6ca3 service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9359801f-294c-4ad8-b4f3-a7ddf3eb2f13 req-e0648176-f061-479e-bdd8-ebc5b94c6ca3 service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9359801f-294c-4ad8-b4f3-a7ddf3eb2f13 req-e0648176-f061-479e-bdd8-ebc5b94c6ca3 service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-9359801f-294c-4ad8-b4f3-a7ddf3eb2f13 req-e0648176-f061-479e-bdd8-ebc5b94c6ca3 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-unplugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:26:18 user nova-compute[75071]: WARNING nova.compute.manager [req-9359801f-294c-4ad8-b4f3-a7ddf3eb2f13 req-e0648176-f061-479e-bdd8-ebc5b94c6ca3 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received unexpected event network-vif-unplugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with vm_state active and task_state resize_migrating.
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-9359801f-294c-4ad8-b4f3-a7ddf3eb2f13 req-e0648176-f061-479e-bdd8-ebc5b94c6ca3 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9359801f-294c-4ad8-b4f3-a7ddf3eb2f13 req-e0648176-f061-479e-bdd8-ebc5b94c6ca3 service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9359801f-294c-4ad8-b4f3-a7ddf3eb2f13 req-e0648176-f061-479e-bdd8-ebc5b94c6ca3 service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9359801f-294c-4ad8-b4f3-a7ddf3eb2f13 req-e0648176-f061-479e-bdd8-ebc5b94c6ca3 service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-9359801f-294c-4ad8-b4f3-a7ddf3eb2f13 req-e0648176-f061-479e-bdd8-ebc5b94c6ca3 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:26:19 user nova-compute[75071]: WARNING nova.compute.manager [req-9359801f-294c-4ad8-b4f3-a7ddf3eb2f13 req-e0648176-f061-479e-bdd8-ebc5b94c6ca3 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received unexpected event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with vm_state active and task_state resize_migrating.
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23333356430306237', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333356430306237', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.860s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e1d804-ec4a-4843-868b-044437a003e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:26:19 user nova-compute[75071]: No targets found.
Dec 05 12:26:19 user nova-compute[75071]: iSNS:
Dec 05 12:26:19 user nova-compute[75071]: No targets found.
Dec 05 12:26:19 user nova-compute[75071]: STATIC:
Dec 05 12:26:19 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98
Dec 05 12:26:19 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:26:19 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:26:19 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:26:19 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:26:19 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:26:19 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546
Dec 05 12:26:19 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:26:19 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:26:19 user nova-compute[75071]: FIRMWARE:
Dec 05 12:26:19 user nova-compute[75071]: No targets found.
Dec 05 12:26:19 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:26:19 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:26:19 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1840068028',display_name='tempest-TestMinimumBasicScenario-server-1840068028',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1840068028',id=23,image_ref='dadec85f-a232-41ae-a859-c4f45f17f685',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgYMh9m/slisf+9eEjgMwJqp26BZoxHiS18Q50W2wVpua8bBzoOPb8JZBddNfzVLxaFl9d7uvsRsNK9UBDNxU25Bg3r71t7m+QxWjc+CF2KmO3pHsDIjEe7HS4xaBQ2gQ==',key_name='tempest-TestMinimumBasicScenario-459970224',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:24:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b9ac01e22eb428885981285a18f34fc',ramdisk_id='',reservation_id='r-oa91ac1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dadec85f-a232-41ae-a859-c4f45f17f685',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-901409176',owner_user_name='tempest-TestMinimumBasicScenario-901409176-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:26:17Z,user_data=None,user_id='1feef67013ea4c4db4be3a352eeaec7f',uuid=386e93a2-2435-4d5f-bee2-fdb5f52fd476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Converting VIF {"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=580a2511-2f94-4e37-af8e-3a3b72654b35,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580a2511-2f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.objects.instance [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lazy-loading 'pci_devices' on Instance uuid 386e93a2-2435-4d5f-bee2-fdb5f52fd476 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[132e1219-0cce-464c-8261-e73ba77ed2ff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.objects.base [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Object Instance<386e93a2-2435-4d5f-bee2-fdb5f52fd476> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:26:19 user nova-compute[75071]:   <uuid>386e93a2-2435-4d5f-bee2-fdb5f52fd476</uuid>
Dec 05 12:26:19 user nova-compute[75071]:   <name>instance-00000017</name>
Dec 05 12:26:19 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:26:19 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:26:19 user nova-compute[75071]:   <metadata>
Dec 05 12:26:19 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:26:19 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:26:19 user nova-compute[75071]:       <nova:name>tempest-TestMinimumBasicScenario-server-1840068028</nova:name>
Dec 05 12:26:19 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:26:17</nova:creationTime>
Dec 05 12:26:19 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:26:19 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:26:19 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:26:19 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:26:19 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:26:19 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:26:19 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:26:19 user nova-compute[75071]:       <nova:owner>
Dec 05 12:26:19 user nova-compute[75071]:         <nova:user uuid="1feef67013ea4c4db4be3a352eeaec7f">tempest-TestMinimumBasicScenario-901409176-project-member</nova:user>
Dec 05 12:26:19 user nova-compute[75071]:         <nova:project uuid="9b9ac01e22eb428885981285a18f34fc">tempest-TestMinimumBasicScenario-901409176</nova:project>
Dec 05 12:26:19 user nova-compute[75071]:       </nova:owner>
Dec 05 12:26:19 user nova-compute[75071]:       <nova:root type="image" uuid="dadec85f-a232-41ae-a859-c4f45f17f685"/>
Dec 05 12:26:19 user nova-compute[75071]:       <nova:ports>
Dec 05 12:26:19 user nova-compute[75071]:         <nova:port uuid="580a2511-2f94-4e37-af8e-3a3b72654b35">
Dec 05 12:26:19 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 05 12:26:19 user nova-compute[75071]:         </nova:port>
Dec 05 12:26:19 user nova-compute[75071]:       </nova:ports>
Dec 05 12:26:19 user nova-compute[75071]:     </nova:instance>
Dec 05 12:26:19 user nova-compute[75071]:   </metadata>
Dec 05 12:26:19 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:26:19 user nova-compute[75071]:     <system>
Dec 05 12:26:19 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:26:19 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:26:19 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:26:19 user nova-compute[75071]:       <entry name="serial">386e93a2-2435-4d5f-bee2-fdb5f52fd476</entry>
Dec 05 12:26:19 user nova-compute[75071]:       <entry name="uuid">386e93a2-2435-4d5f-bee2-fdb5f52fd476</entry>
Dec 05 12:26:19 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:26:19 user nova-compute[75071]:     </system>
Dec 05 12:26:19 user nova-compute[75071]:   </sysinfo>
Dec 05 12:26:19 user nova-compute[75071]:   <os>
Dec 05 12:26:19 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:26:19 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:26:19 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:26:19 user nova-compute[75071]:   </os>
Dec 05 12:26:19 user nova-compute[75071]:   <features>
Dec 05 12:26:19 user nova-compute[75071]:     <acpi/>
Dec 05 12:26:19 user nova-compute[75071]:     <apic/>
Dec 05 12:26:19 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:26:19 user nova-compute[75071]:   </features>
Dec 05 12:26:19 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:26:19 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:26:19 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:26:19 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:26:19 user nova-compute[75071]:   </clock>
Dec 05 12:26:19 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:26:19 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:26:19 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:26:19 user nova-compute[75071]:   </cpu>
Dec 05 12:26:19 user nova-compute[75071]:   <devices>
Dec 05 12:26:19 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:26:19 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:26:19 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk"/>
Dec 05 12:26:19 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:26:19 user nova-compute[75071]:     </disk>
Dec 05 12:26:19 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:26:19 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:26:19 user nova-compute[75071]:       <source dev="/dev/sdb"/>
Dec 05 12:26:19 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Dec 05 12:26:19 user nova-compute[75071]:       <serial>17e7e797-0041-4e40-93bc-c90c42e45a98</serial>
Dec 05 12:26:19 user nova-compute[75071]:     </disk>
Dec 05 12:26:19 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:26:19 user nova-compute[75071]:       <mac address="fa:16:3e:c5:10:6a"/>
Dec 05 12:26:19 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:26:19 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:26:19 user nova-compute[75071]:       <target dev="tap580a2511-2f"/>
Dec 05 12:26:19 user nova-compute[75071]:     </interface>
Dec 05 12:26:19 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:26:19 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/console.log" append="off"/>
Dec 05 12:26:19 user nova-compute[75071]:     </serial>
Dec 05 12:26:19 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:26:19 user nova-compute[75071]:     <video>
Dec 05 12:26:19 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:26:19 user nova-compute[75071]:     </video>
Dec 05 12:26:19 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:26:19 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:26:19 user nova-compute[75071]:     </rng>
Dec 05 12:26:19 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:26:19 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:26:19 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:26:19 user nova-compute[75071]:     </memballoon>
Dec 05 12:26:19 user nova-compute[75071]:   </devices>
Dec 05 12:26:19 user nova-compute[75071]: </domain>
Dec 05 12:26:19 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8176c7-9bc3-4d77-be29-9f4b70b56568]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:26:19 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:26:19 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:26:19 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:26:19 user nova-compute[75071]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:26:19 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:26:19 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82647757e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546'): ({'sde'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Removing single pathed devices sde {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1ec7cb-962b-4442-8047-b4e409392b17]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f583abe-4c5c-4448-afe4-003f2d77cc33]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Flushing IO for device /dev/sde {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbd6e0c-9499-482f-a35d-964cce70d6fd]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c398a3f2-9a42-4418-84e2-7730e3873e69]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7892c1e-23e2-4cfb-8803-e6d07b475f71]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[389e62db-a5d8-4677-9fed-0a8c96845c7c]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260]
Dec 05 12:26:19 user nova-compute[75071]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260] successful.
Dec 05 12:26:19 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d03961-8b40-4a53-a0d5-7189b548d3b8]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] <== disconnect_volume: return (1168ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.objects.instance [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lazy-loading 'trusted_certs' on Instance uuid 386e93a2-2435-4d5f-bee2-fdb5f52fd476 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.objects.base [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Object Instance<386e93a2-2435-4d5f-bee2-fdb5f52fd476> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Checking if we can resize image /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7_resize/disk /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Cannot resize image /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.objects.instance [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lazy-loading 'migration_context' on Instance uuid 386e93a2-2435-4d5f-bee2-fdb5f52fd476 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.objects.base [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Object Instance<386e93a2-2435-4d5f-bee2-fdb5f52fd476> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1840068028',display_name='tempest-TestMinimumBasicScenario-server-1840068028',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1840068028',id=23,image_ref='dadec85f-a232-41ae-a859-c4f45f17f685',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgYMh9m/slisf+9eEjgMwJqp26BZoxHiS18Q50W2wVpua8bBzoOPb8JZBddNfzVLxaFl9d7uvsRsNK9UBDNxU25Bg3r71t7m+QxWjc+CF2KmO3pHsDIjEe7HS4xaBQ2gQ==',key_name='tempest-TestMinimumBasicScenario-459970224',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:24:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='9b9ac01e22eb428885981285a18f34fc',ramdisk_id='',reservation_id='r-oa91ac1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dadec85f-a232-41ae-a859-c4f45f17f685',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-901409176',owner_user_name='tempest-TestMinimumBasicScenario-901409176-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:26:17Z,user_data=None,user_id='1feef67013ea4c4db4be3a352eeaec7f',uuid=386e93a2-2435-4d5f-bee2-fdb5f52fd476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Converting VIF {"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=580a2511-2f94-4e37-af8e-3a3b72654b35,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580a2511-2f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG os_vif [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=580a2511-2f94-4e37-af8e-3a3b72654b35,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580a2511-2f') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93b169ff-62e5-5383-b027-7d0f35b0b0b8', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap580a2511-2f, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap580a2511-2f, col_values=(('qos', UUID('c7490352-86d4-4794-96b7-e072d2b63de7')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap580a2511-2f, col_values=(('external_ids', {'iface-id': '580a2511-2f94-4e37-af8e-3a3b72654b35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:10:6a', 'vm-uuid': '386e93a2-2435-4d5f-bee2-fdb5f52fd476'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:26:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:19 user nova-compute[75071]: INFO os_vif [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=580a2511-2f94-4e37-af8e-3a3b72654b35,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580a2511-2f')
Dec 05 12:26:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CMD "cp -r /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7_resize/disk /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk" returned: 0 in 0.401s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7_resize/disk.info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk.info {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CMD "cp -r /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7_resize/disk.info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk.info" returned: 0 in 0.032s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Port 5077ca66-d74d-4ad0-abee-fe0ea86d67ac binding to destination host user is already ACTIVE {{(pid=75071) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 05 12:26:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:26:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquired lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:26:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:26:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-920a7fcc-1cea-4690-9886-d0c90a3d3024 req-8818f204-e773-4e92-b22c-f9554b609138 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received event network-vif-plugged-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-920a7fcc-1cea-4690-9886-d0c90a3d3024 req-8818f204-e773-4e92-b22c-f9554b609138 service nova] Acquiring lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-920a7fcc-1cea-4690-9886-d0c90a3d3024 req-8818f204-e773-4e92-b22c-f9554b609138 service nova] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-920a7fcc-1cea-4690-9886-d0c90a3d3024 req-8818f204-e773-4e92-b22c-f9554b609138 service nova] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-920a7fcc-1cea-4690-9886-d0c90a3d3024 req-8818f204-e773-4e92-b22c-f9554b609138 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] No waiting events found dispatching network-vif-plugged-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:26:21 user nova-compute[75071]: WARNING nova.compute.manager [req-920a7fcc-1cea-4690-9886-d0c90a3d3024 req-8818f204-e773-4e92-b22c-f9554b609138 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received unexpected event network-vif-plugged-580a2511-2f94-4e37-af8e-3a3b72654b35 for instance with vm_state active and task_state reboot_started_hard.
Dec 05 12:26:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Updating instance_info_cache with network_info: [{"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:26:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Releasing lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG os_brick.utils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea261601-ec94-43b0-ace2-8b5e13da7e46]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6184222-6dc2-4623-bf77-cb312e865a04]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06f2a0a-5bce-4cc8-a653-4b5e2f13a77d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[272b4d3e-6f53-4d10-9d56-388e3b9d24c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:26:22 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:26:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bd69c0-cb18-40a6-9844-42f5d21cebff]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:26:22 user nova-compute[75071]: DEBUG os_brick.utils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:26:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:26:23 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Instance rebooted successfully.
Dec 05 12:26:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:26:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-4f4208a8-c731-4b1d-b641-c22db3116ab1 req-8c9a074c-c348-49e8-9752-d592eeb91799 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received event network-vif-plugged-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4f4208a8-c731-4b1d-b641-c22db3116ab1 req-8c9a074c-c348-49e8-9752-d592eeb91799 service nova] Acquiring lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4f4208a8-c731-4b1d-b641-c22db3116ab1 req-8c9a074c-c348-49e8-9752-d592eeb91799 service nova] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4f4208a8-c731-4b1d-b641-c22db3116ab1 req-8c9a074c-c348-49e8-9752-d592eeb91799 service nova] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-4f4208a8-c731-4b1d-b641-c22db3116ab1 req-8c9a074c-c348-49e8-9752-d592eeb91799 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] No waiting events found dispatching network-vif-plugged-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:26:23 user nova-compute[75071]: WARNING nova.compute.manager [req-4f4208a8-c731-4b1d-b641-c22db3116ab1 req-8c9a074c-c348-49e8-9752-d592eeb91799 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received unexpected event network-vif-plugged-580a2511-2f94-4e37-af8e-3a3b72654b35 for instance with vm_state active and task_state None.
Dec 05 12:26:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-88b171ce-0d6c-440f-9c17-7cdb454d3ff4 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.717s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Starting finish_migration {{(pid=75071) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11668}}
Dec 05 12:26:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Instance directory exists: not creating {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 05 12:26:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Creating image(s)
Dec 05 12:26:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:31 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk. size=21474836480 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:26:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk 21474836480 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk 21474836480" returned: 0 in 0.049s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Ensure instance console log exists: /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Start _get_guest_xml network_info=[{"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1949724505-network", "vif_mac": "fa:16:3e:de:d7:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '0190cb57-ab09-4d89-ac56-54112c8c012b', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNozAuVF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c89c29d3-b60e-4dc5-a895-f9fe84ed69a7', 'attached_at': '2023-12-05T12:26:31.000000', 'detached_at': '', 'volume_id': '48cf8d9f-f91d-4855-b810-453ede3eb546', 'serial': '48cf8d9f-f91d-4855-b810-453ede3eb546'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:26:32 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:26:32 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNozAuVF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:26:32 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:26:32 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:26:32 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8334db0-c217-44c5-a8b9-6f68c7e7b69a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:26:32 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e50d3b-f893-4ae6-84e0-ef37193f52a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546] added
Dec 05 12:26:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0bd20d-09c2-4e7e-ba2a-425479c13fc3]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[548b3f74-0fc5-4f0e-bbee-7337596a333d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNozAuVF {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNozAuVF" returned: 0 in 0.032s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ceb5cf-679c-4046-b7bf-70bfd9bdf8df]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kNozAuVF'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0e2ce4-1bdf-4dc0-9837-902b8624f042]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[42986c40-d6da-401b-bda2-9728287974d6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:26:32 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:26:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:26:32 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:26:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0252d0-efc8-4186-bc50-912f92eca7fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260]
Dec 05 12:26:32 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260] successful.
Dec 05 12:26:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e358d1ca-4c92-4b8c-aebc-a857065fd79b]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[354da110-aa1a-4a29-92ff-517bea21fa78]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:26:32 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:26:32 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:26:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:26:32 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:26:32 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:26:32 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f01c3c-3879-41b1-8160-8fc64d6fb937]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:26:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNozAuVF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26530306139333763', 'path': '/dev/sdd'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530306139333763', 'path': '/dev/sdd'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:22:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-610057875',display_name='tempest-ServerActionsTestOtherB-server-610057875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-610057875',id=19,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD//5LMlmnSypPzSdRI5jpZ9XqSwL0meBfIrwjAimv5kjQelxMdWSK8Bf7Pi316SOZkmu0iNhVkGJ6EvGf+c87dPNcnj3FJiHI1f2q3NnaFYTTYG6q/U8Y9vdkHGXYuKCg==',key_name='tempest-keypair-186552237',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:22:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ee29a575739045dd9db612290cfa9620',ramdisk_id='',reservation_id='r-0dy2tt38',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1001076821',owner_user_name='tempest-ServerActionsTestOtherB-1001076821-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:26:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a213d662f65e41fa8cc3a20e736ca757',uuid=c89c29d3-b60e-4dc5-a895-f9fe84ed69a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1949724505-network", "vif_mac": "fa:16:3e:de:d7:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Converting VIF {"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1949724505-network", "vif_mac": "fa:16:3e:de:d7:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:26:33 user nova-compute[75071]:   <uuid>c89c29d3-b60e-4dc5-a895-f9fe84ed69a7</uuid>
Dec 05 12:26:33 user nova-compute[75071]:   <name>instance-00000013</name>
Dec 05 12:26:33 user nova-compute[75071]:   <memory>2097152</memory>
Dec 05 12:26:33 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:26:33 user nova-compute[75071]:   <metadata>
Dec 05 12:26:33 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:26:33 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:26:33 user nova-compute[75071]:       <nova:name>tempest-ServerActionsTestOtherB-server-610057875</nova:name>
Dec 05 12:26:33 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:26:32</nova:creationTime>
Dec 05 12:26:33 user nova-compute[75071]:       <nova:flavor name="m1.small">
Dec 05 12:26:33 user nova-compute[75071]:         <nova:memory>2048</nova:memory>
Dec 05 12:26:33 user nova-compute[75071]:         <nova:disk>20</nova:disk>
Dec 05 12:26:33 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:26:33 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:26:33 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:26:33 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:26:33 user nova-compute[75071]:       <nova:owner>
Dec 05 12:26:33 user nova-compute[75071]:         <nova:user uuid="a213d662f65e41fa8cc3a20e736ca757">tempest-ServerActionsTestOtherB-1001076821-project-member</nova:user>
Dec 05 12:26:33 user nova-compute[75071]:         <nova:project uuid="ee29a575739045dd9db612290cfa9620">tempest-ServerActionsTestOtherB-1001076821</nova:project>
Dec 05 12:26:33 user nova-compute[75071]:       </nova:owner>
Dec 05 12:26:33 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:26:33 user nova-compute[75071]:       <nova:ports>
Dec 05 12:26:33 user nova-compute[75071]:         <nova:port uuid="5077ca66-d74d-4ad0-abee-fe0ea86d67ac">
Dec 05 12:26:33 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 05 12:26:33 user nova-compute[75071]:         </nova:port>
Dec 05 12:26:33 user nova-compute[75071]:       </nova:ports>
Dec 05 12:26:33 user nova-compute[75071]:     </nova:instance>
Dec 05 12:26:33 user nova-compute[75071]:   </metadata>
Dec 05 12:26:33 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:26:33 user nova-compute[75071]:     <system>
Dec 05 12:26:33 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:26:33 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:26:33 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:26:33 user nova-compute[75071]:       <entry name="serial">c89c29d3-b60e-4dc5-a895-f9fe84ed69a7</entry>
Dec 05 12:26:33 user nova-compute[75071]:       <entry name="uuid">c89c29d3-b60e-4dc5-a895-f9fe84ed69a7</entry>
Dec 05 12:26:33 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:26:33 user nova-compute[75071]:     </system>
Dec 05 12:26:33 user nova-compute[75071]:   </sysinfo>
Dec 05 12:26:33 user nova-compute[75071]:   <os>
Dec 05 12:26:33 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:26:33 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:26:33 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:26:33 user nova-compute[75071]:   </os>
Dec 05 12:26:33 user nova-compute[75071]:   <features>
Dec 05 12:26:33 user nova-compute[75071]:     <acpi/>
Dec 05 12:26:33 user nova-compute[75071]:     <apic/>
Dec 05 12:26:33 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:26:33 user nova-compute[75071]:   </features>
Dec 05 12:26:33 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:26:33 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:26:33 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:26:33 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:26:33 user nova-compute[75071]:   </clock>
Dec 05 12:26:33 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:26:33 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:26:33 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:26:33 user nova-compute[75071]:   </cpu>
Dec 05 12:26:33 user nova-compute[75071]:   <devices>
Dec 05 12:26:33 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:26:33 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:26:33 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk"/>
Dec 05 12:26:33 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:26:33 user nova-compute[75071]:     </disk>
Dec 05 12:26:33 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:26:33 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:26:33 user nova-compute[75071]:       <source dev="/dev/sdd"/>
Dec 05 12:26:33 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Dec 05 12:26:33 user nova-compute[75071]:       <serial>48cf8d9f-f91d-4855-b810-453ede3eb546</serial>
Dec 05 12:26:33 user nova-compute[75071]:     </disk>
Dec 05 12:26:33 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:26:33 user nova-compute[75071]:       <mac address="fa:16:3e:de:d7:62"/>
Dec 05 12:26:33 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:26:33 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:26:33 user nova-compute[75071]:       <target dev="tap5077ca66-d7"/>
Dec 05 12:26:33 user nova-compute[75071]:     </interface>
Dec 05 12:26:33 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:26:33 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/console.log" append="off"/>
Dec 05 12:26:33 user nova-compute[75071]:     </serial>
Dec 05 12:26:33 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:26:33 user nova-compute[75071]:     <video>
Dec 05 12:26:33 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:26:33 user nova-compute[75071]:     </video>
Dec 05 12:26:33 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:26:33 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:26:33 user nova-compute[75071]:     </rng>
Dec 05 12:26:33 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:26:33 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:26:33 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:26:33 user nova-compute[75071]:     </memballoon>
Dec 05 12:26:33 user nova-compute[75071]:   </devices>
Dec 05 12:26:33 user nova-compute[75071]: </domain>
Dec 05 12:26:33 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:22:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-610057875',display_name='tempest-ServerActionsTestOtherB-server-610057875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-610057875',id=19,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD//5LMlmnSypPzSdRI5jpZ9XqSwL0meBfIrwjAimv5kjQelxMdWSK8Bf7Pi316SOZkmu0iNhVkGJ6EvGf+c87dPNcnj3FJiHI1f2q3NnaFYTTYG6q/U8Y9vdkHGXYuKCg==',key_name='tempest-keypair-186552237',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:22:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ee29a575739045dd9db612290cfa9620',ramdisk_id='',reservation_id='r-0dy2tt38',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1001076821',owner_user_name='tempest-ServerActionsTestOtherB-1001076821-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:26:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a213d662f65e41fa8cc3a20e736ca757',uuid=c89c29d3-b60e-4dc5-a895-f9fe84ed69a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1949724505-network", "vif_mac": "fa:16:3e:de:d7:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Converting VIF {"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1949724505-network", "vif_mac": "fa:16:3e:de:d7:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG os_vif [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a26441c-5832-55ed-b6e2-b2eb5e1fadaa', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5077ca66-d7, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5077ca66-d7, col_values=(('qos', UUID('05d44f0b-0d16-4bdc-b6d5-7aef6e6c4a05')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5077ca66-d7, col_values=(('external_ids', {'iface-id': '5077ca66-d74d-4ad0-abee-fe0ea86d67ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:d7:62', 'vm-uuid': 'c89c29d3-b60e-4dc5-a895-f9fe84ed69a7'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:33 user nova-compute[75071]: INFO os_vif [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7')
Dec 05 12:26:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:26:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] No VIF found with MAC fa:16:3e:de:d7:62, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:26:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-025f355a-d1f0-4ef3-a943-861ee881f984 req-ab41be32-98dc-41a3-b1f5-29d5075db24e service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-025f355a-d1f0-4ef3-a943-861ee881f984 req-ab41be32-98dc-41a3-b1f5-29d5075db24e service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-025f355a-d1f0-4ef3-a943-861ee881f984 req-ab41be32-98dc-41a3-b1f5-29d5075db24e service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-025f355a-d1f0-4ef3-a943-861ee881f984 req-ab41be32-98dc-41a3-b1f5-29d5075db24e service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-025f355a-d1f0-4ef3-a943-861ee881f984 req-ab41be32-98dc-41a3-b1f5-29d5075db24e service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:26:35 user nova-compute[75071]: WARNING nova.compute.manager [req-025f355a-d1f0-4ef3-a943-861ee881f984 req-ab41be32-98dc-41a3-b1f5-29d5075db24e service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received unexpected event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with vm_state active and task_state resize_finish.
Dec 05 12:26:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:26:37 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Instance running successfully.
Dec 05 12:26:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Failed to set time: agent not configured {{(pid=75071) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Dec 05 12:26:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-9c133c57-9175-492a-af68-6bba5a8f163b tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] finish_migration finished successfully. {{(pid=75071) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11763}}
Dec 05 12:26:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-83922f52-b709-4f42-8a33-383364731c12 req-36f9f2ec-74e7-4e0a-9821-45370587dca9 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-83922f52-b709-4f42-8a33-383364731c12 req-36f9f2ec-74e7-4e0a-9821-45370587dca9 service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-83922f52-b709-4f42-8a33-383364731c12 req-36f9f2ec-74e7-4e0a-9821-45370587dca9 service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-83922f52-b709-4f42-8a33-383364731c12 req-36f9f2ec-74e7-4e0a-9821-45370587dca9 service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-83922f52-b709-4f42-8a33-383364731c12 req-36f9f2ec-74e7-4e0a-9821-45370587dca9 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:26:37 user nova-compute[75071]: WARNING nova.compute.manager [req-83922f52-b709-4f42-8a33-383364731c12 req-36f9f2ec-74e7-4e0a-9821-45370587dca9 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received unexpected event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with vm_state active and task_state resize_finish.
Dec 05 12:26:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "17348e17-fde4-49b9-a79d-8361724acc4f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "17348e17-fde4-49b9-a79d-8361724acc4f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "17348e17-fde4-49b9-a79d-8361724acc4f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "17348e17-fde4-49b9-a79d-8361724acc4f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "17348e17-fde4-49b9-a79d-8361724acc4f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:42 user nova-compute[75071]: INFO nova.compute.manager [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Terminating instance
Dec 05 12:26:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:26:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-80c1c3ad-fa3a-4d55-96a9-e3dc8ae1dd1a req-3a1dbe31-3721-4aa2-9f4c-e7e30d90efe1 service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Received event network-vif-unplugged-fd5c707a-6b81-4c59-87d0-8204082e274a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-80c1c3ad-fa3a-4d55-96a9-e3dc8ae1dd1a req-3a1dbe31-3721-4aa2-9f4c-e7e30d90efe1 service nova] Acquiring lock "17348e17-fde4-49b9-a79d-8361724acc4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-80c1c3ad-fa3a-4d55-96a9-e3dc8ae1dd1a req-3a1dbe31-3721-4aa2-9f4c-e7e30d90efe1 service nova] Lock "17348e17-fde4-49b9-a79d-8361724acc4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-80c1c3ad-fa3a-4d55-96a9-e3dc8ae1dd1a req-3a1dbe31-3721-4aa2-9f4c-e7e30d90efe1 service nova] Lock "17348e17-fde4-49b9-a79d-8361724acc4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-80c1c3ad-fa3a-4d55-96a9-e3dc8ae1dd1a req-3a1dbe31-3721-4aa2-9f4c-e7e30d90efe1 service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] No waiting events found dispatching network-vif-unplugged-fd5c707a-6b81-4c59-87d0-8204082e274a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:26:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-80c1c3ad-fa3a-4d55-96a9-e3dc8ae1dd1a req-3a1dbe31-3721-4aa2-9f4c-e7e30d90efe1 service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Received event network-vif-unplugged-fd5c707a-6b81-4c59-87d0-8204082e274a for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:26:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Instance destroyed successfully.
Dec 05 12:26:43 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lazy-loading 'resources' on Instance uuid 17348e17-fde4-49b9-a79d-8361724acc4f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:26:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-117102152',display_name='tempest-AttachVolumeNegativeTest-server-117102152',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-117102152',id=22,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLb9de/I70kpl8WryK8ZjE2MJmvZ9xawT3KV75HA1/NLwTKi2kyyx141C489P+/cA+7w/9xb11YoPevhXin2EgowfRszakaOrTAL4cO7W/uaj7BBQyce/72ycxM03stW6A==',key_name='tempest-keypair-1414079810',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:23:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5c1a038a4eb45508b7f5aa3eb435229',ramdisk_id='',reservation_id='r-x4pdkicd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1152460930',owner_user_name='tempest-AttachVolumeNegativeTest-1152460930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:23:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d78c212de2e426fad0cba51a2e7bf52',uuid=17348e17-fde4-49b9-a79d-8361724acc4f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd5c707a-6b81-4c59-87d0-8204082e274a", "address": "fa:16:3e:4f:0f:1c", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5c707a-6b", "ovs_interfaceid": "fd5c707a-6b81-4c59-87d0-8204082e274a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:26:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converting VIF {"id": "fd5c707a-6b81-4c59-87d0-8204082e274a", "address": "fa:16:3e:4f:0f:1c", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5c707a-6b", "ovs_interfaceid": "fd5c707a-6b81-4c59-87d0-8204082e274a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:26:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:0f:1c,bridge_name='br-int',has_traffic_filtering=True,id=fd5c707a-6b81-4c59-87d0-8204082e274a,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5c707a-6b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:26:43 user nova-compute[75071]: DEBUG os_vif [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:0f:1c,bridge_name='br-int',has_traffic_filtering=True,id=fd5c707a-6b81-4c59-87d0-8204082e274a,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5c707a-6b') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:26:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd5c707a-6b, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:26:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2963c1dd-3331-4ebe-bc83-d94de11bd680) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:26:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:43 user nova-compute[75071]: INFO os_vif [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:0f:1c,bridge_name='br-int',has_traffic_filtering=True,id=fd5c707a-6b81-4c59-87d0-8204082e274a,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5c707a-6b')
Dec 05 12:26:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Deleting instance files /opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f_del
Dec 05 12:26:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Deletion of /opt/stack/data/nova/instances/17348e17-fde4-49b9-a79d-8361724acc4f_del complete
Dec 05 12:26:43 user nova-compute[75071]: INFO nova.compute.manager [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Took 0.86 seconds to destroy the instance on the hypervisor.
Dec 05 12:26:43 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:26:43 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:26:43 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:26:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:43 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:26:44 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:26:44 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Took 0.71 seconds to deallocate network for instance.
Dec 05 12:26:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-a298ffec-fbc0-4f84-bfe6-eee8b016425d req-9529706b-e07f-411f-a706-35b139467c14 service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Received event network-vif-deleted-fd5c707a-6b81-4c59-87d0-8204082e274a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:44 user nova-compute[75071]: INFO nova.compute.manager [req-a298ffec-fbc0-4f84-bfe6-eee8b016425d req-9529706b-e07f-411f-a706-35b139467c14 service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Neutron deleted interface fd5c707a-6b81-4c59-87d0-8204082e274a; detaching it from the instance and deleting it from the info cache
Dec 05 12:26:44 user nova-compute[75071]: DEBUG nova.network.neutron [req-a298ffec-fbc0-4f84-bfe6-eee8b016425d req-9529706b-e07f-411f-a706-35b139467c14 service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:26:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-a298ffec-fbc0-4f84-bfe6-eee8b016425d req-9529706b-e07f-411f-a706-35b139467c14 service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Detach interface failed, port_id=fd5c707a-6b81-4c59-87d0-8204082e274a, reason: Instance 17348e17-fde4-49b9-a79d-8361724acc4f could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:26:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:44 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:26:44 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:26:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:44 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Deleted allocations for instance 17348e17-fde4-49b9-a79d-8361724acc4f
Dec 05 12:26:44 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:26:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a4a0b570-4935-407e-baa8-a7f93377db89 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "17348e17-fde4-49b9-a79d-8361724acc4f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.045s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-134427b3-53ec-4443-bc2c-9eb76d8f4b7c req-e6457cb9-249d-4a7d-b267-034c317ab53e service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Received event network-vif-plugged-fd5c707a-6b81-4c59-87d0-8204082e274a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-134427b3-53ec-4443-bc2c-9eb76d8f4b7c req-e6457cb9-249d-4a7d-b267-034c317ab53e service nova] Acquiring lock "17348e17-fde4-49b9-a79d-8361724acc4f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-134427b3-53ec-4443-bc2c-9eb76d8f4b7c req-e6457cb9-249d-4a7d-b267-034c317ab53e service nova] Lock "17348e17-fde4-49b9-a79d-8361724acc4f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-134427b3-53ec-4443-bc2c-9eb76d8f4b7c req-e6457cb9-249d-4a7d-b267-034c317ab53e service nova] Lock "17348e17-fde4-49b9-a79d-8361724acc4f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-134427b3-53ec-4443-bc2c-9eb76d8f4b7c req-e6457cb9-249d-4a7d-b267-034c317ab53e service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] No waiting events found dispatching network-vif-plugged-fd5c707a-6b81-4c59-87d0-8204082e274a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:26:45 user nova-compute[75071]: WARNING nova.compute.manager [req-134427b3-53ec-4443-bc2c-9eb76d8f4b7c req-e6457cb9-249d-4a7d-b267-034c317ab53e service nova] [instance: 17348e17-fde4-49b9-a79d-8361724acc4f] Received unexpected event network-vif-plugged-fd5c707a-6b81-4c59-87d0-8204082e274a for instance with vm_state deleted and task_state None.
Dec 05 12:26:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:26:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:26:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:26:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:26:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:26:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:26:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:26:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:26:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:26:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:26:49 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:26:49 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:26:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=7874MB free_disk=25.10521697998047GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:26:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Applying migration context for instance c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 as it has an incoming, in-progress migration cb889f27-40cc-4594-8c24-ab4a23f7cda9. Migration status is finished {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 05 12:26:49 user nova-compute[75071]: INFO nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Updating resource usage from migration cb889f27-40cc-4594-8c24-ab4a23f7cda9
Dec 05 12:26:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e08be776-0fa9-4871-86eb-2093530c00f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:26:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:26:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:26:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:26:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 386e93a2-2435-4d5f-bee2-fdb5f52fd476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:26:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance a99a0331-1d77-4b71-9ef7-0794778b3ef1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:26:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Migration cb889f27-40cc-4594-8c24-ab4a23f7cda9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Dec 05 12:26:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:26:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:26:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:26:49 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:26:49 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:26:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:26:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.403s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:26:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:26:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:26:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:26:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:26:50 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:26:50 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Updating instance_info_cache with network_info: [{"id": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "address": "fa:16:3e:59:88:5c", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2c318b-a7", "ovs_interfaceid": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:26:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:26:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:26:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:26:50 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:26:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:26:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:58 user nova-compute[75071]: INFO nova.compute.manager [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Rescuing
Dec 05 12:26:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:26:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquired lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:26:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:26:59 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Updating instance_info_cache with network_info: [{"id": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "address": "fa:16:3e:53:ed:01", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd15e936-54", "ovs_interfaceid": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:26:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Releasing lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:26:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-b0fab34f-5a3e-4b0c-b26d-9ef65a2e81c4 req-d4609a75-3fdc-4cfa-b337-8452e1e507a2 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received event network-vif-unplugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:26:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b0fab34f-5a3e-4b0c-b26d-9ef65a2e81c4 req-d4609a75-3fdc-4cfa-b337-8452e1e507a2 service nova] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b0fab34f-5a3e-4b0c-b26d-9ef65a2e81c4 req-d4609a75-3fdc-4cfa-b337-8452e1e507a2 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b0fab34f-5a3e-4b0c-b26d-9ef65a2e81c4 req-d4609a75-3fdc-4cfa-b337-8452e1e507a2 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-b0fab34f-5a3e-4b0c-b26d-9ef65a2e81c4 req-d4609a75-3fdc-4cfa-b337-8452e1e507a2 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] No waiting events found dispatching network-vif-unplugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:26:59 user nova-compute[75071]: WARNING nova.compute.manager [req-b0fab34f-5a3e-4b0c-b26d-9ef65a2e81c4 req-d4609a75-3fdc-4cfa-b337-8452e1e507a2 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received unexpected event network-vif-unplugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac for instance with vm_state active and task_state rescuing.
Dec 05 12:26:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:26:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Instance destroyed successfully.
Dec 05 12:26:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Attempting rescue
Dec 05 12:26:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75071) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 05 12:26:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Instance directory exists: not creating {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 05 12:26:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Creating image(s)
Dec 05 12:26:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "/opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "/opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "/opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:26:59 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:26:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:26:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:26:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk.rescue {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk.rescue" returned: 0 in 0.052s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'migration_context' on Instance uuid 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.objects.base [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Object Instance<9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Start _get_guest_xml network_info=[{"id": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "address": "fa:16:3e:53:ed:01", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "vif_mac": "fa:16:3e:53:ed:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd15e936-54", "ovs_interfaceid": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'resources' on Instance uuid 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.objects.base [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Object Instance<9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'numa_topology' on Instance uuid 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.objects.base [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Object Instance<9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:27:00 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:27:00 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.objects.base [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Object Instance<9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:22:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1939676217',display_name='tempest-ServerRescueNegativeTestJSON-server-1939676217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1939676217',id=17,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:22:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b958a2138af24f5a860e7a0c99d9ebb5',ramdisk_id='',reservation_id='r-ampwzrjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-170727457',owner_user_name='tempest-ServerRescueNegativeTestJSON-170727457-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:22:24Z,user_data=None,user_id='3312b55016d34680b6873eedf97e9a8f',uuid=9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "address": "fa:16:3e:53:ed:01", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "vif_mac": "fa:16:3e:53:ed:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd15e936-54", "ovs_interfaceid": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converting VIF {"id": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "address": "fa:16:3e:53:ed:01", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "vif_mac": "fa:16:3e:53:ed:01"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd15e936-54", "ovs_interfaceid": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:ed:01,bridge_name='br-int',has_traffic_filtering=True,id=dd15e936-54b4-4e4b-a17a-9bad21c19bac,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd15e936-54') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.objects.base [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Object Instance<9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:27:00 user nova-compute[75071]:   <uuid>9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f</uuid>
Dec 05 12:27:00 user nova-compute[75071]:   <name>instance-00000011</name>
Dec 05 12:27:00 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:27:00 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:27:00 user nova-compute[75071]:   <metadata>
Dec 05 12:27:00 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:27:00 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:27:00 user nova-compute[75071]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1939676217</nova:name>
Dec 05 12:27:00 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:27:00</nova:creationTime>
Dec 05 12:27:00 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:27:00 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:27:00 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:27:00 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:27:00 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:27:00 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:27:00 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:27:00 user nova-compute[75071]:       <nova:owner>
Dec 05 12:27:00 user nova-compute[75071]:         <nova:user uuid="3312b55016d34680b6873eedf97e9a8f">tempest-ServerRescueNegativeTestJSON-170727457-project-member</nova:user>
Dec 05 12:27:00 user nova-compute[75071]:         <nova:project uuid="b958a2138af24f5a860e7a0c99d9ebb5">tempest-ServerRescueNegativeTestJSON-170727457</nova:project>
Dec 05 12:27:00 user nova-compute[75071]:       </nova:owner>
Dec 05 12:27:00 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:27:00 user nova-compute[75071]:       <nova:ports>
Dec 05 12:27:00 user nova-compute[75071]:         <nova:port uuid="dd15e936-54b4-4e4b-a17a-9bad21c19bac">
Dec 05 12:27:00 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 05 12:27:00 user nova-compute[75071]:         </nova:port>
Dec 05 12:27:00 user nova-compute[75071]:       </nova:ports>
Dec 05 12:27:00 user nova-compute[75071]:     </nova:instance>
Dec 05 12:27:00 user nova-compute[75071]:   </metadata>
Dec 05 12:27:00 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:27:00 user nova-compute[75071]:     <system>
Dec 05 12:27:00 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:27:00 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:27:00 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:27:00 user nova-compute[75071]:       <entry name="serial">9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f</entry>
Dec 05 12:27:00 user nova-compute[75071]:       <entry name="uuid">9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f</entry>
Dec 05 12:27:00 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:27:00 user nova-compute[75071]:     </system>
Dec 05 12:27:00 user nova-compute[75071]:   </sysinfo>
Dec 05 12:27:00 user nova-compute[75071]:   <os>
Dec 05 12:27:00 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:27:00 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:27:00 user nova-compute[75071]:   </os>
Dec 05 12:27:00 user nova-compute[75071]:   <features>
Dec 05 12:27:00 user nova-compute[75071]:     <acpi/>
Dec 05 12:27:00 user nova-compute[75071]:     <apic/>
Dec 05 12:27:00 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:27:00 user nova-compute[75071]:   </features>
Dec 05 12:27:00 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:27:00 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:27:00 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:27:00 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:27:00 user nova-compute[75071]:   </clock>
Dec 05 12:27:00 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:27:00 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:27:00 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:27:00 user nova-compute[75071]:   </cpu>
Dec 05 12:27:00 user nova-compute[75071]:   <devices>
Dec 05 12:27:00 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:27:00 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:27:00 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk.rescue"/>
Dec 05 12:27:00 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:27:00 user nova-compute[75071]:     </disk>
Dec 05 12:27:00 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:27:00 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:27:00 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk"/>
Dec 05 12:27:00 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Dec 05 12:27:00 user nova-compute[75071]:     </disk>
Dec 05 12:27:00 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:27:00 user nova-compute[75071]:       <mac address="fa:16:3e:53:ed:01"/>
Dec 05 12:27:00 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:27:00 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:27:00 user nova-compute[75071]:       <target dev="tapdd15e936-54"/>
Dec 05 12:27:00 user nova-compute[75071]:     </interface>
Dec 05 12:27:00 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:27:00 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/console.log" append="off"/>
Dec 05 12:27:00 user nova-compute[75071]:     </serial>
Dec 05 12:27:00 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:27:00 user nova-compute[75071]:     <video>
Dec 05 12:27:00 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:27:00 user nova-compute[75071]:     </video>
Dec 05 12:27:00 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:27:00 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:27:00 user nova-compute[75071]:     </rng>
Dec 05 12:27:00 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:27:00 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:27:00 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:27:00 user nova-compute[75071]:     </memballoon>
Dec 05 12:27:00 user nova-compute[75071]:   </devices>
Dec 05 12:27:00 user nova-compute[75071]: </domain>
Dec 05 12:27:00 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:27:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Instance destroyed successfully.
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:27:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] No VIF found with MAC fa:16:3e:53:ed:01, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:27:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-380f7020-3657-432b-8b9d-c39d9596a5b2 req-1b1b7394-55a2-4922-bf80-094814b42600 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:27:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-380f7020-3657-432b-8b9d-c39d9596a5b2 req-1b1b7394-55a2-4922-bf80-094814b42600 service nova] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-380f7020-3657-432b-8b9d-c39d9596a5b2 req-1b1b7394-55a2-4922-bf80-094814b42600 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-380f7020-3657-432b-8b9d-c39d9596a5b2 req-1b1b7394-55a2-4922-bf80-094814b42600 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-380f7020-3657-432b-8b9d-c39d9596a5b2 req-1b1b7394-55a2-4922-bf80-094814b42600 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] No waiting events found dispatching network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:27:01 user nova-compute[75071]: WARNING nova.compute.manager [req-380f7020-3657-432b-8b9d-c39d9596a5b2 req-1b1b7394-55a2-4922-bf80-094814b42600 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received unexpected event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac for instance with vm_state active and task_state rescuing.
Dec 05 12:27:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-dc957870-2950-462d-925e-1186c15060a9 req-bb1b13dd-ac60-4ebc-b39d-696042c4ff2f service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:27:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dc957870-2950-462d-925e-1186c15060a9 req-bb1b13dd-ac60-4ebc-b39d-696042c4ff2f service nova] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dc957870-2950-462d-925e-1186c15060a9 req-bb1b13dd-ac60-4ebc-b39d-696042c4ff2f service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dc957870-2950-462d-925e-1186c15060a9 req-bb1b13dd-ac60-4ebc-b39d-696042c4ff2f service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-dc957870-2950-462d-925e-1186c15060a9 req-bb1b13dd-ac60-4ebc-b39d-696042c4ff2f service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] No waiting events found dispatching network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:27:03 user nova-compute[75071]: WARNING nova.compute.manager [req-dc957870-2950-462d-925e-1186c15060a9 req-bb1b13dd-ac60-4ebc-b39d-696042c4ff2f service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received unexpected event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac for instance with vm_state active and task_state rescuing.
Dec 05 12:27:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-dc957870-2950-462d-925e-1186c15060a9 req-bb1b13dd-ac60-4ebc-b39d-696042c4ff2f service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:27:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dc957870-2950-462d-925e-1186c15060a9 req-bb1b13dd-ac60-4ebc-b39d-696042c4ff2f service nova] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dc957870-2950-462d-925e-1186c15060a9 req-bb1b13dd-ac60-4ebc-b39d-696042c4ff2f service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dc957870-2950-462d-925e-1186c15060a9 req-bb1b13dd-ac60-4ebc-b39d-696042c4ff2f service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-dc957870-2950-462d-925e-1186c15060a9 req-bb1b13dd-ac60-4ebc-b39d-696042c4ff2f service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] No waiting events found dispatching network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:27:03 user nova-compute[75071]: WARNING nova.compute.manager [req-dc957870-2950-462d-925e-1186c15060a9 req-bb1b13dd-ac60-4ebc-b39d-696042c4ff2f service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received unexpected event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac for instance with vm_state active and task_state rescuing.
Dec 05 12:27:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f227fbbf-6ec8-4f4f-8f69-348fda05c8f1 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:27:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-e502b607-2773-457a-9f9e-4436e5a9794d req-6c26f76b-cb08-4d16-9ea9-d656a709192c service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Received event network-changed-5c0e15bb-4937-4f6a-8642-65fec78c2156 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:27:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-e502b607-2773-457a-9f9e-4436e5a9794d req-6c26f76b-cb08-4d16-9ea9-d656a709192c service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Refreshing instance network info cache due to event network-changed-5c0e15bb-4937-4f6a-8642-65fec78c2156. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:27:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e502b607-2773-457a-9f9e-4436e5a9794d req-6c26f76b-cb08-4d16-9ea9-d656a709192c service nova] Acquiring lock "refresh_cache-a99a0331-1d77-4b71-9ef7-0794778b3ef1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:27:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e502b607-2773-457a-9f9e-4436e5a9794d req-6c26f76b-cb08-4d16-9ea9-d656a709192c service nova] Acquired lock "refresh_cache-a99a0331-1d77-4b71-9ef7-0794778b3ef1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:27:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-e502b607-2773-457a-9f9e-4436e5a9794d req-6c26f76b-cb08-4d16-9ea9-d656a709192c service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Refreshing network info cache for port 5c0e15bb-4937-4f6a-8642-65fec78c2156 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG nova.objects.instance [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lazy-loading 'flavor' on Instance uuid a99a0331-1d77-4b71-9ef7-0794778b3ef1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-e502b607-2773-457a-9f9e-4436e5a9794d req-6c26f76b-cb08-4d16-9ea9-d656a709192c service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Updated VIF entry in instance network info cache for port 5c0e15bb-4937-4f6a-8642-65fec78c2156. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG nova.network.neutron [req-e502b607-2773-457a-9f9e-4436e5a9794d req-6c26f76b-cb08-4d16-9ea9-d656a709192c service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Updating instance_info_cache with network_info: [{"id": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "address": "fa:16:3e:8e:c8:78", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0e15bb-49", "ovs_interfaceid": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e502b607-2773-457a-9f9e-4436e5a9794d req-6c26f76b-cb08-4d16-9ea9-d656a709192c service nova] Releasing lock "refresh_cache-a99a0331-1d77-4b71-9ef7-0794778b3ef1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:07 user nova-compute[75071]: INFO nova.compute.manager [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Attaching volume fc84a2e9-c21a-40a6-9f93-2a70f7b187cf to /dev/vdb
Dec 05 12:27:07 user nova-compute[75071]: DEBUG os_brick.utils [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea10b70d-4be2-45e3-b7e8-41feecb1ee8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f360687-a221-4eaf-9882-03d959698ff0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d21a7d7-d1b9-47af-8ce4-c4c9051a847c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[045d92b8-8406-4f41-8ddd-e04d88e06b32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:27:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:27:08 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:27:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb899ac6-da8d-4414-ab1c-1820c8130caa]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:27:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:27:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:27:08 user nova-compute[75071]: DEBUG os_brick.utils [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:27:08 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Updating existing volume attachment record: 97a53836-5d24-4da4-91d1-b624dc36fd20 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:27:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:09 user nova-compute[75071]: INFO nova.compute.manager [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Unshelving
Dec 05 12:27:09 user nova-compute[75071]: INFO nova.virt.block_device [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Booting with volume e27c2098-3dd5-4d73-8694-8698769ed883 at /dev/vdc
Dec 05 12:27:09 user nova-compute[75071]: DEBUG os_brick.utils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[342ac2c2-4d04-4f19-9c1d-91d151d577d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9efec84-353f-4777-9da2-c1367292da1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e114fe50-4b79-4001-a21d-b54c12b31006]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58435b9-99a0-4f87-ac07-77847e2fa938]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:27:09 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:27:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a567bf-2e98-44cd-8bfe-5bf851fef9a4]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG os_brick.utils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:27:09 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Updating existing volume attachment record: e844f704-8130-4276-88c9-a7f02b84ecc9 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:27:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iZozaDbY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:27:18 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:27:18 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:27:18 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e690258f-1c4c-476f-acba-89723d25eb35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:27:18 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e3d549-8c3f-4eef-bf51-63151c33c38d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf] added
Dec 05 12:27:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7318a19-b432-49e6-8fdf-1f3d3e5fd379]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ca85a6-245f-47f4-b696-c7c950ade452]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iZozaDbY {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iZozaDbY" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bde329-a81d-4a1b-85ff-17de04fc856f]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iZozaDbY'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aceb721f-5929-4b09-a350-d4e04ba2ea84]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc739bec-a4ce-414b-abc6-2ea1ba2544fc]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:27:18 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:27:18 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:27:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:27:18 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:27:18 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:27:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d57afc-f8df-4849-9cb0-0f32158d8335]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf, portal: 172.16.0.220,3260]
Dec 05 12:27:18 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf, portal: 172.16.0.220,3260] successful.
Dec 05 12:27:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a591a04d-c681-4707-be3e-3ee0787d2fca]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aac6deb-fead-488d-ae5c-65b404812844]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:27:18 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:27:18 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:27:18 user nova-compute[75071]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf (non-flash)
Dec 05 12:27:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:27:18 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:27:18 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:27:18 user nova-compute[75071]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf (non-flash)
Dec 05 12:27:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] HCTL ('36', '-', '-', 0) found on session 29 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0290015-a1b4-49a5-adec-143118a29660]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Searching for a device in session 29 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:27:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iZozaDbY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:27:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:27:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23334303633326236', 'path': '/dev/sde'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:27:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334303633326236', 'path': '/dev/sde'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:27:19 user nova-compute[75071]: DEBUG nova.objects.instance [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lazy-loading 'flavor' on Instance uuid a99a0331-1d77-4b71-9ef7-0794778b3ef1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:27:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:27:19 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:27:19 user nova-compute[75071]:   <source dev="/dev/sde"/>
Dec 05 12:27:19 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:27:19 user nova-compute[75071]:   <serial>fc84a2e9-c21a-40a6-9f93-2a70f7b187cf</serial>
Dec 05 12:27:19 user nova-compute[75071]: </disk>
Dec 05 12:27:19 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:27:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:27:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:27:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] No VIF found with MAC fa:16:3e:8e:c8:78, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:27:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bf85c095-4648-4a21-aaa6-77e118159e62 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.746s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:27:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:27:21 user nova-compute[75071]: INFO nova.compute.claims [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Claim successful on node user
Dec 05 12:27:21 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:27:21 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:27:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:27:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:27:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:27:21 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:27:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG nova.policy [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '201cbbb8b3dc4a3aa8164d69c1257489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77a4b1baadd43e1be69eecb1f5370bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:27:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Creating image(s)
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "/opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "/opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "/opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.200s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'pci_requests' on Instance uuid cad9a071-e232-4629-a3cc-9cb9d3fe9333 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'numa_topology' on Instance uuid cad9a071-e232-4629-a3cc-9cb9d3fe9333 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:27:22 user nova-compute[75071]: INFO nova.compute.claims [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Claim successful on node user
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk 1073741824" returned: 0 in 0.048s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Checking if we can resize image /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:22 user nova-compute[75071]: INFO nova.compute.manager [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Detaching volume fc84a2e9-c21a-40a6-9f93-2a70f7b187cf
Dec 05 12:27:22 user nova-compute[75071]: INFO nova.virt.block_device [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Attempting to driver detach volume fc84a2e9-c21a-40a6-9f93-2a70f7b187cf from mountpoint /dev/vdb
Dec 05 12:27:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Attempting to detach device vdb from instance a99a0331-1d77-4b71-9ef7-0794778b3ef1 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:27:22 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:27:22 user nova-compute[75071]:   <source dev="/dev/sde"/>
Dec 05 12:27:22 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:27:22 user nova-compute[75071]:   <serial>fc84a2e9-c21a-40a6-9f93-2a70f7b187cf</serial>
Dec 05 12:27:22 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:27:22 user nova-compute[75071]: </disk>
Dec 05 12:27:22 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:27:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Successfully detached device vdb from instance a99a0331-1d77-4b71-9ef7-0794778b3ef1 from the persistent domain config.
Dec 05 12:27:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a99a0331-1d77-4b71-9ef7-0794778b3ef1 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:27:22 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:27:22 user nova-compute[75071]:   <source dev="/dev/sde"/>
Dec 05 12:27:22 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:27:22 user nova-compute[75071]:   <serial>fc84a2e9-c21a-40a6-9f93-2a70f7b187cf</serial>
Dec 05 12:27:22 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:27:22 user nova-compute[75071]: </disk>
Dec 05 12:27:22 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Cannot resize image /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Ensure instance console log exists: /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.672s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Successfully created port: cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:27:23 user nova-compute[75071]: INFO nova.network.neutron [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Updating port a8db5130-7bc3-414c-b8bf-469e4fa0eb7b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 05 12:27:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a99a0331-1d77-4b71-9ef7-0794778b3ef1 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:27:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:27:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquired lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:27:24 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:27:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-bce337c0-b410-41d5-b10d-f5fb78fe2526 req-541064f8-8e08-44a8-89f8-92fec51c1661 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received event network-changed-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:27:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-bce337c0-b410-41d5-b10d-f5fb78fe2526 req-541064f8-8e08-44a8-89f8-92fec51c1661 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Refreshing instance network info cache due to event network-changed-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:27:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bce337c0-b410-41d5-b10d-f5fb78fe2526 req-541064f8-8e08-44a8-89f8-92fec51c1661 service nova] Acquiring lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:27:24 user nova-compute[75071]: DEBUG nova.network.neutron [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Successfully updated port: cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:27:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "refresh_cache-30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:27:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquired lock "refresh_cache-30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:27:24 user nova-compute[75071]: DEBUG nova.network.neutron [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.network.neutron [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.network.neutron [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Updating instance_info_cache with network_info: [{"id": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "address": "fa:16:3e:ee:3d:ba", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfb6b0b-8b", "ovs_interfaceid": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Releasing lock "refresh_cache-30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.compute.manager [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Instance network_info: |[{"id": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "address": "fa:16:3e:ee:3d:ba", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfb6b0b-8b", "ovs_interfaceid": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Updating instance_info_cache with network_info: [{"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Start _get_guest_xml network_info=[{"id": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "address": "fa:16:3e:ee:3d:ba", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfb6b0b-8b", "ovs_interfaceid": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:27:25 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:27:25 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Releasing lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:27:25 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Creating image(s)
Dec 05 12:27:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "/opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "/opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "/opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'trusted_certs' on Instance uuid cad9a071-e232-4629-a3cc-9cb9d3fe9333 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bce337c0-b410-41d5-b10d-f5fb78fe2526 req-541064f8-8e08-44a8-89f8-92fec51c1661 service nova] Acquired lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.network.neutron [req-bce337c0-b410-41d5-b10d-f5fb78fe2526 req-541064f8-8e08-44a8-89f8-92fec51c1661 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Refreshing network info cache for port a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:27:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-179947841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-179947841',id=26,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b77a4b1baadd43e1be69eecb1f5370bd',ramdisk_id='',reservation_id='r-x7rdhfor',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86909184',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:27:22Z,user_data=None,user_id='201cbbb8b3dc4a3aa8164d69c1257489',uuid=30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "address": "fa:16:3e:ee:3d:ba", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfb6b0b-8b", "ovs_interfaceid": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converting VIF {"id": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "address": "fa:16:3e:ee:3d:ba", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfb6b0b-8b", "ovs_interfaceid": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:3d:ba,bridge_name='br-int',has_traffic_filtering=True,id=cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfb6b0b-8b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.objects.instance [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'pci_devices' on Instance uuid 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.objects.base [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Object Instance<cad9a071-e232-4629-a3cc-9cb9d3fe9333> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "abf92b803935b7c006ff6444550e1015589a942a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "abf92b803935b7c006ff6444550e1015589a942a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:27:25 user nova-compute[75071]:   <uuid>30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c</uuid>
Dec 05 12:27:25 user nova-compute[75071]:   <name>instance-0000001a</name>
Dec 05 12:27:25 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:27:25 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:27:25 user nova-compute[75071]:   <metadata>
Dec 05 12:27:25 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:27:25 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:27:25 user nova-compute[75071]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-179947841</nova:name>
Dec 05 12:27:25 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:27:25</nova:creationTime>
Dec 05 12:27:25 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:27:25 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:27:25 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:27:25 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:27:25 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:27:25 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:27:25 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:27:25 user nova-compute[75071]:       <nova:owner>
Dec 05 12:27:25 user nova-compute[75071]:         <nova:user uuid="201cbbb8b3dc4a3aa8164d69c1257489">tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member</nova:user>
Dec 05 12:27:25 user nova-compute[75071]:         <nova:project uuid="b77a4b1baadd43e1be69eecb1f5370bd">tempest-ServerBootFromVolumeStableRescueTest-86909184</nova:project>
Dec 05 12:27:25 user nova-compute[75071]:       </nova:owner>
Dec 05 12:27:25 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:27:25 user nova-compute[75071]:       <nova:ports>
Dec 05 12:27:25 user nova-compute[75071]:         <nova:port uuid="cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c">
Dec 05 12:27:25 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 05 12:27:25 user nova-compute[75071]:         </nova:port>
Dec 05 12:27:25 user nova-compute[75071]:       </nova:ports>
Dec 05 12:27:25 user nova-compute[75071]:     </nova:instance>
Dec 05 12:27:25 user nova-compute[75071]:   </metadata>
Dec 05 12:27:25 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:27:25 user nova-compute[75071]:     <system>
Dec 05 12:27:25 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:27:25 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:27:25 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:27:25 user nova-compute[75071]:       <entry name="serial">30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c</entry>
Dec 05 12:27:25 user nova-compute[75071]:       <entry name="uuid">30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c</entry>
Dec 05 12:27:25 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:27:25 user nova-compute[75071]:     </system>
Dec 05 12:27:25 user nova-compute[75071]:   </sysinfo>
Dec 05 12:27:25 user nova-compute[75071]:   <os>
Dec 05 12:27:25 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:27:25 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:27:25 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:27:25 user nova-compute[75071]:   </os>
Dec 05 12:27:25 user nova-compute[75071]:   <features>
Dec 05 12:27:25 user nova-compute[75071]:     <acpi/>
Dec 05 12:27:25 user nova-compute[75071]:     <apic/>
Dec 05 12:27:25 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:27:25 user nova-compute[75071]:   </features>
Dec 05 12:27:25 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:27:25 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:27:25 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:27:25 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:27:25 user nova-compute[75071]:   </clock>
Dec 05 12:27:25 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:27:25 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:27:25 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:27:25 user nova-compute[75071]:   </cpu>
Dec 05 12:27:25 user nova-compute[75071]:   <devices>
Dec 05 12:27:25 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:27:25 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:27:25 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk"/>
Dec 05 12:27:25 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:27:25 user nova-compute[75071]:     </disk>
Dec 05 12:27:25 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:27:25 user nova-compute[75071]:       <mac address="fa:16:3e:ee:3d:ba"/>
Dec 05 12:27:25 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:27:25 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:27:25 user nova-compute[75071]:       <target dev="tapcdfb6b0b-8b"/>
Dec 05 12:27:25 user nova-compute[75071]:     </interface>
Dec 05 12:27:25 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:27:25 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/console.log" append="off"/>
Dec 05 12:27:25 user nova-compute[75071]:     </serial>
Dec 05 12:27:25 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:27:25 user nova-compute[75071]:     <video>
Dec 05 12:27:25 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:27:25 user nova-compute[75071]:     </video>
Dec 05 12:27:25 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:27:25 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:27:25 user nova-compute[75071]:     </rng>
Dec 05 12:27:25 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:27:25 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:27:25 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:27:25 user nova-compute[75071]:     </memballoon>
Dec 05 12:27:25 user nova-compute[75071]:   </devices>
Dec 05 12:27:25 user nova-compute[75071]: </domain>
Dec 05 12:27:25 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:27:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-179947841',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-179947841',id=26,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b77a4b1baadd43e1be69eecb1f5370bd',ramdisk_id='',reservation_id='r-x7rdhfor',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86909184',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:27:22Z,user_data=None,user_id='201cbbb8b3dc4a3aa8164d69c1257489',uuid=30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "address": "fa:16:3e:ee:3d:ba", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfb6b0b-8b", "ovs_interfaceid": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converting VIF {"id": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "address": "fa:16:3e:ee:3d:ba", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfb6b0b-8b", "ovs_interfaceid": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:3d:ba,bridge_name='br-int',has_traffic_filtering=True,id=cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfb6b0b-8b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG os_vif [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:3d:ba,bridge_name='br-int',has_traffic_filtering=True,id=cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfb6b0b-8b') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc4f676b-037e-598e-8c32-00eeb4286aeb', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcdfb6b0b-8b, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcdfb6b0b-8b, col_values=(('qos', UUID('165670b8-7c77-484e-84ea-af15363476dc')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcdfb6b0b-8b, col_values=(('external_ids', {'iface-id': 'cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:3d:ba', 'vm-uuid': '30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:27:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:25 user nova-compute[75071]: INFO os_vif [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:3d:ba,bridge_name='br-int',has_traffic_filtering=True,id=cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfb6b0b-8b')
Dec 05 12:27:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abf92b803935b7c006ff6444550e1015589a942a.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:27:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] No VIF found with MAC fa:16:3e:ee:3d:ba, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:27:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abf92b803935b7c006ff6444550e1015589a942a.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:26 user nova-compute[75071]: DEBUG nova.virt.images [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] 77a7b7cc-5988-456d-8643-d255f10239e6 was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 12:27:26 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 12:27:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/abf92b803935b7c006ff6444550e1015589a942a.part /opt/stack/data/nova/instances/_base/abf92b803935b7c006ff6444550e1015589a942a.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-18a0ee32-829e-4e92-af0a-e80ee4e3ab3b req-16d3184e-6e9b-4537-93d6-cac0f0e0a522 service nova] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Received event network-changed-cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:27:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-18a0ee32-829e-4e92-af0a-e80ee4e3ab3b req-16d3184e-6e9b-4537-93d6-cac0f0e0a522 service nova] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Refreshing instance network info cache due to event network-changed-cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:27:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-18a0ee32-829e-4e92-af0a-e80ee4e3ab3b req-16d3184e-6e9b-4537-93d6-cac0f0e0a522 service nova] Acquiring lock "refresh_cache-30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:27:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-18a0ee32-829e-4e92-af0a-e80ee4e3ab3b req-16d3184e-6e9b-4537-93d6-cac0f0e0a522 service nova] Acquired lock "refresh_cache-30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:27:26 user nova-compute[75071]: DEBUG nova.network.neutron [req-18a0ee32-829e-4e92-af0a-e80ee4e3ab3b req-16d3184e-6e9b-4537-93d6-cac0f0e0a522 service nova] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Refreshing network info cache for port cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:27:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:27 user nova-compute[75071]: DEBUG nova.network.neutron [req-bce337c0-b410-41d5-b10d-f5fb78fe2526 req-541064f8-8e08-44a8-89f8-92fec51c1661 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Updated VIF entry in instance network info cache for port a8db5130-7bc3-414c-b8bf-469e4fa0eb7b. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:27:27 user nova-compute[75071]: DEBUG nova.network.neutron [req-bce337c0-b410-41d5-b10d-f5fb78fe2526 req-541064f8-8e08-44a8-89f8-92fec51c1661 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Updating instance_info_cache with network_info: [{"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:27:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bce337c0-b410-41d5-b10d-f5fb78fe2526 req-541064f8-8e08-44a8-89f8-92fec51c1661 service nova] Releasing lock "refresh_cache-cad9a071-e232-4629-a3cc-9cb9d3fe9333" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:27:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/abf92b803935b7c006ff6444550e1015589a942a.part /opt/stack/data/nova/instances/_base/abf92b803935b7c006ff6444550e1015589a942a.converted" returned: 0 in 0.605s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abf92b803935b7c006ff6444550e1015589a942a.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:27 user nova-compute[75071]: DEBUG nova.network.neutron [req-18a0ee32-829e-4e92-af0a-e80ee4e3ab3b req-16d3184e-6e9b-4537-93d6-cac0f0e0a522 service nova] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Updated VIF entry in instance network info cache for port cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:27:27 user nova-compute[75071]: DEBUG nova.network.neutron [req-18a0ee32-829e-4e92-af0a-e80ee4e3ab3b req-16d3184e-6e9b-4537-93d6-cac0f0e0a522 service nova] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Updating instance_info_cache with network_info: [{"id": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "address": "fa:16:3e:ee:3d:ba", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfb6b0b-8b", "ovs_interfaceid": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:27:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-18a0ee32-829e-4e92-af0a-e80ee4e3ab3b req-16d3184e-6e9b-4537-93d6-cac0f0e0a522 service nova] Releasing lock "refresh_cache-30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:27:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abf92b803935b7c006ff6444550e1015589a942a.converted --force-share --output=json" returned: 0 in 0.252s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "abf92b803935b7c006ff6444550e1015589a942a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.232s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:27 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abf92b803935b7c006ff6444550e1015589a942a --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abf92b803935b7c006ff6444550e1015589a942a --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "abf92b803935b7c006ff6444550e1015589a942a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "abf92b803935b7c006ff6444550e1015589a942a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abf92b803935b7c006ff6444550e1015589a942a --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abf92b803935b7c006ff6444550e1015589a942a --force-share --output=json" returned: 0 in 0.167s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/abf92b803935b7c006ff6444550e1015589a942a,backing_fmt=raw /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/abf92b803935b7c006ff6444550e1015589a942a,backing_fmt=raw /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk 1073741824" returned: 0 in 0.050s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "abf92b803935b7c006ff6444550e1015589a942a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abf92b803935b7c006ff6444550e1015589a942a --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/abf92b803935b7c006ff6444550e1015589a942a --force-share --output=json" returned: 0 in 0.205s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:28 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'migration_context' on Instance uuid cad9a071-e232-4629-a3cc-9cb9d3fe9333 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:27:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:28 user nova-compute[75071]: DEBUG nova.objects.base [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Object Instance<cad9a071-e232-4629-a3cc-9cb9d3fe9333> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:27:28 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Rebasing disk image.
Dec 05 12:27:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.209s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 -F raw /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-43cda4af-c896-4c67-8113-696cc7a12e3a req-b7c64c0c-d9f3-49b5-8ded-9dab8e3fb6bb service nova] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Received event network-vif-plugged-cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:27:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-43cda4af-c896-4c67-8113-696cc7a12e3a req-b7c64c0c-d9f3-49b5-8ded-9dab8e3fb6bb service nova] Acquiring lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-43cda4af-c896-4c67-8113-696cc7a12e3a req-b7c64c0c-d9f3-49b5-8ded-9dab8e3fb6bb service nova] Lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-43cda4af-c896-4c67-8113-696cc7a12e3a req-b7c64c0c-d9f3-49b5-8ded-9dab8e3fb6bb service nova] Lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-43cda4af-c896-4c67-8113-696cc7a12e3a req-b7c64c0c-d9f3-49b5-8ded-9dab8e3fb6bb service nova] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] No waiting events found dispatching network-vif-plugged-cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:27:29 user nova-compute[75071]: WARNING nova.compute.manager [req-43cda4af-c896-4c67-8113-696cc7a12e3a req-b7c64c0c-d9f3-49b5-8ded-9dab8e3fb6bb service nova] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Received unexpected event network-vif-plugged-cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c for instance with vm_state building and task_state spawning.
Dec 05 12:27:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:27:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:27:30 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Instance spawned successfully.
Dec 05 12:27:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:27:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:27:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:27:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:27:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:27:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:27:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:27:30 user nova-compute[75071]: INFO nova.compute.manager [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Took 8.85 seconds to spawn the instance on the hypervisor.
Dec 05 12:27:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:27:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 -F raw /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk" returned: 0 in 2.240s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:27:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Ensure instance console log exists: /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:27:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Start _get_guest_xml network_info=[{"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='00ebedfc8e5dcc7d624fa126ace32133',container_format='bare',created_at=2023-12-05T12:25:16Z,direct_url=<?>,disk_format='qcow2',id=77a7b7cc-5988-456d-8643-d255f10239e6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-6013421-shelved',owner='36cda9a88b434e66ad6d8ac75790d141',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-05T12:25:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'e844f704-8130-4276-88c9-a7f02b84ecc9', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VENfGTmi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'cad9a071-e232-4629-a3cc-9cb9d3fe9333', 'attached_at': '', 'detached_at': '', 'volume_id': 'e27c2098-3dd5-4d73-8694-8698769ed883', 'serial': 'e27c2098-3dd5-4d73-8694-8698769ed883'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:27:31 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:27:31 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-6ec7792b-2397-4b81-92ea-983d4c72b437 req-dd78eb47-6b33-4281-9526-e29d35d6f6ad service nova] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Received event network-vif-plugged-cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6ec7792b-2397-4b81-92ea-983d4c72b437 req-dd78eb47-6b33-4281-9526-e29d35d6f6ad service nova] Acquiring lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6ec7792b-2397-4b81-92ea-983d4c72b437 req-dd78eb47-6b33-4281-9526-e29d35d6f6ad service nova] Lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6ec7792b-2397-4b81-92ea-983d4c72b437 req-dd78eb47-6b33-4281-9526-e29d35d6f6ad service nova] Lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-6ec7792b-2397-4b81-92ea-983d4c72b437 req-dd78eb47-6b33-4281-9526-e29d35d6f6ad service nova] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] No waiting events found dispatching network-vif-plugged-cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:27:31 user nova-compute[75071]: WARNING nova.compute.manager [req-6ec7792b-2397-4b81-92ea-983d4c72b437 req-dd78eb47-6b33-4281-9526-e29d35d6f6ad service nova] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Received unexpected event network-vif-plugged-cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c for instance with vm_state building and task_state spawning.
Dec 05 12:27:31 user nova-compute[75071]: INFO nova.compute.manager [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Took 9.94 seconds to build instance.
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='00ebedfc8e5dcc7d624fa126ace32133',container_format='bare',created_at=2023-12-05T12:25:16Z,direct_url=<?>,disk_format='qcow2',id=77a7b7cc-5988-456d-8643-d255f10239e6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-6013421-shelved',owner='36cda9a88b434e66ad6d8ac75790d141',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-05T12:25:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'vcpu_model' on Instance uuid cad9a071-e232-4629-a3cc-9cb9d3fe9333 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-de6c2ba5-d142-4160-acfd-2f2be032a976 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.095s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.objects.base [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Object Instance<cad9a071-e232-4629-a3cc-9cb9d3fe9333> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VENfGTmi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:27:31 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:27:31 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.012s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:27:31 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc498331-bea9-4776-8497-0434957ce207]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:27:31 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1142c39-5760-4b2b-beb0-6c889fc39dd2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883] added
Dec 05 12:27:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[223f4ab0-bc40-4bb7-8307-e16d23028593]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fcbc51-a02f-4fcf-b7ab-e2dcb8cf0b7c]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VENfGTmi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VENfGTmi" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a878a7-58cb-4cde-8f36-bfa9631a2d5c]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VENfGTmi'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4e2d5d-a7f0-4c98-95d0-9b017957d6d2]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8670a3f6-f4ba-472f-a329-9288016d955a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:27:31 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:27:31 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:27:31 user nova-compute[75071]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf (non-flash)
Dec 05 12:27:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:27:31 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:27:31 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:27:31 user nova-compute[75071]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf (non-flash)
Dec 05 12:27:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2a8c16-4af0-4bab-9fea-b37053a4ed99]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883, portal: 172.16.0.220,3260]
Dec 05 12:27:31 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883, portal: 172.16.0.220,3260] successful.
Dec 05 12:27:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f779abc-4ba7-4314-8f13-a7a5c362d407]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc2e908-1f31-4ba8-8692-51bec22e6229]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:27:31 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:27:31 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:27:31 user nova-compute[75071]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf (non-flash)
Dec 05 12:27:31 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)
Dec 05 12:27:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:27:31 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:27:31 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:27:31 user nova-compute[75071]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf (non-flash)
Dec 05 12:27:31 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)
Dec 05 12:27:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1f8236-bbe0-4751-bdf4-f194d496d7c7]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:27:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VENfGTmi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23039333336313531', 'path': '/dev/sdf'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039333336313531', 'path': '/dev/sdf'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T12:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-6013421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-6013421',id=21,image_ref='77a7b7cc-5988-456d-8643-d255f10239e6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-399432094',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:23:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='36cda9a88b434e66ad6d8ac75790d141',ramdisk_id='',reservation_id='r-xmrtzxbg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1822750901',owner_user_name='tempest-AttachVolumeShelveTestJSON-1822750901-project-member',shelved_at='2023-12-05T12:25:21.025990',shelved_host='user',shelved_image_id='77a7b7cc-5988-456d-8643-d255f10239e6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:27:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a70218d8181040818ed8290e743bd2db',uuid=cad9a071-e232-4629-a3cc-9cb9d3fe9333,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converting VIF {"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:89,bridge_name='br-int',has_traffic_filtering=True,id=a8db5130-7bc3-414c-b8bf-469e4fa0eb7b,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db5130-7b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'pci_devices' on Instance uuid cad9a071-e232-4629-a3cc-9cb9d3fe9333 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG nova.objects.base [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Object Instance<cad9a071-e232-4629-a3cc-9cb9d3fe9333> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:27:32 user nova-compute[75071]:   <uuid>cad9a071-e232-4629-a3cc-9cb9d3fe9333</uuid>
Dec 05 12:27:32 user nova-compute[75071]:   <name>instance-00000015</name>
Dec 05 12:27:32 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:27:32 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:27:32 user nova-compute[75071]:   <metadata>
Dec 05 12:27:32 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:27:32 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:27:32 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-6013421</nova:name>
Dec 05 12:27:32 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:27:31</nova:creationTime>
Dec 05 12:27:32 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:27:32 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:27:32 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:27:32 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:27:32 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:27:32 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:27:32 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:27:32 user nova-compute[75071]:       <nova:owner>
Dec 05 12:27:32 user nova-compute[75071]:         <nova:user uuid="a70218d8181040818ed8290e743bd2db">tempest-AttachVolumeShelveTestJSON-1822750901-project-member</nova:user>
Dec 05 12:27:32 user nova-compute[75071]:         <nova:project uuid="36cda9a88b434e66ad6d8ac75790d141">tempest-AttachVolumeShelveTestJSON-1822750901</nova:project>
Dec 05 12:27:32 user nova-compute[75071]:       </nova:owner>
Dec 05 12:27:32 user nova-compute[75071]:       <nova:root type="image" uuid="77a7b7cc-5988-456d-8643-d255f10239e6"/>
Dec 05 12:27:32 user nova-compute[75071]:       <nova:ports>
Dec 05 12:27:32 user nova-compute[75071]:         <nova:port uuid="a8db5130-7bc3-414c-b8bf-469e4fa0eb7b">
Dec 05 12:27:32 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 12:27:32 user nova-compute[75071]:         </nova:port>
Dec 05 12:27:32 user nova-compute[75071]:       </nova:ports>
Dec 05 12:27:32 user nova-compute[75071]:     </nova:instance>
Dec 05 12:27:32 user nova-compute[75071]:   </metadata>
Dec 05 12:27:32 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:27:32 user nova-compute[75071]:     <system>
Dec 05 12:27:32 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:27:32 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:27:32 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:27:32 user nova-compute[75071]:       <entry name="serial">cad9a071-e232-4629-a3cc-9cb9d3fe9333</entry>
Dec 05 12:27:32 user nova-compute[75071]:       <entry name="uuid">cad9a071-e232-4629-a3cc-9cb9d3fe9333</entry>
Dec 05 12:27:32 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:27:32 user nova-compute[75071]:     </system>
Dec 05 12:27:32 user nova-compute[75071]:   </sysinfo>
Dec 05 12:27:32 user nova-compute[75071]:   <os>
Dec 05 12:27:32 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:27:32 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:27:32 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:27:32 user nova-compute[75071]:   </os>
Dec 05 12:27:32 user nova-compute[75071]:   <features>
Dec 05 12:27:32 user nova-compute[75071]:     <acpi/>
Dec 05 12:27:32 user nova-compute[75071]:     <apic/>
Dec 05 12:27:32 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:27:32 user nova-compute[75071]:   </features>
Dec 05 12:27:32 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:27:32 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:27:32 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:27:32 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:27:32 user nova-compute[75071]:   </clock>
Dec 05 12:27:32 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:27:32 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:27:32 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:27:32 user nova-compute[75071]:   </cpu>
Dec 05 12:27:32 user nova-compute[75071]:   <devices>
Dec 05 12:27:32 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:27:32 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:27:32 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk"/>
Dec 05 12:27:32 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:27:32 user nova-compute[75071]:     </disk>
Dec 05 12:27:32 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:27:32 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:27:32 user nova-compute[75071]:       <source dev="/dev/sdf"/>
Dec 05 12:27:32 user nova-compute[75071]:       <target dev="vdc" bus="virtio"/>
Dec 05 12:27:32 user nova-compute[75071]:       <serial>e27c2098-3dd5-4d73-8694-8698769ed883</serial>
Dec 05 12:27:32 user nova-compute[75071]:     </disk>
Dec 05 12:27:32 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:27:32 user nova-compute[75071]:       <mac address="fa:16:3e:ad:51:89"/>
Dec 05 12:27:32 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:27:32 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:27:32 user nova-compute[75071]:       <target dev="tapa8db5130-7b"/>
Dec 05 12:27:32 user nova-compute[75071]:     </interface>
Dec 05 12:27:32 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:27:32 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/console.log" append="off"/>
Dec 05 12:27:32 user nova-compute[75071]:     </serial>
Dec 05 12:27:32 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:27:32 user nova-compute[75071]:     <video>
Dec 05 12:27:32 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:27:32 user nova-compute[75071]:     </video>
Dec 05 12:27:32 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:27:32 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:27:32 user nova-compute[75071]:     </rng>
Dec 05 12:27:32 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:27:32 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:27:32 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:27:32 user nova-compute[75071]:     </memballoon>
Dec 05 12:27:32 user nova-compute[75071]:   </devices>
Dec 05 12:27:32 user nova-compute[75071]: </domain>
Dec 05 12:27:32 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T12:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-6013421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-6013421',id=21,image_ref='77a7b7cc-5988-456d-8643-d255f10239e6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-399432094',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:23:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='36cda9a88b434e66ad6d8ac75790d141',ramdisk_id='',reservation_id='r-xmrtzxbg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1822750901',owner_user_name='tempest-AttachVolumeShelveTestJSON-1822750901-project-member',shelved_at='2023-12-05T12:25:21.025990',shelved_host='user',shelved_image_id='77a7b7cc-5988-456d-8643-d255f10239e6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:27:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a70218d8181040818ed8290e743bd2db',uuid=cad9a071-e232-4629-a3cc-9cb9d3fe9333,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converting VIF {"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:89,bridge_name='br-int',has_traffic_filtering=True,id=a8db5130-7bc3-414c-b8bf-469e4fa0eb7b,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db5130-7b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG os_vif [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:89,bridge_name='br-int',has_traffic_filtering=True,id=a8db5130-7bc3-414c-b8bf-469e4fa0eb7b,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db5130-7b') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f383b49-053e-5de1-8559-5719bb3fd8db', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8db5130-7b, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8db5130-7b, col_values=(('qos', UUID('df5d5700-8b4c-4da9-9206-832660efdc06')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8db5130-7b, col_values=(('external_ids', {'iface-id': 'a8db5130-7bc3-414c-b8bf-469e4fa0eb7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:51:89', 'vm-uuid': 'cad9a071-e232-4629-a3cc-9cb9d3fe9333'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:32 user nova-compute[75071]: INFO os_vif [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:89,bridge_name='br-int',has_traffic_filtering=True,id=a8db5130-7bc3-414c-b8bf-469e4fa0eb7b,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db5130-7b')
Dec 05 12:27:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:27:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] No VIF found with MAC fa:16:3e:ad:51:89, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:27:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-4bce2e16-9c00-4fff-9499-7020f6818380 req-48884b95-938c-4b66-aa90-2faf18efc92d service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received event network-vif-plugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:27:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4bce2e16-9c00-4fff-9499-7020f6818380 req-48884b95-938c-4b66-aa90-2faf18efc92d service nova] Acquiring lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4bce2e16-9c00-4fff-9499-7020f6818380 req-48884b95-938c-4b66-aa90-2faf18efc92d service nova] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4bce2e16-9c00-4fff-9499-7020f6818380 req-48884b95-938c-4b66-aa90-2faf18efc92d service nova] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-4bce2e16-9c00-4fff-9499-7020f6818380 req-48884b95-938c-4b66-aa90-2faf18efc92d service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] No waiting events found dispatching network-vif-plugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:27:34 user nova-compute[75071]: WARNING nova.compute.manager [req-4bce2e16-9c00-4fff-9499-7020f6818380 req-48884b95-938c-4b66-aa90-2faf18efc92d service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received unexpected event network-vif-plugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b for instance with vm_state shelved_offloaded and task_state spawning.
Dec 05 12:27:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:27:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:27:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-68e6fe91-eeff-4c2b-8f1a-35a5ba24afcc req-10af5d67-0f0f-4c3f-9617-613d407c6b2e service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received event network-vif-plugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:27:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-68e6fe91-eeff-4c2b-8f1a-35a5ba24afcc req-10af5d67-0f0f-4c3f-9617-613d407c6b2e service nova] Acquiring lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-68e6fe91-eeff-4c2b-8f1a-35a5ba24afcc req-10af5d67-0f0f-4c3f-9617-613d407c6b2e service nova] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-68e6fe91-eeff-4c2b-8f1a-35a5ba24afcc req-10af5d67-0f0f-4c3f-9617-613d407c6b2e service nova] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-68e6fe91-eeff-4c2b-8f1a-35a5ba24afcc req-10af5d67-0f0f-4c3f-9617-613d407c6b2e service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] No waiting events found dispatching network-vif-plugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:27:36 user nova-compute[75071]: WARNING nova.compute.manager [req-68e6fe91-eeff-4c2b-8f1a-35a5ba24afcc req-10af5d67-0f0f-4c3f-9617-613d407c6b2e service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received unexpected event network-vif-plugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b for instance with vm_state shelved_offloaded and task_state spawning.
Dec 05 12:27:36 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Instance spawned successfully.
Dec 05 12:27:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "2704ba7b-5e66-4348-a0fb-181465476095" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "2704ba7b-5e66-4348-a0fb-181465476095" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:27:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:27:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:36 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:27:36 user nova-compute[75071]: INFO nova.compute.claims [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Claim successful on node user
Dec 05 12:27:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d96e34c9-b43e-49a9-a989-be5ce528393b tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 27.286s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.771s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:27:37 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:27:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG nova.policy [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7d78c212de2e426fad0cba51a2e7bf52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c1a038a4eb45508b7f5aa3eb435229', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:27:37 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Creating image(s)
Dec 05 12:27:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "/opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "/opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "/opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Acquiring lock "49b87f98-7fd9-4566-a038-f18e494aea08" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Lock "49b87f98-7fd9-4566-a038-f18e494aea08" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:27:37 user nova-compute[75071]: INFO nova.compute.claims [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Claim successful on node user
Dec 05 12:27:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk 1073741824" returned: 0 in 0.070s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Successfully created port: 084a2a59-92f8-433d-be29-18eb5444cf18 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.219s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.706s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Cannot resize image /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Ensure instance console log exists: /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG nova.network.neutron [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:27:38 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:27:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG nova.policy [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '677345acdba3484195146080b0f7fdd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ca401c7f16f41f287c25049ef2b2089', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:27:38 user nova-compute[75071]: INFO nova.virt.block_device [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Booting with volume 6932fe86-5cf2-4b77-b6c6-de088961d190 at /dev/vda
Dec 05 12:27:38 user nova-compute[75071]: DEBUG os_brick.utils [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:27:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89f840f-20c1-4e96-be1e-7feeaab8e395]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f63f801-f31a-431d-9dca-269144a88b6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5336507-321f-4102-adbf-ab862930877e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f79c10-a13a-4e57-b3f3-e22428d5d0d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:27:39 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:27:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0663ee5c-cfc1-4a76-b5b2-98aa2c421d98]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG os_brick.utils [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Updating existing volume attachment record: 70b570e2-8887-4314-908f-594ab2c3715c {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Successfully updated port: 084a2a59-92f8-433d-be29-18eb5444cf18 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "refresh_cache-2704ba7b-5e66-4348-a0fb-181465476095" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquired lock "refresh_cache-2704ba7b-5e66-4348-a0fb-181465476095" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-05828642-39b2-46c8-a7b5-3d432ae3324f req-069a74fa-9509-4c52-9bf2-22fdd6e22fb8 service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Received event network-changed-084a2a59-92f8-433d-be29-18eb5444cf18 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-05828642-39b2-46c8-a7b5-3d432ae3324f req-069a74fa-9509-4c52-9bf2-22fdd6e22fb8 service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Refreshing instance network info cache due to event network-changed-084a2a59-92f8-433d-be29-18eb5444cf18. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-05828642-39b2-46c8-a7b5-3d432ae3324f req-069a74fa-9509-4c52-9bf2-22fdd6e22fb8 service nova] Acquiring lock "refresh_cache-2704ba7b-5e66-4348-a0fb-181465476095" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Updating instance_info_cache with network_info: [{"id": "084a2a59-92f8-433d-be29-18eb5444cf18", "address": "fa:16:3e:54:c7:a3", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a2a59-92", "ovs_interfaceid": "084a2a59-92f8-433d-be29-18eb5444cf18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Releasing lock "refresh_cache-2704ba7b-5e66-4348-a0fb-181465476095" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Instance network_info: |[{"id": "084a2a59-92f8-433d-be29-18eb5444cf18", "address": "fa:16:3e:54:c7:a3", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a2a59-92", "ovs_interfaceid": "084a2a59-92f8-433d-be29-18eb5444cf18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-05828642-39b2-46c8-a7b5-3d432ae3324f req-069a74fa-9509-4c52-9bf2-22fdd6e22fb8 service nova] Acquired lock "refresh_cache-2704ba7b-5e66-4348-a0fb-181465476095" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.network.neutron [req-05828642-39b2-46c8-a7b5-3d432ae3324f req-069a74fa-9509-4c52-9bf2-22fdd6e22fb8 service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Refreshing network info cache for port 084a2a59-92f8-433d-be29-18eb5444cf18 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Start _get_guest_xml network_info=[{"id": "084a2a59-92f8-433d-be29-18eb5444cf18", "address": "fa:16:3e:54:c7:a3", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a2a59-92", "ovs_interfaceid": "084a2a59-92f8-433d-be29-18eb5444cf18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:27:39 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:27:39 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:27:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-688610055',display_name='tempest-AttachVolumeNegativeTest-server-688610055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-688610055',id=27,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsvGSq3wxJ16ef0Ypt89B8VjEUQMfUjwgY2R0unFCnT+/5X0OY7wcKF2/kOZJ3qWtUjYI9dCvVl7dRvjQiCoepD9Ga0fP139KYIdSB4GYeouSgjg8cQc46aWDBYuF3hGA==',key_name='tempest-keypair-1264295312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5c1a038a4eb45508b7f5aa3eb435229',ramdisk_id='',reservation_id='r-k5c76l01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1152460930',owner_user_name='tempest-AttachVolumeNegativeTest-1152460930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:27:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d78c212de2e426fad0cba51a2e7bf52',uuid=2704ba7b-5e66-4348-a0fb-181465476095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "084a2a59-92f8-433d-be29-18eb5444cf18", "address": "fa:16:3e:54:c7:a3", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a2a59-92", "ovs_interfaceid": "084a2a59-92f8-433d-be29-18eb5444cf18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converting VIF {"id": "084a2a59-92f8-433d-be29-18eb5444cf18", "address": "fa:16:3e:54:c7:a3", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a2a59-92", "ovs_interfaceid": "084a2a59-92f8-433d-be29-18eb5444cf18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:c7:a3,bridge_name='br-int',has_traffic_filtering=True,id=084a2a59-92f8-433d-be29-18eb5444cf18,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084a2a59-92') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.objects.instance [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lazy-loading 'pci_devices' on Instance uuid 2704ba7b-5e66-4348-a0fb-181465476095 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:27:39 user nova-compute[75071]:   <uuid>2704ba7b-5e66-4348-a0fb-181465476095</uuid>
Dec 05 12:27:39 user nova-compute[75071]:   <name>instance-0000001b</name>
Dec 05 12:27:39 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:27:39 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:27:39 user nova-compute[75071]:   <metadata>
Dec 05 12:27:39 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:27:39 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:27:39 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeNegativeTest-server-688610055</nova:name>
Dec 05 12:27:39 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:27:39</nova:creationTime>
Dec 05 12:27:39 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:27:39 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:27:39 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:27:39 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:27:39 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:27:39 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:27:39 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:27:39 user nova-compute[75071]:       <nova:owner>
Dec 05 12:27:39 user nova-compute[75071]:         <nova:user uuid="7d78c212de2e426fad0cba51a2e7bf52">tempest-AttachVolumeNegativeTest-1152460930-project-member</nova:user>
Dec 05 12:27:39 user nova-compute[75071]:         <nova:project uuid="d5c1a038a4eb45508b7f5aa3eb435229">tempest-AttachVolumeNegativeTest-1152460930</nova:project>
Dec 05 12:27:39 user nova-compute[75071]:       </nova:owner>
Dec 05 12:27:39 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:27:39 user nova-compute[75071]:       <nova:ports>
Dec 05 12:27:39 user nova-compute[75071]:         <nova:port uuid="084a2a59-92f8-433d-be29-18eb5444cf18">
Dec 05 12:27:39 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 05 12:27:39 user nova-compute[75071]:         </nova:port>
Dec 05 12:27:39 user nova-compute[75071]:       </nova:ports>
Dec 05 12:27:39 user nova-compute[75071]:     </nova:instance>
Dec 05 12:27:39 user nova-compute[75071]:   </metadata>
Dec 05 12:27:39 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:27:39 user nova-compute[75071]:     <system>
Dec 05 12:27:39 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:27:39 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:27:39 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:27:39 user nova-compute[75071]:       <entry name="serial">2704ba7b-5e66-4348-a0fb-181465476095</entry>
Dec 05 12:27:39 user nova-compute[75071]:       <entry name="uuid">2704ba7b-5e66-4348-a0fb-181465476095</entry>
Dec 05 12:27:39 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:27:39 user nova-compute[75071]:     </system>
Dec 05 12:27:39 user nova-compute[75071]:   </sysinfo>
Dec 05 12:27:39 user nova-compute[75071]:   <os>
Dec 05 12:27:39 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:27:39 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:27:39 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:27:39 user nova-compute[75071]:   </os>
Dec 05 12:27:39 user nova-compute[75071]:   <features>
Dec 05 12:27:39 user nova-compute[75071]:     <acpi/>
Dec 05 12:27:39 user nova-compute[75071]:     <apic/>
Dec 05 12:27:39 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:27:39 user nova-compute[75071]:   </features>
Dec 05 12:27:39 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:27:39 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:27:39 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:27:39 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:27:39 user nova-compute[75071]:   </clock>
Dec 05 12:27:39 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:27:39 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:27:39 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:27:39 user nova-compute[75071]:   </cpu>
Dec 05 12:27:39 user nova-compute[75071]:   <devices>
Dec 05 12:27:39 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:27:39 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:27:39 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk"/>
Dec 05 12:27:39 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:27:39 user nova-compute[75071]:     </disk>
Dec 05 12:27:39 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:27:39 user nova-compute[75071]:       <mac address="fa:16:3e:54:c7:a3"/>
Dec 05 12:27:39 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:27:39 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:27:39 user nova-compute[75071]:       <target dev="tap084a2a59-92"/>
Dec 05 12:27:39 user nova-compute[75071]:     </interface>
Dec 05 12:27:39 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:27:39 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/console.log" append="off"/>
Dec 05 12:27:39 user nova-compute[75071]:     </serial>
Dec 05 12:27:39 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:27:39 user nova-compute[75071]:     <video>
Dec 05 12:27:39 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:27:39 user nova-compute[75071]:     </video>
Dec 05 12:27:39 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:27:39 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:27:39 user nova-compute[75071]:     </rng>
Dec 05 12:27:39 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:27:39 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:27:39 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:27:39 user nova-compute[75071]:     </memballoon>
Dec 05 12:27:39 user nova-compute[75071]:   </devices>
Dec 05 12:27:39 user nova-compute[75071]: </domain>
Dec 05 12:27:39 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:27:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-688610055',display_name='tempest-AttachVolumeNegativeTest-server-688610055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-688610055',id=27,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsvGSq3wxJ16ef0Ypt89B8VjEUQMfUjwgY2R0unFCnT+/5X0OY7wcKF2/kOZJ3qWtUjYI9dCvVl7dRvjQiCoepD9Ga0fP139KYIdSB4GYeouSgjg8cQc46aWDBYuF3hGA==',key_name='tempest-keypair-1264295312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5c1a038a4eb45508b7f5aa3eb435229',ramdisk_id='',reservation_id='r-k5c76l01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1152460930',owner_user_name='tempest-AttachVolumeNegativeTest-1152460930-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:27:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d78c212de2e426fad0cba51a2e7bf52',uuid=2704ba7b-5e66-4348-a0fb-181465476095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "084a2a59-92f8-433d-be29-18eb5444cf18", "address": "fa:16:3e:54:c7:a3", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a2a59-92", "ovs_interfaceid": "084a2a59-92f8-433d-be29-18eb5444cf18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converting VIF {"id": "084a2a59-92f8-433d-be29-18eb5444cf18", "address": "fa:16:3e:54:c7:a3", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a2a59-92", "ovs_interfaceid": "084a2a59-92f8-433d-be29-18eb5444cf18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:c7:a3,bridge_name='br-int',has_traffic_filtering=True,id=084a2a59-92f8-433d-be29-18eb5444cf18,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084a2a59-92') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG os_vif [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c7:a3,bridge_name='br-int',has_traffic_filtering=True,id=084a2a59-92f8-433d-be29-18eb5444cf18,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084a2a59-92') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c03287b7-2994-58b2-adbf-d41f6dc17937', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap084a2a59-92, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap084a2a59-92, col_values=(('qos', UUID('8a5c8fec-9101-4cba-997f-d861c490086c')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap084a2a59-92, col_values=(('external_ids', {'iface-id': '084a2a59-92f8-433d-be29-18eb5444cf18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:c7:a3', 'vm-uuid': '2704ba7b-5e66-4348-a0fb-181465476095'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:39 user nova-compute[75071]: INFO os_vif [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:c7:a3,bridge_name='br-int',has_traffic_filtering=True,id=084a2a59-92f8-433d-be29-18eb5444cf18,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084a2a59-92')
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:27:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] No VIF found with MAC fa:16:3e:54:c7:a3, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:27:40 user nova-compute[75071]: DEBUG nova.network.neutron [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Successfully created port: 4d7177dd-82c0-4697-b66f-b1cef01444f7 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:27:40 user nova-compute[75071]: DEBUG nova.network.neutron [req-05828642-39b2-46c8-a7b5-3d432ae3324f req-069a74fa-9509-4c52-9bf2-22fdd6e22fb8 service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Updated VIF entry in instance network info cache for port 084a2a59-92f8-433d-be29-18eb5444cf18. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:27:40 user nova-compute[75071]: DEBUG nova.network.neutron [req-05828642-39b2-46c8-a7b5-3d432ae3324f req-069a74fa-9509-4c52-9bf2-22fdd6e22fb8 service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Updating instance_info_cache with network_info: [{"id": "084a2a59-92f8-433d-be29-18eb5444cf18", "address": "fa:16:3e:54:c7:a3", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a2a59-92", "ovs_interfaceid": "084a2a59-92f8-433d-be29-18eb5444cf18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:27:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-05828642-39b2-46c8-a7b5-3d432ae3324f req-069a74fa-9509-4c52-9bf2-22fdd6e22fb8 service nova] Releasing lock "refresh_cache-2704ba7b-5e66-4348-a0fb-181465476095" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:27:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Successfully updated port: 4d7177dd-82c0-4697-b66f-b1cef01444f7 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:27:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Acquiring lock "refresh_cache-49b87f98-7fd9-4566-a038-f18e494aea08" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:27:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Acquired lock "refresh_cache-49b87f98-7fd9-4566-a038-f18e494aea08" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:27:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:27:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:27:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-baa008d9-6a5e-49f0-a044-5faaf906abe1 req-765d4d80-2ac8-4977-a85f-9d3784a108fe service nova] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Received event network-changed-4d7177dd-82c0-4697-b66f-b1cef01444f7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:27:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-baa008d9-6a5e-49f0-a044-5faaf906abe1 req-765d4d80-2ac8-4977-a85f-9d3784a108fe service nova] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Refreshing instance network info cache due to event network-changed-4d7177dd-82c0-4697-b66f-b1cef01444f7. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:27:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-baa008d9-6a5e-49f0-a044-5faaf906abe1 req-765d4d80-2ac8-4977-a85f-9d3784a108fe service nova] Acquiring lock "refresh_cache-49b87f98-7fd9-4566-a038-f18e494aea08" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:27:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Updating instance_info_cache with network_info: [{"id": "4d7177dd-82c0-4697-b66f-b1cef01444f7", "address": "fa:16:3e:49:0e:0b", "network": {"id": "9c07857b-0eb0-43d9-9a61-71ae02bc5d7e", "bridge": "br-int", "label": "tempest-TestShelveInstance-103442687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca401c7f16f41f287c25049ef2b2089", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7177dd-82", "ovs_interfaceid": "4d7177dd-82c0-4697-b66f-b1cef01444f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:27:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Releasing lock "refresh_cache-49b87f98-7fd9-4566-a038-f18e494aea08" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:27:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Instance network_info: |[{"id": "4d7177dd-82c0-4697-b66f-b1cef01444f7", "address": "fa:16:3e:49:0e:0b", "network": {"id": "9c07857b-0eb0-43d9-9a61-71ae02bc5d7e", "bridge": "br-int", "label": "tempest-TestShelveInstance-103442687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca401c7f16f41f287c25049ef2b2089", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7177dd-82", "ovs_interfaceid": "4d7177dd-82c0-4697-b66f-b1cef01444f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:27:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-baa008d9-6a5e-49f0-a044-5faaf906abe1 req-765d4d80-2ac8-4977-a85f-9d3784a108fe service nova] Acquired lock "refresh_cache-49b87f98-7fd9-4566-a038-f18e494aea08" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:27:41 user nova-compute[75071]: DEBUG nova.network.neutron [req-baa008d9-6a5e-49f0-a044-5faaf906abe1 req-765d4d80-2ac8-4977-a85f-9d3784a108fe service nova] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Refreshing network info cache for port 4d7177dd-82c0-4697-b66f-b1cef01444f7 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:27:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-baa008d9-6a5e-49f0-a044-5faaf906abe1 req-765d4d80-2ac8-4977-a85f-9d3784a108fe service nova] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Updated VIF entry in instance network info cache for port 4d7177dd-82c0-4697-b66f-b1cef01444f7. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:27:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-baa008d9-6a5e-49f0-a044-5faaf906abe1 req-765d4d80-2ac8-4977-a85f-9d3784a108fe service nova] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Updating instance_info_cache with network_info: [{"id": "4d7177dd-82c0-4697-b66f-b1cef01444f7", "address": "fa:16:3e:49:0e:0b", "network": {"id": "9c07857b-0eb0-43d9-9a61-71ae02bc5d7e", "bridge": "br-int", "label": "tempest-TestShelveInstance-103442687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca401c7f16f41f287c25049ef2b2089", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7177dd-82", "ovs_interfaceid": "4d7177dd-82c0-4697-b66f-b1cef01444f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:27:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-baa008d9-6a5e-49f0-a044-5faaf906abe1 req-765d4d80-2ac8-4977-a85f-9d3784a108fe service nova] Releasing lock "refresh_cache-49b87f98-7fd9-4566-a038-f18e494aea08" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:27:43 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a99a0331-1d77-4b71-9ef7-0794778b3ef1 is timed out.
Dec 05 12:27:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Successfully detached device vdb from instance a99a0331-1d77-4b71-9ef7-0794778b3ef1 from the live domain config.
Dec 05 12:27:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iZozaDbY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:27:43 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7660106-5e15-4c45-a714-e205eada5915]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:27:43 user nova-compute[75071]: No targets found.
Dec 05 12:27:43 user nova-compute[75071]: iSNS:
Dec 05 12:27:43 user nova-compute[75071]: No targets found.
Dec 05 12:27:43 user nova-compute[75071]: STATIC:
Dec 05 12:27:43 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98
Dec 05 12:27:43 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:27:43 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:27:43 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:27:43 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:27:43 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:27:43 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf
Dec 05 12:27:43 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:27:43 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:27:43 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883
Dec 05 12:27:43 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:27:43 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:27:43 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546
Dec 05 12:27:43 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:27:43 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:27:43 user nova-compute[75071]: FIRMWARE:
Dec 05 12:27:43 user nova-compute[75071]: No targets found.
Dec 05 12:27:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:27:43 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:27:43 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae01c791-2a1e-47d1-9050-062974fba7bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[074334e7-9eb2-45cb-af2e-124b733b4be2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:27:43 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:27:43 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:27:43 user nova-compute[75071]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf (non-flash)
Dec 05 12:27:43 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)
Dec 05 12:27:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:27:43 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:27:43 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:27:43 user nova-compute[75071]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf (non-flash)
Dec 05 12:27:43 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)
Dec 05 12:27:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8274283e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf'): ({'sde'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Removing single pathed devices sde {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c73db27-9663-4829-a77d-0aac5142b0f8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-d92cd5ac-dcb9-4404-a6cc-fa6ece99c634 req-da58593c-eae1-47bc-8c2f-a8c7a5feb241 service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Received event network-vif-plugged-084a2a59-92f8-433d-be29-18eb5444cf18 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d92cd5ac-dcb9-4404-a6cc-fa6ece99c634 req-da58593c-eae1-47bc-8c2f-a8c7a5feb241 service nova] Acquiring lock "2704ba7b-5e66-4348-a0fb-181465476095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d92cd5ac-dcb9-4404-a6cc-fa6ece99c634 req-da58593c-eae1-47bc-8c2f-a8c7a5feb241 service nova] Lock "2704ba7b-5e66-4348-a0fb-181465476095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d92cd5ac-dcb9-4404-a6cc-fa6ece99c634 req-da58593c-eae1-47bc-8c2f-a8c7a5feb241 service nova] Lock "2704ba7b-5e66-4348-a0fb-181465476095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-d92cd5ac-dcb9-4404-a6cc-fa6ece99c634 req-da58593c-eae1-47bc-8c2f-a8c7a5feb241 service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] No waiting events found dispatching network-vif-plugged-084a2a59-92f8-433d-be29-18eb5444cf18 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:27:43 user nova-compute[75071]: WARNING nova.compute.manager [req-d92cd5ac-dcb9-4404-a6cc-fa6ece99c634 req-da58593c-eae1-47bc-8c2f-a8c7a5feb241 service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Received unexpected event network-vif-plugged-084a2a59-92f8-433d-be29-18eb5444cf18 for instance with vm_state building and task_state spawning.
Dec 05 12:27:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-d92cd5ac-dcb9-4404-a6cc-fa6ece99c634 req-da58593c-eae1-47bc-8c2f-a8c7a5feb241 service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Received event network-vif-plugged-084a2a59-92f8-433d-be29-18eb5444cf18 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d92cd5ac-dcb9-4404-a6cc-fa6ece99c634 req-da58593c-eae1-47bc-8c2f-a8c7a5feb241 service nova] Acquiring lock "2704ba7b-5e66-4348-a0fb-181465476095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d92cd5ac-dcb9-4404-a6cc-fa6ece99c634 req-da58593c-eae1-47bc-8c2f-a8c7a5feb241 service nova] Lock "2704ba7b-5e66-4348-a0fb-181465476095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d92cd5ac-dcb9-4404-a6cc-fa6ece99c634 req-da58593c-eae1-47bc-8c2f-a8c7a5feb241 service nova] Lock "2704ba7b-5e66-4348-a0fb-181465476095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-d92cd5ac-dcb9-4404-a6cc-fa6ece99c634 req-da58593c-eae1-47bc-8c2f-a8c7a5feb241 service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] No waiting events found dispatching network-vif-plugged-084a2a59-92f8-433d-be29-18eb5444cf18 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:27:43 user nova-compute[75071]: WARNING nova.compute.manager [req-d92cd5ac-dcb9-4404-a6cc-fa6ece99c634 req-da58593c-eae1-47bc-8c2f-a8c7a5feb241 service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Received unexpected event network-vif-plugged-084a2a59-92f8-433d-be29-18eb5444cf18 for instance with vm_state building and task_state spawning.
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c11e81-21c3-48c9-a687-54499897b541]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Flushing IO for device /dev/sde {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83d221d-25a4-4498-8f9d-f6f3c421da29]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb8837e-1045-4a6e-92b0-b00feacfabe8]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35948e9-8a4c-4614-999b-490991f2a6d8]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40969fe-3427-4e8e-b9ae-18a449a61a31]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf, portal: 172.16.0.220,3260]
Dec 05 12:27:43 user nova-compute[75071]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf, portal: 172.16.0.220,3260] successful.
Dec 05 12:27:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc84a2e9-c21a-40a6-9f93-2a70f7b187cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[96eb32ec-c88b-4b5e-8beb-86b0f23529a8]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] <== disconnect_volume: return (373ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:27:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:27:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Instance spawned successfully.
Dec 05 12:27:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:27:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:27:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:27:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:27:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:27:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:27:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:27:44 user nova-compute[75071]: INFO nova.compute.manager [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Took 6.38 seconds to spawn the instance on the hypervisor.
Dec 05 12:27:44 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:27:44 user nova-compute[75071]: INFO nova.compute.manager [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Took 7.89 seconds to build instance.
Dec 05 12:27:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5be14f11-019d-435d-8ea4-38dd3d35d5e9 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "2704ba7b-5e66-4348-a0fb-181465476095" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.009s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:44 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:27:44 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:27:44 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:27:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:27:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:27:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:27:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:45 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:27:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:45 user nova-compute[75071]: DEBUG nova.objects.instance [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lazy-loading 'flavor' on Instance uuid a99a0331-1d77-4b71-9ef7-0794778b3ef1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:27:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-82c553c9-bac3-4779-b49d-c44526f86802 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.340s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.volume.cinder [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Update attachment failed for attachment 70b570e2-8887-4314-908f-594ab2c3715c. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8f2785f2-9469-4ef3-8d64-247ebeed0c00) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8f2785f2-9469-4ef3-8d64-247ebeed0c00)
Dec 05 12:27:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8f2785f2-9469-4ef3-8d64-247ebeed0c00)
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Traceback (most recent call last):
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]     driver_block_device.attach_block_devices(
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]     _log_and_attach(device)
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]     bdm.attach(*attach_args, **attach_kwargs)
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]     ret_val = method(obj, context, *args, **kwargs)
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]     self._do_attach(context, instance, volume, volume_api,
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]     self._volume_attach(context, volume, connector, instance,
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]     connection_info = volume_api.attachment_update(
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]     res = method(self, ctx, *args, **kwargs)
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]     res = method(self, ctx, attachment_id, *args, **kwargs)
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]     with excutils.save_and_reraise_exception():
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]     self.force_reraise()
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]     raise self.value
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]     context, '3.44', skip_version_check=True).attachments.update(
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]     return method.func(obj, *args, **kwargs)
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]     resp = self._update('/attachments/%s' % id, body)
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]     resp, body = self.api.client.put(url, body=body, **kwargs)
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]     return self._cs_request(url, 'PUT', **kwargs)
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]     return self.request(url, method, **kwargs)
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08]     raise exceptions.from_response(resp, body)
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8f2785f2-9469-4ef3-8d64-247ebeed0c00)
Dec 05 12:27:46 user nova-compute[75071]: ERROR nova.compute.manager [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] 
Dec 05 12:27:46 user nova-compute[75071]: DEBUG nova.compute.claims [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Aborting claim: <nova.compute.claims.Claim object at 0x7f82743b6170> {{(pid=75071) abort /opt/stack/nova/nova/compute/claims.py:84}}
Dec 05 12:27:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.804s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG nova.compute.manager [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Build of instance 49b87f98-7fd9-4566-a038-f18e494aea08 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8f2785f2-9469-4ef3-8d64-247ebeed0c00) {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG nova.compute.utils [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Build of instance 49b87f98-7fd9-4566-a038-f18e494aea08 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75071) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Dec 05 12:27:47 user nova-compute[75071]: ERROR nova.compute.manager [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Build of instance 49b87f98-7fd9-4566-a038-f18e494aea08 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8f2785f2-9469-4ef3-8d64-247ebeed0c00): nova.exception.BuildAbortException: Build of instance 49b87f98-7fd9-4566-a038-f18e494aea08 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8f2785f2-9469-4ef3-8d64-247ebeed0c00)
Dec 05 12:27:47 user nova-compute[75071]: DEBUG nova.compute.manager [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Unplugging VIFs for instance {{(pid=75071) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:27:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1604727829',display_name='tempest-TestShelveInstance-server-1604727829',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1604727829',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgBubElUi8Gn/dCT1QoNJYdeaNsBmhyhXYkIeUWblNHb8HVqWOAp24Y3EGDX5OPy3qgQm4jyhjRCDwbB8ljGg/JDBR59GZ+pk5T6khshJFYJg/7KbA4LRFnfFSLUbhXdg==',key_name='tempest-TestShelveInstance-1311361256',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ca401c7f16f41f287c25049ef2b2089',ramdisk_id='',reservation_id='r-yffrj4bd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-473862258',owner_user_name='tempest-TestShelveInstance-473862258-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:27:39Z,user_data=None,user_id='677345acdba3484195146080b0f7fdd3',uuid=49b87f98-7fd9-4566-a038-f18e494aea08,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d7177dd-82c0-4697-b66f-b1cef01444f7", "address": "fa:16:3e:49:0e:0b", "network": {"id": "9c07857b-0eb0-43d9-9a61-71ae02bc5d7e", "bridge": "br-int", "label": "tempest-TestShelveInstance-103442687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca401c7f16f41f287c25049ef2b2089", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7177dd-82", "ovs_interfaceid": "4d7177dd-82c0-4697-b66f-b1cef01444f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Converting VIF {"id": "4d7177dd-82c0-4697-b66f-b1cef01444f7", "address": "fa:16:3e:49:0e:0b", "network": {"id": "9c07857b-0eb0-43d9-9a61-71ae02bc5d7e", "bridge": "br-int", "label": "tempest-TestShelveInstance-103442687-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8ca401c7f16f41f287c25049ef2b2089", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d7177dd-82", "ovs_interfaceid": "4d7177dd-82c0-4697-b66f-b1cef01444f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:0e:0b,bridge_name='br-int',has_traffic_filtering=True,id=4d7177dd-82c0-4697-b66f-b1cef01444f7,network=Network(9c07857b-0eb0-43d9-9a61-71ae02bc5d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7177dd-82') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG os_vif [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:0e:0b,bridge_name='br-int',has_traffic_filtering=True,id=4d7177dd-82c0-4697-b66f-b1cef01444f7,network=Network(9c07857b-0eb0-43d9-9a61-71ae02bc5d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7177dd-82') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d7177dd-82, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:27:47 user nova-compute[75071]: INFO os_vif [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:0e:0b,bridge_name='br-int',has_traffic_filtering=True,id=4d7177dd-82c0-4697-b66f-b1cef01444f7,network=Network(9c07857b-0eb0-43d9-9a61-71ae02bc5d7e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d7177dd-82')
Dec 05 12:27:47 user nova-compute[75071]: DEBUG nova.compute.manager [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Unplugged VIFs for instance {{(pid=75071) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG nova.compute.manager [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG nova.network.neutron [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG nova.network.neutron [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:27:47 user nova-compute[75071]: INFO nova.compute.manager [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Took 0.56 seconds to deallocate network for instance.
Dec 05 12:27:47 user nova-compute[75071]: DEBUG nova.compute.manager [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Detaching volume: 6932fe86-5cf2-4b77-b6c6-de088961d190 {{(pid=75071) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Dec 05 12:27:47 user nova-compute[75071]: INFO nova.compute.manager [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Detaching volume 6932fe86-5cf2-4b77-b6c6-de088961d190
Dec 05 12:27:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:47 user nova-compute[75071]: ERROR nova.virt.block_device [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Unable to call for a driver detach of volume 6932fe86-5cf2-4b77-b6c6-de088961d190 due to the instance being registered to the remote host None.: nova.exception.BuildAbortException: Build of instance 49b87f98-7fd9-4566-a038-f18e494aea08 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8f2785f2-9469-4ef3-8d64-247ebeed0c00)
Dec 05 12:27:47 user nova-compute[75071]: DEBUG nova.compute.manager [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] [instance: 49b87f98-7fd9-4566-a038-f18e494aea08] Deleting volume: 6932fe86-5cf2-4b77-b6c6-de088961d190 {{(pid=75071) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "c2b46f1c-dce6-4436-8e1e-062ffda80732" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:27:48 user nova-compute[75071]: INFO nova.compute.claims [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Claim successful on node user
Dec 05 12:27:48 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Deleted allocations for instance 49b87f98-7fd9-4566-a038-f18e494aea08
Dec 05 12:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-91c14bb5-bf30-4688-8a57-140fe1778a5d tempest-TestShelveInstance-473862258 tempest-TestShelveInstance-473862258-project-member] Lock "49b87f98-7fd9-4566-a038-f18e494aea08" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.379s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.607s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:27:48 user nova-compute[75071]: DEBUG nova.network.neutron [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:27:48 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:27:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG nova.policy [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7e73e24d5b1489c813f06690b12eef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b6bfae34944fcfbd49d2f18b232ec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:49 user nova-compute[75071]: INFO nova.virt.block_device [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Booting with volume 8ec07bbd-2382-4b77-9612-c773344113f0 at /dev/vda
Dec 05 12:27:49 user nova-compute[75071]: DEBUG os_brick.utils [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd9cd2a-5e3b-4411-8f2c-467af3486101]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd185fc-875a-47b4-88bf-69f87bc7353d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae807cd8-c492-490d-8a79-45b913902cbe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91f6349-c376-4198-a82d-d1a3d761026b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:27:49 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d31855-e205-4d9a-b52c-808843da05bd]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG os_brick.utils [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Updating existing volume attachment record: ad3e1165-f85a-4436-8d6d-c0c26b963350 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG nova.network.neutron [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Successfully created port: 0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:50 user nova-compute[75071]: DEBUG nova.network.neutron [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Successfully updated port: 0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:27:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "refresh_cache-c2b46f1c-dce6-4436-8e1e-062ffda80732" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:27:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquired lock "refresh_cache-c2b46f1c-dce6-4436-8e1e-062ffda80732" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:27:50 user nova-compute[75071]: DEBUG nova.network.neutron [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:27:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-3b9ec40e-44f0-4b49-95a7-d647a0b52ee7 req-622e493f-43eb-45a9-8239-032500457f84 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Received event network-changed-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:27:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-3b9ec40e-44f0-4b49-95a7-d647a0b52ee7 req-622e493f-43eb-45a9-8239-032500457f84 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Refreshing instance network info cache due to event network-changed-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:27:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3b9ec40e-44f0-4b49-95a7-d647a0b52ee7 req-622e493f-43eb-45a9-8239-032500457f84 service nova] Acquiring lock "refresh_cache-c2b46f1c-dce6-4436-8e1e-062ffda80732" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:27:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:27:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:50 user nova-compute[75071]: DEBUG nova.network.neutron [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:27:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:50 user nova-compute[75071]: DEBUG nova.network.neutron [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Updating instance_info_cache with network_info: [{"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:27:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Releasing lock "refresh_cache-c2b46f1c-dce6-4436-8e1e-062ffda80732" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Instance network_info: |[{"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3b9ec40e-44f0-4b49-95a7-d647a0b52ee7 req-622e493f-43eb-45a9-8239-032500457f84 service nova] Acquired lock "refresh_cache-c2b46f1c-dce6-4436-8e1e-062ffda80732" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG nova.network.neutron [req-3b9ec40e-44f0-4b49-95a7-d647a0b52ee7 req-622e493f-43eb-45a9-8239-032500457f84 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Refreshing network info cache for port 0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:27:51 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:27:51 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:27:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=7601MB free_disk=25.029502868652344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Applying migration context for instance c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 as it has an incoming, in-progress migration cb889f27-40cc-4594-8c24-ab4a23f7cda9. Migration status is finished {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 05 12:27:51 user nova-compute[75071]: INFO nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Updating resource usage from migration cb889f27-40cc-4594-8c24-ab4a23f7cda9
Dec 05 12:27:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e08be776-0fa9-4871-86eb-2093530c00f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 386e93a2-2435-4d5f-bee2-fdb5f52fd476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance a99a0331-1d77-4b71-9ef7-0794778b3ef1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Migration cb889f27-40cc-4594-8c24-ab4a23f7cda9 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance cad9a071-e232-4629-a3cc-9cb9d3fe9333 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 2704ba7b-5e66-4348-a0fb-181465476095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c2b46f1c-dce6-4436-8e1e-062ffda80732 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:27:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:27:52 user nova-compute[75071]: DEBUG nova.network.neutron [req-3b9ec40e-44f0-4b49-95a7-d647a0b52ee7 req-622e493f-43eb-45a9-8239-032500457f84 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Updated VIF entry in instance network info cache for port 0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:27:52 user nova-compute[75071]: DEBUG nova.network.neutron [req-3b9ec40e-44f0-4b49-95a7-d647a0b52ee7 req-622e493f-43eb-45a9-8239-032500457f84 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Updating instance_info_cache with network_info: [{"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:27:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3b9ec40e-44f0-4b49-95a7-d647a0b52ee7 req-622e493f-43eb-45a9-8239-032500457f84 service nova] Releasing lock "refresh_cache-c2b46f1c-dce6-4436-8e1e-062ffda80732" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:27:52 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:27:52 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:27:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:27:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.684s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:52 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:27:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 12:27:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 12:27:52 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:27:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 12:27:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:27:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:27:54 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:27:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:54 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Updating instance_info_cache with network_info: [{"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:27:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:27:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:27:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:27:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:27:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:27:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:27:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:27:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Creating image(s)
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Ensure instance console log exists: /opt/stack/data/nova/instances/c2b46f1c-dce6-4436-8e1e-062ffda80732/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Start _get_guest_xml network_info=[{"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'ad3e1165-f85a-4436-8d6d-c0c26b963350', 'device_type': 'disk', 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMDuqjzy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c2b46f1c-dce6-4436-8e1e-062ffda80732', 'attached_at': '', 'detached_at': '', 'volume_id': '8ec07bbd-2382-4b77-9612-c773344113f0', 'serial': '8ec07bbd-2382-4b77-9612-c773344113f0'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:27:59 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:27:59 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMDuqjzy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:27:59 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:27:59 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:27:59 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b57588-be33-4ff8-bb62-b7d5486dee94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:27:59 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0085a7-6690-4328-9449-b3746e95fbe8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0] added
Dec 05 12:27:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[121d9ea9-42b5-46cf-9b1d-55a0dd7f16f1]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8d24aa-1407-4fd7-b451-83e170c92be8]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sMDuqjzy {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sMDuqjzy" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[094a7e45-de17-45df-923e-e72729f2beaf]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sMDuqjzy'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d720d9e-e940-4440-9ecb-d0323e2e6f0e]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1448d8da-7251-464f-b10f-451acd1bc7cf]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:27:59 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:27:59 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:27:59 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)
Dec 05 12:27:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:27:59 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:27:59 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:27:59 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)
Dec 05 12:27:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e34770-e509-4c1f-978a-bafdb7d01e0a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0, portal: 172.16.0.220,3260]
Dec 05 12:27:59 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0, portal: 172.16.0.220,3260] successful.
Dec 05 12:27:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1b5899-b666-4c5a-9749-d7110a9faa2a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e947c5-acc0-48b3-b768-b9d14aa9fa2f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:27:59 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:27:59 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:27:59 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)
Dec 05 12:27:59 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:27:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:27:59 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:27:59 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:27:59 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)
Dec 05 12:27:59 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:27:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f189374-1857-42e3-82c5-99cbc666c6b7]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:27:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMDuqjzy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:28:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:28:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23133613339663534', 'path': '/dev/sde'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:28:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133613339663534', 'path': '/dev/sde'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:28:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-838854064',display_name='tempest-ServerActionsTestOtherA-server-838854064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-838854064',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr4CxHIGILJKylwCAW1k5g9hHm3DpT3NJj15aFaT5zmT7LmQxPRChXNHnUJDBNGMOIF2KjOMuY9sG7Diwqrmevv8WAXt0F+z6Y+uzBIRaBoBEcSXjeLaXdD3Dv6NXOVGQ==',key_name='tempest-keypair-237629817',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59b6bfae34944fcfbd49d2f18b232ec8',ramdisk_id='',reservation_id='r-34l73x5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1523780015',owner_user_name='tempest-ServerActionsTestOtherA-1523780015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e73e24d5b1489c813f06690b12eef4',uuid=c2b46f1c-dce6-4436-8e1e-062ffda80732,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:28:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converting VIF {"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:28:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7fb9d1-89') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:28:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lazy-loading 'pci_devices' on Instance uuid c2b46f1c-dce6-4436-8e1e-062ffda80732 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:28:01 user nova-compute[75071]:   <uuid>c2b46f1c-dce6-4436-8e1e-062ffda80732</uuid>
Dec 05 12:28:01 user nova-compute[75071]:   <name>instance-0000001d</name>
Dec 05 12:28:01 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:28:01 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:28:01 user nova-compute[75071]:   <metadata>
Dec 05 12:28:01 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:28:01 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:28:01 user nova-compute[75071]:       <nova:name>tempest-ServerActionsTestOtherA-server-838854064</nova:name>
Dec 05 12:28:01 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:27:59</nova:creationTime>
Dec 05 12:28:01 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:28:01 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:28:01 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:28:01 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:28:01 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:28:01 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:28:01 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:28:01 user nova-compute[75071]:       <nova:owner>
Dec 05 12:28:01 user nova-compute[75071]:         <nova:user uuid="d7e73e24d5b1489c813f06690b12eef4">tempest-ServerActionsTestOtherA-1523780015-project-member</nova:user>
Dec 05 12:28:01 user nova-compute[75071]:         <nova:project uuid="59b6bfae34944fcfbd49d2f18b232ec8">tempest-ServerActionsTestOtherA-1523780015</nova:project>
Dec 05 12:28:01 user nova-compute[75071]:       </nova:owner>
Dec 05 12:28:01 user nova-compute[75071]:       <nova:ports>
Dec 05 12:28:01 user nova-compute[75071]:         <nova:port uuid="0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258">
Dec 05 12:28:01 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 05 12:28:01 user nova-compute[75071]:         </nova:port>
Dec 05 12:28:01 user nova-compute[75071]:       </nova:ports>
Dec 05 12:28:01 user nova-compute[75071]:     </nova:instance>
Dec 05 12:28:01 user nova-compute[75071]:   </metadata>
Dec 05 12:28:01 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:28:01 user nova-compute[75071]:     <system>
Dec 05 12:28:01 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:28:01 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:28:01 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:28:01 user nova-compute[75071]:       <entry name="serial">c2b46f1c-dce6-4436-8e1e-062ffda80732</entry>
Dec 05 12:28:01 user nova-compute[75071]:       <entry name="uuid">c2b46f1c-dce6-4436-8e1e-062ffda80732</entry>
Dec 05 12:28:01 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:28:01 user nova-compute[75071]:     </system>
Dec 05 12:28:01 user nova-compute[75071]:   </sysinfo>
Dec 05 12:28:01 user nova-compute[75071]:   <os>
Dec 05 12:28:01 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:28:01 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:28:01 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:28:01 user nova-compute[75071]:   </os>
Dec 05 12:28:01 user nova-compute[75071]:   <features>
Dec 05 12:28:01 user nova-compute[75071]:     <acpi/>
Dec 05 12:28:01 user nova-compute[75071]:     <apic/>
Dec 05 12:28:01 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:28:01 user nova-compute[75071]:   </features>
Dec 05 12:28:01 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:28:01 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:28:01 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:28:01 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:28:01 user nova-compute[75071]:   </clock>
Dec 05 12:28:01 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:28:01 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:28:01 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:28:01 user nova-compute[75071]:   </cpu>
Dec 05 12:28:01 user nova-compute[75071]:   <devices>
Dec 05 12:28:01 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:28:01 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:28:01 user nova-compute[75071]:       <source dev="/dev/sde"/>
Dec 05 12:28:01 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:28:01 user nova-compute[75071]:       <serial>8ec07bbd-2382-4b77-9612-c773344113f0</serial>
Dec 05 12:28:01 user nova-compute[75071]:     </disk>
Dec 05 12:28:01 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:28:01 user nova-compute[75071]:       <mac address="fa:16:3e:39:95:8a"/>
Dec 05 12:28:01 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:28:01 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:28:01 user nova-compute[75071]:       <target dev="tap0a7fb9d1-89"/>
Dec 05 12:28:01 user nova-compute[75071]:     </interface>
Dec 05 12:28:01 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:28:01 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/c2b46f1c-dce6-4436-8e1e-062ffda80732/console.log" append="off"/>
Dec 05 12:28:01 user nova-compute[75071]:     </serial>
Dec 05 12:28:01 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:28:01 user nova-compute[75071]:     <video>
Dec 05 12:28:01 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:28:01 user nova-compute[75071]:     </video>
Dec 05 12:28:01 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:28:01 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:28:01 user nova-compute[75071]:     </rng>
Dec 05 12:28:01 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:28:01 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:28:01 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:28:01 user nova-compute[75071]:     </memballoon>
Dec 05 12:28:01 user nova-compute[75071]:   </devices>
Dec 05 12:28:01 user nova-compute[75071]: </domain>
Dec 05 12:28:01 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-838854064',display_name='tempest-ServerActionsTestOtherA-server-838854064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-838854064',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr4CxHIGILJKylwCAW1k5g9hHm3DpT3NJj15aFaT5zmT7LmQxPRChXNHnUJDBNGMOIF2KjOMuY9sG7Diwqrmevv8WAXt0F+z6Y+uzBIRaBoBEcSXjeLaXdD3Dv6NXOVGQ==',key_name='tempest-keypair-237629817',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59b6bfae34944fcfbd49d2f18b232ec8',ramdisk_id='',reservation_id='r-34l73x5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1523780015',owner_user_name='tempest-ServerActionsTestOtherA-1523780015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:27:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e73e24d5b1489c813f06690b12eef4',uuid=c2b46f1c-dce6-4436-8e1e-062ffda80732,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converting VIF {"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7fb9d1-89') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG os_vif [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7fb9d1-89') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd26f9cc-c606-5a38-ada5-988c16c5fbb8', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a7fb9d1-89, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a7fb9d1-89, col_values=(('qos', UUID('e47eea3e-59db-42ec-9cc7-1486ce6ed6cd')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a7fb9d1-89, col_values=(('external_ids', {'iface-id': '0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:95:8a', 'vm-uuid': 'c2b46f1c-dce6-4436-8e1e-062ffda80732'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:01 user nova-compute[75071]: INFO os_vif [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7fb9d1-89')
Dec 05 12:28:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:28:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] No VIF found with MAC fa:16:3e:39:95:8a, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:28:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-c2f8ef4c-525c-4fa9-9671-aac0d78c7e33 req-77b9451d-52f2-46ea-a3f0-b10340259552 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Received event network-vif-plugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c2f8ef4c-525c-4fa9-9671-aac0d78c7e33 req-77b9451d-52f2-46ea-a3f0-b10340259552 service nova] Acquiring lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c2f8ef4c-525c-4fa9-9671-aac0d78c7e33 req-77b9451d-52f2-46ea-a3f0-b10340259552 service nova] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c2f8ef4c-525c-4fa9-9671-aac0d78c7e33 req-77b9451d-52f2-46ea-a3f0-b10340259552 service nova] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-c2f8ef4c-525c-4fa9-9671-aac0d78c7e33 req-77b9451d-52f2-46ea-a3f0-b10340259552 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] No waiting events found dispatching network-vif-plugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:02 user nova-compute[75071]: WARNING nova.compute.manager [req-c2f8ef4c-525c-4fa9-9671-aac0d78c7e33 req-77b9451d-52f2-46ea-a3f0-b10340259552 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Received unexpected event network-vif-plugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 for instance with vm_state building and task_state spawning.
Dec 05 12:28:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:28:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:28:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-a82f83e6-700f-408a-bd7b-ca778f19cdb0 req-c3dede3d-f8ca-455a-b175-93640140f77f service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Received event network-vif-plugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a82f83e6-700f-408a-bd7b-ca778f19cdb0 req-c3dede3d-f8ca-455a-b175-93640140f77f service nova] Acquiring lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a82f83e6-700f-408a-bd7b-ca778f19cdb0 req-c3dede3d-f8ca-455a-b175-93640140f77f service nova] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a82f83e6-700f-408a-bd7b-ca778f19cdb0 req-c3dede3d-f8ca-455a-b175-93640140f77f service nova] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-a82f83e6-700f-408a-bd7b-ca778f19cdb0 req-c3dede3d-f8ca-455a-b175-93640140f77f service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] No waiting events found dispatching network-vif-plugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:04 user nova-compute[75071]: WARNING nova.compute.manager [req-a82f83e6-700f-408a-bd7b-ca778f19cdb0 req-c3dede3d-f8ca-455a-b175-93640140f77f service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Received unexpected event network-vif-plugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 for instance with vm_state building and task_state spawning.
Dec 05 12:28:04 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Instance spawned successfully.
Dec 05 12:28:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:28:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:28:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:28:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:28:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:28:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:28:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:28:04 user nova-compute[75071]: INFO nova.compute.manager [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Took 5.17 seconds to spawn the instance on the hypervisor.
Dec 05 12:28:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:28:04 user nova-compute[75071]: INFO nova.compute.manager [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Took 16.66 seconds to build instance.
Dec 05 12:28:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7c694250-1b5e-4b97-8958-c3609c61f1ba tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.833s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Port 5077ca66-d74d-4ad0-abee-fe0ea86d67ac binding to destination host user is already ACTIVE {{(pid=75071) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 05 12:28:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:28:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquired lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:28:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:28:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Updating instance_info_cache with network_info: [{"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:28:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Releasing lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:28:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Creating tmpfile /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/tmp4s_pgec1 to verify with other compute node that the instance is on the same shared storage. {{(pid=75071) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-7f7b2cc6-b979-47b2-845b-ef5705f3785e req-30e4e5c6-256b-4faf-a9fa-b5fc2b5eedfb service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-unplugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7f7b2cc6-b979-47b2-845b-ef5705f3785e req-30e4e5c6-256b-4faf-a9fa-b5fc2b5eedfb service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7f7b2cc6-b979-47b2-845b-ef5705f3785e req-30e4e5c6-256b-4faf-a9fa-b5fc2b5eedfb service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7f7b2cc6-b979-47b2-845b-ef5705f3785e req-30e4e5c6-256b-4faf-a9fa-b5fc2b5eedfb service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-7f7b2cc6-b979-47b2-845b-ef5705f3785e req-30e4e5c6-256b-4faf-a9fa-b5fc2b5eedfb service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-unplugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:07 user nova-compute[75071]: WARNING nova.compute.manager [req-7f7b2cc6-b979-47b2-845b-ef5705f3785e req-30e4e5c6-256b-4faf-a9fa-b5fc2b5eedfb service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received unexpected event network-vif-unplugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with vm_state resized and task_state resize_reverting.
Dec 05 12:28:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:07 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Instance destroyed successfully.
Dec 05 12:28:07 user nova-compute[75071]: DEBUG nova.objects.instance [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lazy-loading 'resources' on Instance uuid c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:22:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-610057875',display_name='tempest-ServerActionsTestOtherB-server-610057875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-610057875',id=19,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD//5LMlmnSypPzSdRI5jpZ9XqSwL0meBfIrwjAimv5kjQelxMdWSK8Bf7Pi316SOZkmu0iNhVkGJ6EvGf+c87dPNcnj3FJiHI1f2q3NnaFYTTYG6q/U8Y9vdkHGXYuKCg==',key_name='tempest-keypair-186552237',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:26:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee29a575739045dd9db612290cfa9620',ramdisk_id='',reservation_id='r-0dy2tt38',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1001076821',owner_user_name='tempest-ServerActionsTestOtherB-1001076821-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:26:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a213d662f65e41fa8cc3a20e736ca757',uuid=c89c29d3-b60e-4dc5-a895-f9fe84ed69a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Converting VIF {"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG os_vif [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5077ca66-d7, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05d44f0b-0d16-4bdc-b6d5-7aef6e6c4a05) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:28:07 user nova-compute[75071]: INFO os_vif [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7')
Dec 05 12:28:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNozAuVF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:28:07 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[645a3baa-fba1-442e-bb2a-2c2ee0af01de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:28:07 user nova-compute[75071]: No targets found.
Dec 05 12:28:07 user nova-compute[75071]: iSNS:
Dec 05 12:28:07 user nova-compute[75071]: No targets found.
Dec 05 12:28:07 user nova-compute[75071]: STATIC:
Dec 05 12:28:07 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98
Dec 05 12:28:07 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:28:07 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:28:07 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:28:07 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:28:07 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:28:07 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883
Dec 05 12:28:07 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:28:07 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:28:07 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0
Dec 05 12:28:07 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:28:07 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:28:07 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546
Dec 05 12:28:07 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:28:07 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:28:07 user nova-compute[75071]: FIRMWARE:
Dec 05 12:28:07 user nova-compute[75071]: No targets found.
Dec 05 12:28:07 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:28:07 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:28:07 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e42e7ab-7733-4781-b920-225d2192681a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[53381a99-eac9-446b-92fd-70ff57a59693]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:28:08 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:28:08 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:28:08 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)
Dec 05 12:28:08 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:28:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:28:08 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:28:08 user nova-compute[75071]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:28:08 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)
Dec 05 12:28:08 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:28:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f827c19eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546'): ({'sdd'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Removing single pathed devices sdd {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e935470a-09a0-4686-944b-3c1accb29aa7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a7a44c-7f16-4251-bc1c-dd741346add8]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Flushing IO for device /dev/sdd {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce4e0ef-fbb7-41fe-b595-a9356fa1702a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed341fe8-166e-410c-a785-1991943c6f7e]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2f7e2f-7a08-4e40-b611-fdb0ad9e64c0]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1807f4dc-7770-407c-a9d6-3ba92921b3a8]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260]
Dec 05 12:28:08 user nova-compute[75071]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260] successful.
Dec 05 12:28:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62746e2-1c74-4a14-9bc3-293cbf50fb96]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] <== disconnect_volume: return (389ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-fee5733a-1e64-4c8e-b9ce-726180bb5827 req-19357e95-28b5-4563-bf4c-5b7a23d4ef31 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received event network-changed-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-fee5733a-1e64-4c8e-b9ce-726180bb5827 req-19357e95-28b5-4563-bf4c-5b7a23d4ef31 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Refreshing instance network info cache due to event network-changed-580a2511-2f94-4e37-af8e-3a3b72654b35. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fee5733a-1e64-4c8e-b9ce-726180bb5827 req-19357e95-28b5-4563-bf4c-5b7a23d4ef31 service nova] Acquiring lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fee5733a-1e64-4c8e-b9ce-726180bb5827 req-19357e95-28b5-4563-bf4c-5b7a23d4ef31 service nova] Acquired lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-fee5733a-1e64-4c8e-b9ce-726180bb5827 req-19357e95-28b5-4563-bf4c-5b7a23d4ef31 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Refreshing network info cache for port 580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-fee5733a-1e64-4c8e-b9ce-726180bb5827 req-19357e95-28b5-4563-bf4c-5b7a23d4ef31 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Updated VIF entry in instance network info cache for port 580a2511-2f94-4e37-af8e-3a3b72654b35. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-fee5733a-1e64-4c8e-b9ce-726180bb5827 req-19357e95-28b5-4563-bf4c-5b7a23d4ef31 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Updating instance_info_cache with network_info: [{"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fee5733a-1e64-4c8e-b9ce-726180bb5827 req-19357e95-28b5-4563-bf4c-5b7a23d4ef31 service nova] Releasing lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.objects.instance [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lazy-loading 'migration_context' on Instance uuid c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.objects.base [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Object Instance<c89c29d3-b60e-4dc5-a895-f9fe84ed69a7> lazy-loaded attributes: resources,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Refreshing inventories for resource provider 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Updating ProviderTree inventory for provider 25beb694-9dd7-475f-9657-74a5f0368417 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Updating inventory in ProviderTree for provider 25beb694-9dd7-475f-9657-74a5f0368417 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Refreshing aggregate associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:09 user nova-compute[75071]: WARNING nova.compute.manager [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received unexpected event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with vm_state resized and task_state resize_reverting.
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:09 user nova-compute[75071]: WARNING nova.compute.manager [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received unexpected event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with vm_state resized and task_state resize_reverting.
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:09 user nova-compute[75071]: WARNING nova.compute.manager [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received unexpected event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with vm_state resized and task_state resize_reverting.
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-unplugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-unplugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:09 user nova-compute[75071]: WARNING nova.compute.manager [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received unexpected event network-vif-unplugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with vm_state resized and task_state resize_reverting.
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:09 user nova-compute[75071]: WARNING nova.compute.manager [req-0b7ab3c0-b78a-4d4d-b017-59abfcbd332f req-1f0caa91-8bf5-43de-bcde-c37c9c5dca8b service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received unexpected event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with vm_state resized and task_state resize_reverting.
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Refreshing trait associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:09 user nova-compute[75071]: INFO nova.compute.manager [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Detaching volume 17e7e797-0041-4e40-93bc-c90c42e45a98
Dec 05 12:28:09 user nova-compute[75071]: INFO nova.virt.block_device [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Attempting to driver detach volume 17e7e797-0041-4e40-93bc-c90c42e45a98 from mountpoint /dev/vdb
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Attempting to detach device vdb from instance 386e93a2-2435-4d5f-bee2-fdb5f52fd476 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:28:09 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:28:09 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:28:09 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:28:09 user nova-compute[75071]:   <serial>17e7e797-0041-4e40-93bc-c90c42e45a98</serial>
Dec 05 12:28:09 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 12:28:09 user nova-compute[75071]: </disk>
Dec 05 12:28:09 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:28:09 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Successfully detached device vdb from instance 386e93a2-2435-4d5f-bee2-fdb5f52fd476 from the persistent domain config.
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 386e93a2-2435-4d5f-bee2-fdb5f52fd476 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:28:09 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:28:09 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:28:09 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:28:09 user nova-compute[75071]:   <serial>17e7e797-0041-4e40-93bc-c90c42e45a98</serial>
Dec 05 12:28:09 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 12:28:09 user nova-compute[75071]: </disk>
Dec 05 12:28:09 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:28:09 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:28:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.633s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:10 user nova-compute[75071]: INFO nova.compute.manager [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Swapping old allocation on dict_keys(['25beb694-9dd7-475f-9657-74a5f0368417']) held by migration cb889f27-40cc-4594-8c24-ab4a23f7cda9 for instance
Dec 05 12:28:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 386e93a2-2435-4d5f-bee2-fdb5f52fd476 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:28:10 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Overwriting current allocation {'allocations': {'25beb694-9dd7-475f-9657-74a5f0368417': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 34}}, 'project_id': 'ee29a575739045dd9db612290cfa9620', 'user_id': 'a213d662f65e41fa8cc3a20e736ca757', 'consumer_generation': 1} on consumer c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 {{(pid=75071) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Dec 05 12:28:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:28:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquired lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:28:10 user nova-compute[75071]: DEBUG nova.network.neutron [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:28:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-4cccf624-b00d-4f6d-b1e4-ef31140bfa64 req-174874d3-7c70-447a-acb6-cf05d8edca2a service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received event network-changed-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-4cccf624-b00d-4f6d-b1e4-ef31140bfa64 req-174874d3-7c70-447a-acb6-cf05d8edca2a service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Refreshing instance network info cache due to event network-changed-580a2511-2f94-4e37-af8e-3a3b72654b35. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:28:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4cccf624-b00d-4f6d-b1e4-ef31140bfa64 req-174874d3-7c70-447a-acb6-cf05d8edca2a service nova] Acquiring lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:28:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4cccf624-b00d-4f6d-b1e4-ef31140bfa64 req-174874d3-7c70-447a-acb6-cf05d8edca2a service nova] Acquired lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:28:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-4cccf624-b00d-4f6d-b1e4-ef31140bfa64 req-174874d3-7c70-447a-acb6-cf05d8edca2a service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Refreshing network info cache for port 580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG nova.network.neutron [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Updating instance_info_cache with network_info: [{"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Releasing lock "refresh_cache-c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG os_brick.utils [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd29a7f-ba9a-4567-ac33-2f6df21a7a0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1254e35b-3425-41a6-8035-d8f65048b73c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b47120-8176-4928-8b8c-acfb8c0dc441]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec6ad2a-492a-4765-8c73-9a8f860d788a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-4cccf624-b00d-4f6d-b1e4-ef31140bfa64 req-174874d3-7c70-447a-acb6-cf05d8edca2a service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Updated VIF entry in instance network info cache for port 580a2511-2f94-4e37-af8e-3a3b72654b35. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-4cccf624-b00d-4f6d-b1e4-ef31140bfa64 req-174874d3-7c70-447a-acb6-cf05d8edca2a service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Updating instance_info_cache with network_info: [{"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4cccf624-b00d-4f6d-b1e4-ef31140bfa64 req-174874d3-7c70-447a-acb6-cf05d8edca2a service nova] Releasing lock "refresh_cache-386e93a2-2435-4d5f-bee2-fdb5f52fd476" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:28:11 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:28:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[90467c6b-48d4-4420-a829-4a2cb38602c5]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:28:11 user nova-compute[75071]: DEBUG os_brick.utils [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:28:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:28:18 user nova-compute[75071]: INFO nova.compute.manager [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] instance snapshotting
Dec 05 12:28:18 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Beginning live snapshot process
Dec 05 12:28:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json -f qcow2 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json -f qcow2" returned: 0 in 0.227s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json -f qcow2 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptq3fe8t0/9651fa508dda41aa814905fe1d1e33ee.delta 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptq3fe8t0/9651fa508dda41aa814905fe1d1e33ee.delta 1073741824" returned: 0 in 0.052s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:18 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 05 12:28:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:28:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:28:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 05 12:28:20 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 12:28:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptq3fe8t0/9651fa508dda41aa814905fe1d1e33ee.delta /opt/stack/data/nova/instances/snapshots/tmptq3fe8t0/9651fa508dda41aa814905fe1d1e33ee {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptq3fe8t0/9651fa508dda41aa814905fe1d1e33ee.delta /opt/stack/data/nova/instances/snapshots/tmptq3fe8t0/9651fa508dda41aa814905fe1d1e33ee" returned: 0 in 0.698s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Snapshot extracted, beginning image upload
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Starting finish_revert_migration {{(pid=75071) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11813}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Start _get_guest_xml network_info=[{"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'b8338251-038e-46e4-b843-eb92b69af29f', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNozAuVF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c89c29d3-b60e-4dc5-a895-f9fe84ed69a7', 'attached_at': '2023-12-05T12:28:21.000000', 'detached_at': '', 'volume_id': '48cf8d9f-f91d-4855-b810-453ede3eb546', 'serial': '48cf8d9f-f91d-4855-b810-453ede3eb546'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:28:21 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:28:21 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.objects.instance [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lazy-loading 'vcpu_model' on Instance uuid c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNozAuVF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:28:21 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:28:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:28:21 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:28:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:28:21 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:28:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8071733e-1838-4c55-89b8-a8e59f84c0c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:28:21 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f843cb-08f0-472e-bd6d-3e1f6c6a5d3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546] added
Dec 05 12:28:21 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2490f1-2114-45ca-8300-9ddb9495f8ac]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a39d7d-d794-4014-a4a9-03fc98f2c167]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNozAuVF {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNozAuVF" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a4e338-2485-4817-8cb6-a064c85d8514]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kNozAuVF'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[794bacae-6f0a-45e6-871c-88675952ef8f]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:28:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a22d7c-5f3f-415a-a3cc-dedc69ceca6f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:28:22 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:28:22 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)
Dec 05 12:28:22 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:28:22 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:28:22 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:28:22 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)
Dec 05 12:28:22 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:28:22 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59198f4-bd43-4ae1-aa56-edb53900804f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260]
Dec 05 12:28:22 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260] successful.
Dec 05 12:28:22 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[143b6b03-1e80-45a4-b1c5-3e14bda53e2b]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a4b28c-8ed9-4202-ab62-bc649b88f752]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:28:22 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:28:22 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)
Dec 05 12:28:22 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:28:22 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:28:22 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:28:22 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:28:22 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)
Dec 05 12:28:22 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:28:22 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:28:22 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[980b3593-f594-40e9-89bf-9ca613e9fb46]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNozAuVF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:28:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26530306139333763', 'path': '/dev/sdd'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530306139333763', 'path': '/dev/sdd'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:22:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-610057875',display_name='tempest-ServerActionsTestOtherB-server-610057875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-610057875',id=19,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD//5LMlmnSypPzSdRI5jpZ9XqSwL0meBfIrwjAimv5kjQelxMdWSK8Bf7Pi316SOZkmu0iNhVkGJ6EvGf+c87dPNcnj3FJiHI1f2q3NnaFYTTYG6q/U8Y9vdkHGXYuKCg==',key_name='tempest-keypair-186552237',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:26:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ee29a575739045dd9db612290cfa9620',ramdisk_id='',reservation_id='r-0dy2tt38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1001076821',owner_user_name='tempest-ServerActionsTestOtherB-1001076821-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:28:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a213d662f65e41fa8cc3a20e736ca757',uuid=c89c29d3-b60e-4dc5-a895-f9fe84ed69a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Converting VIF {"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:28:23 user nova-compute[75071]:   <uuid>c89c29d3-b60e-4dc5-a895-f9fe84ed69a7</uuid>
Dec 05 12:28:23 user nova-compute[75071]:   <name>instance-00000013</name>
Dec 05 12:28:23 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:28:23 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:28:23 user nova-compute[75071]:   <metadata>
Dec 05 12:28:23 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:28:23 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:28:23 user nova-compute[75071]:       <nova:name>tempest-ServerActionsTestOtherB-server-610057875</nova:name>
Dec 05 12:28:23 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:28:21</nova:creationTime>
Dec 05 12:28:23 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:28:23 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:28:23 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:28:23 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:28:23 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:28:23 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:28:23 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:28:23 user nova-compute[75071]:       <nova:owner>
Dec 05 12:28:23 user nova-compute[75071]:         <nova:user uuid="a213d662f65e41fa8cc3a20e736ca757">tempest-ServerActionsTestOtherB-1001076821-project-member</nova:user>
Dec 05 12:28:23 user nova-compute[75071]:         <nova:project uuid="ee29a575739045dd9db612290cfa9620">tempest-ServerActionsTestOtherB-1001076821</nova:project>
Dec 05 12:28:23 user nova-compute[75071]:       </nova:owner>
Dec 05 12:28:23 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:28:23 user nova-compute[75071]:       <nova:ports>
Dec 05 12:28:23 user nova-compute[75071]:         <nova:port uuid="5077ca66-d74d-4ad0-abee-fe0ea86d67ac">
Dec 05 12:28:23 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 05 12:28:23 user nova-compute[75071]:         </nova:port>
Dec 05 12:28:23 user nova-compute[75071]:       </nova:ports>
Dec 05 12:28:23 user nova-compute[75071]:     </nova:instance>
Dec 05 12:28:23 user nova-compute[75071]:   </metadata>
Dec 05 12:28:23 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:28:23 user nova-compute[75071]:     <system>
Dec 05 12:28:23 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:28:23 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:28:23 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:28:23 user nova-compute[75071]:       <entry name="serial">c89c29d3-b60e-4dc5-a895-f9fe84ed69a7</entry>
Dec 05 12:28:23 user nova-compute[75071]:       <entry name="uuid">c89c29d3-b60e-4dc5-a895-f9fe84ed69a7</entry>
Dec 05 12:28:23 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:28:23 user nova-compute[75071]:     </system>
Dec 05 12:28:23 user nova-compute[75071]:   </sysinfo>
Dec 05 12:28:23 user nova-compute[75071]:   <os>
Dec 05 12:28:23 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:28:23 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:28:23 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:28:23 user nova-compute[75071]:   </os>
Dec 05 12:28:23 user nova-compute[75071]:   <features>
Dec 05 12:28:23 user nova-compute[75071]:     <acpi/>
Dec 05 12:28:23 user nova-compute[75071]:     <apic/>
Dec 05 12:28:23 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:28:23 user nova-compute[75071]:   </features>
Dec 05 12:28:23 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:28:23 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:28:23 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:28:23 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:28:23 user nova-compute[75071]:   </clock>
Dec 05 12:28:23 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:28:23 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:28:23 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:28:23 user nova-compute[75071]:   </cpu>
Dec 05 12:28:23 user nova-compute[75071]:   <devices>
Dec 05 12:28:23 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:28:23 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:28:23 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk"/>
Dec 05 12:28:23 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:28:23 user nova-compute[75071]:     </disk>
Dec 05 12:28:23 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:28:23 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:28:23 user nova-compute[75071]:       <source dev="/dev/sdd"/>
Dec 05 12:28:23 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Dec 05 12:28:23 user nova-compute[75071]:       <serial>48cf8d9f-f91d-4855-b810-453ede3eb546</serial>
Dec 05 12:28:23 user nova-compute[75071]:     </disk>
Dec 05 12:28:23 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:28:23 user nova-compute[75071]:       <mac address="fa:16:3e:de:d7:62"/>
Dec 05 12:28:23 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:28:23 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:28:23 user nova-compute[75071]:       <target dev="tap5077ca66-d7"/>
Dec 05 12:28:23 user nova-compute[75071]:     </interface>
Dec 05 12:28:23 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:28:23 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/console.log" append="off"/>
Dec 05 12:28:23 user nova-compute[75071]:     </serial>
Dec 05 12:28:23 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:28:23 user nova-compute[75071]:     <video>
Dec 05 12:28:23 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:28:23 user nova-compute[75071]:     </video>
Dec 05 12:28:23 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:28:23 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:28:23 user nova-compute[75071]:     </rng>
Dec 05 12:28:23 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:28:23 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:28:23 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:28:23 user nova-compute[75071]:     </memballoon>
Dec 05 12:28:23 user nova-compute[75071]:   </devices>
Dec 05 12:28:23 user nova-compute[75071]: </domain>
Dec 05 12:28:23 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:22:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-610057875',display_name='tempest-ServerActionsTestOtherB-server-610057875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-610057875',id=19,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD//5LMlmnSypPzSdRI5jpZ9XqSwL0meBfIrwjAimv5kjQelxMdWSK8Bf7Pi316SOZkmu0iNhVkGJ6EvGf+c87dPNcnj3FJiHI1f2q3NnaFYTTYG6q/U8Y9vdkHGXYuKCg==',key_name='tempest-keypair-186552237',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:26:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ee29a575739045dd9db612290cfa9620',ramdisk_id='',reservation_id='r-0dy2tt38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1001076821',owner_user_name='tempest-ServerActionsTestOtherB-1001076821-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:28:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a213d662f65e41fa8cc3a20e736ca757',uuid=c89c29d3-b60e-4dc5-a895-f9fe84ed69a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Converting VIF {"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG os_vif [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a26441c-5832-55ed-b6e2-b2eb5e1fadaa', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5077ca66-d7, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5077ca66-d7, col_values=(('qos', UUID('11acedbd-2b0f-4dbe-a76c-87a7cff61c5c')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5077ca66-d7, col_values=(('external_ids', {'iface-id': '5077ca66-d74d-4ad0-abee-fe0ea86d67ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:d7:62', 'vm-uuid': 'c89c29d3-b60e-4dc5-a895-f9fe84ed69a7'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:23 user nova-compute[75071]: INFO os_vif [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7')
Dec 05 12:28:23 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Snapshot image upload complete
Dec 05 12:28:23 user nova-compute[75071]: INFO nova.compute.manager [None req-1fd5ebc1-869c-4b48-ad30-29441ffc6903 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Took 5.56 seconds to snapshot the instance on the hypervisor.
Dec 05 12:28:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-f381e7b0-ce64-4fac-9d04-fe9492e1e4ca req-a772da9c-efe7-48c3-b1de-d54277e34264 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f381e7b0-ce64-4fac-9d04-fe9492e1e4ca req-a772da9c-efe7-48c3-b1de-d54277e34264 service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f381e7b0-ce64-4fac-9d04-fe9492e1e4ca req-a772da9c-efe7-48c3-b1de-d54277e34264 service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f381e7b0-ce64-4fac-9d04-fe9492e1e4ca req-a772da9c-efe7-48c3-b1de-d54277e34264 service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-f381e7b0-ce64-4fac-9d04-fe9492e1e4ca req-a772da9c-efe7-48c3-b1de-d54277e34264 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:24 user nova-compute[75071]: WARNING nova.compute.manager [req-f381e7b0-ce64-4fac-9d04-fe9492e1e4ca req-a772da9c-efe7-48c3-b1de-d54277e34264 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received unexpected event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with vm_state resized and task_state resize_reverting.
Dec 05 12:28:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "20883e1b-4595-44c9-9855-3160fb16d148" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "20883e1b-4595-44c9-9855-3160fb16d148" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:26 user nova-compute[75071]: DEBUG nova.compute.manager [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:28:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:26 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:28:26 user nova-compute[75071]: INFO nova.compute.claims [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Claim successful on node user
Dec 05 12:28:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-a9c00391-a027-48ec-97c1-e2eeaeae8327 req-db121ef2-7cd2-44e7-820a-19b676cafa7d service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a9c00391-a027-48ec-97c1-e2eeaeae8327 req-db121ef2-7cd2-44e7-820a-19b676cafa7d service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a9c00391-a027-48ec-97c1-e2eeaeae8327 req-db121ef2-7cd2-44e7-820a-19b676cafa7d service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a9c00391-a027-48ec-97c1-e2eeaeae8327 req-db121ef2-7cd2-44e7-820a-19b676cafa7d service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-a9c00391-a027-48ec-97c1-e2eeaeae8327 req-db121ef2-7cd2-44e7-820a-19b676cafa7d service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:27 user nova-compute[75071]: WARNING nova.compute.manager [req-a9c00391-a027-48ec-97c1-e2eeaeae8327 req-db121ef2-7cd2-44e7-820a-19b676cafa7d service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received unexpected event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with vm_state resized and task_state resize_reverting.
Dec 05 12:28:27 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:28:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:28:27 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Instance running successfully.
Dec 05 12:28:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] finish_revert_migration finished successfully. {{(pid=75071) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11857}}
Dec 05 12:28:27 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:28:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.617s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:28:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:28:27 user nova-compute[75071]: DEBUG nova.network.neutron [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:28:27 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:28:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:28:27 user nova-compute[75071]: INFO nova.compute.manager [None req-14ad500c-6597-4208-a1c6-a45ac4f192ad tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Updating instance to original state: 'active'
Dec 05 12:28:27 user nova-compute[75071]: DEBUG nova.policy [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '809ec3faecd845e0ada2fc55ee6a8f39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b30662558d734f36ac8edbe9532d0d8a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:28:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:28:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:28:27 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Creating image(s)
Dec 05 12:28:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "/opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "/opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "/opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "1f66afeb7b71615884afd49cbe357a9bfe26f12c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "1f66afeb7b71615884afd49cbe357a9bfe26f12c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f66afeb7b71615884afd49cbe357a9bfe26f12c.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:28 user nova-compute[75071]: DEBUG nova.network.neutron [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Successfully created port: c5c11572-db63-48c5-9899-b3fd621d1819 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:28:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:28:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f66afeb7b71615884afd49cbe357a9bfe26f12c.part --force-share --output=json" returned: 0 in 0.213s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:28 user nova-compute[75071]: DEBUG nova.virt.images [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] 941fa97d-2297-4ef3-94fe-15656d9f346c was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 12:28:28 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 12:28:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1f66afeb7b71615884afd49cbe357a9bfe26f12c.part /opt/stack/data/nova/instances/_base/1f66afeb7b71615884afd49cbe357a9bfe26f12c.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1f66afeb7b71615884afd49cbe357a9bfe26f12c.part /opt/stack/data/nova/instances/_base/1f66afeb7b71615884afd49cbe357a9bfe26f12c.converted" returned: 0 in 0.640s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f66afeb7b71615884afd49cbe357a9bfe26f12c.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:29 user nova-compute[75071]: DEBUG nova.network.neutron [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Successfully updated port: c5c11572-db63-48c5-9899-b3fd621d1819 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:28:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-070f6cfc-4a70-410b-a460-83f7ff50e901 req-7206821b-2e0d-4b35-b8ae-d60dba67b0d1 service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Received event network-changed-c5c11572-db63-48c5-9899-b3fd621d1819 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-070f6cfc-4a70-410b-a460-83f7ff50e901 req-7206821b-2e0d-4b35-b8ae-d60dba67b0d1 service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Refreshing instance network info cache due to event network-changed-c5c11572-db63-48c5-9899-b3fd621d1819. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:28:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-070f6cfc-4a70-410b-a460-83f7ff50e901 req-7206821b-2e0d-4b35-b8ae-d60dba67b0d1 service nova] Acquiring lock "refresh_cache-20883e1b-4595-44c9-9855-3160fb16d148" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:28:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-070f6cfc-4a70-410b-a460-83f7ff50e901 req-7206821b-2e0d-4b35-b8ae-d60dba67b0d1 service nova] Acquired lock "refresh_cache-20883e1b-4595-44c9-9855-3160fb16d148" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:28:29 user nova-compute[75071]: DEBUG nova.network.neutron [req-070f6cfc-4a70-410b-a460-83f7ff50e901 req-7206821b-2e0d-4b35-b8ae-d60dba67b0d1 service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Refreshing network info cache for port c5c11572-db63-48c5-9899-b3fd621d1819 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:28:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "refresh_cache-20883e1b-4595-44c9-9855-3160fb16d148" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:28:29 user nova-compute[75071]: DEBUG nova.network.neutron [req-070f6cfc-4a70-410b-a460-83f7ff50e901 req-7206821b-2e0d-4b35-b8ae-d60dba67b0d1 service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:28:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f66afeb7b71615884afd49cbe357a9bfe26f12c.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "1f66afeb7b71615884afd49cbe357a9bfe26f12c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.436s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f66afeb7b71615884afd49cbe357a9bfe26f12c --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:29 user nova-compute[75071]: DEBUG nova.network.neutron [req-070f6cfc-4a70-410b-a460-83f7ff50e901 req-7206821b-2e0d-4b35-b8ae-d60dba67b0d1 service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-070f6cfc-4a70-410b-a460-83f7ff50e901 req-7206821b-2e0d-4b35-b8ae-d60dba67b0d1 service nova] Releasing lock "refresh_cache-20883e1b-4595-44c9-9855-3160fb16d148" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquired lock "refresh_cache-20883e1b-4595-44c9-9855-3160fb16d148" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.network.neutron [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f66afeb7b71615884afd49cbe357a9bfe26f12c --force-share --output=json" returned: 0 in 0.208s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "1f66afeb7b71615884afd49cbe357a9bfe26f12c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "1f66afeb7b71615884afd49cbe357a9bfe26f12c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f66afeb7b71615884afd49cbe357a9bfe26f12c --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.network.neutron [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:28:30 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 386e93a2-2435-4d5f-bee2-fdb5f52fd476 is timed out.
Dec 05 12:28:30 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Successfully detached device vdb from instance 386e93a2-2435-4d5f-bee2-fdb5f52fd476 from the live domain config.
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XgSTEoiP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:28:30 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f66afeb7b71615884afd49cbe357a9bfe26f12c --force-share --output=json" returned: 0 in 0.213s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1f66afeb7b71615884afd49cbe357a9bfe26f12c,backing_fmt=raw /opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd735d5-020e-4401-a3f4-db5f959794c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:28:30 user nova-compute[75071]: No targets found.
Dec 05 12:28:30 user nova-compute[75071]: iSNS:
Dec 05 12:28:30 user nova-compute[75071]: No targets found.
Dec 05 12:28:30 user nova-compute[75071]: STATIC:
Dec 05 12:28:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98
Dec 05 12:28:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:28:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:28:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:28:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:28:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:28:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883
Dec 05 12:28:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:28:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:28:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0
Dec 05 12:28:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:28:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:28:30 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546
Dec 05 12:28:30 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:28:30 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:28:30 user nova-compute[75071]: FIRMWARE:
Dec 05 12:28:30 user nova-compute[75071]: No targets found.
Dec 05 12:28:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:28:30 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:28:30 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1f66afeb7b71615884afd49cbe357a9bfe26f12c,backing_fmt=raw /opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/disk 1073741824" returned: 0 in 0.056s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "1f66afeb7b71615884afd49cbe357a9bfe26f12c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f66afeb7b71615884afd49cbe357a9bfe26f12c --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4927034-4f72-4a99-be70-eccd34d9e8d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b009b91-0fed-46a7-a386-ce31b0d02efe]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:28:30 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:28:30 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)
Dec 05 12:28:30 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:28:30 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:28:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:28:30 user nova-compute[75071]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 (non-flash)
Dec 05 12:28:30 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)
Dec 05 12:28:30 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:28:30 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:28:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f827c1df640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af47209-c825-490e-ab06-85d747017561]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0160ae73-c96a-43b5-b085-2936327667ca]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[befe7a54-51d0-45bd-8310-2737887b8eff]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.network.neutron [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Updating instance_info_cache with network_info: [{"id": "c5c11572-db63-48c5-9899-b3fd621d1819", "address": "fa:16:3e:18:69:a2", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c11572-db", "ovs_interfaceid": "c5c11572-db63-48c5-9899-b3fd621d1819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Releasing lock "refresh_cache-20883e1b-4595-44c9-9855-3160fb16d148" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Instance network_info: |[{"id": "c5c11572-db63-48c5-9899-b3fd621d1819", "address": "fa:16:3e:18:69:a2", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c11572-db", "ovs_interfaceid": "c5c11572-db63-48c5-9899-b3fd621d1819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7948a89-f5ba-450a-ae7a-09a5da10ddf3]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1f66afeb7b71615884afd49cbe357a9bfe26f12c --force-share --output=json" returned: 0 in 0.206s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Ensure instance console log exists: /opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Start _get_guest_xml network_info=[{"id": "c5c11572-db63-48c5-9899-b3fd621d1819", "address": "fa:16:3e:18:69:a2", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c11572-db", "ovs_interfaceid": "c5c11572-db63-48c5-9899-b3fd621d1819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ba92f96a2025f74d095d5386368ffbb3',container_format='bare',created_at=2023-12-05T12:28:18Z,direct_url=<?>,disk_format='qcow2',id=941fa97d-2297-4ef3-94fe-15656d9f346c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1481775485',owner='b30662558d734f36ac8edbe9532d0d8a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-05T12:28:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': '941fa97d-2297-4ef3-94fe-15656d9f346c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42f0193-a93b-441f-9368-8a7d096a77e8]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:30 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:28:30 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ba92f96a2025f74d095d5386368ffbb3',container_format='bare',created_at=2023-12-05T12:28:18Z,direct_url=<?>,disk_format='qcow2',id=941fa97d-2297-4ef3-94fe-15656d9f346c,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1481775485',owner='b30662558d734f36ac8edbe9532d0d8a',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-05T12:28:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:28:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-934876001',display_name='tempest-TestStampPattern-server-934876001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-934876001',id=30,image_ref='941fa97d-2297-4ef3-94fe-15656d9f346c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5oir8WHtqBRqryIYkB3I8UlaFk+dqU7IU6/ODmrxiWXhJiAujDIqqNL9Se9MN5Cfk4XMMDLRzpXzZGmiliVEnSL3Carc5WXCaALVz8WrwdnaIjjhGdD2iq63mJ07QOLA==',key_name='tempest-TestStampPattern-141813427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b30662558d734f36ac8edbe9532d0d8a',ramdisk_id='',reservation_id='r-eimlbog8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a99a0331-1d77-4b71-9ef7-0794778b3ef1',image_min_disk='1',image_min_ram='0',image_owner_id='b30662558d734f36ac8edbe9532d0d8a',image_owner_project_name='tempest-TestStampPattern-979532490',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-979532490-project-member',image_user_id='809ec3faecd845e0ada2fc55ee6a8f39',network_allocated='True',owner_project_name='tempest-TestStampPattern-979532490',owner_user_name='tempest-TestStampPattern-979532490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:28:27Z,user_data=None,user_id='809ec3faecd845e0ada2fc55ee6a8f39',uuid=20883e1b-4595-44c9-9855-3160fb16d148,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5c11572-db63-48c5-9899-b3fd621d1819", "address": "fa:16:3e:18:69:a2", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c11572-db", "ovs_interfaceid": "c5c11572-db63-48c5-9899-b3fd621d1819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Converting VIF {"id": "c5c11572-db63-48c5-9899-b3fd621d1819", "address": "fa:16:3e:18:69:a2", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c11572-db", "ovs_interfaceid": "c5c11572-db63-48c5-9899-b3fd621d1819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:a2,bridge_name='br-int',has_traffic_filtering=True,id=c5c11572-db63-48c5-9899-b3fd621d1819,network=Network(cbf3c2f9-f756-4283-b6d9-236fb2d2faed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c11572-db') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.objects.instance [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lazy-loading 'pci_devices' on Instance uuid 20883e1b-4595-44c9-9855-3160fb16d148 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[304788bd-b655-434b-9626-9af9abe3cd76]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98, portal: 172.16.0.220,3260]
Dec 05 12:28:30 user nova-compute[75071]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98, portal: 172.16.0.220,3260] successful.
Dec 05 12:28:30 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:28:30 user nova-compute[75071]:   <uuid>20883e1b-4595-44c9-9855-3160fb16d148</uuid>
Dec 05 12:28:30 user nova-compute[75071]:   <name>instance-0000001e</name>
Dec 05 12:28:30 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:28:30 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:28:30 user nova-compute[75071]:   <metadata>
Dec 05 12:28:30 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:28:30 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:28:30 user nova-compute[75071]:       <nova:name>tempest-TestStampPattern-server-934876001</nova:name>
Dec 05 12:28:30 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:28:30</nova:creationTime>
Dec 05 12:28:30 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:28:30 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:28:30 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:28:30 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:28:30 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:28:30 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:28:30 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:28:30 user nova-compute[75071]:       <nova:owner>
Dec 05 12:28:30 user nova-compute[75071]:         <nova:user uuid="809ec3faecd845e0ada2fc55ee6a8f39">tempest-TestStampPattern-979532490-project-member</nova:user>
Dec 05 12:28:30 user nova-compute[75071]:         <nova:project uuid="b30662558d734f36ac8edbe9532d0d8a">tempest-TestStampPattern-979532490</nova:project>
Dec 05 12:28:30 user nova-compute[75071]:       </nova:owner>
Dec 05 12:28:30 user nova-compute[75071]:       <nova:root type="image" uuid="941fa97d-2297-4ef3-94fe-15656d9f346c"/>
Dec 05 12:28:30 user nova-compute[75071]:       <nova:ports>
Dec 05 12:28:30 user nova-compute[75071]:         <nova:port uuid="c5c11572-db63-48c5-9899-b3fd621d1819">
Dec 05 12:28:30 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 05 12:28:30 user nova-compute[75071]:         </nova:port>
Dec 05 12:28:30 user nova-compute[75071]:       </nova:ports>
Dec 05 12:28:30 user nova-compute[75071]:     </nova:instance>
Dec 05 12:28:30 user nova-compute[75071]:   </metadata>
Dec 05 12:28:30 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:28:30 user nova-compute[75071]:     <system>
Dec 05 12:28:30 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:28:30 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:28:30 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:28:30 user nova-compute[75071]:       <entry name="serial">20883e1b-4595-44c9-9855-3160fb16d148</entry>
Dec 05 12:28:30 user nova-compute[75071]:       <entry name="uuid">20883e1b-4595-44c9-9855-3160fb16d148</entry>
Dec 05 12:28:30 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:28:30 user nova-compute[75071]:     </system>
Dec 05 12:28:30 user nova-compute[75071]:   </sysinfo>
Dec 05 12:28:30 user nova-compute[75071]:   <os>
Dec 05 12:28:30 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:28:30 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:28:30 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:28:30 user nova-compute[75071]:   </os>
Dec 05 12:28:30 user nova-compute[75071]:   <features>
Dec 05 12:28:30 user nova-compute[75071]:     <acpi/>
Dec 05 12:28:30 user nova-compute[75071]:     <apic/>
Dec 05 12:28:30 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:28:30 user nova-compute[75071]:   </features>
Dec 05 12:28:30 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:28:30 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:28:30 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:28:30 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:28:30 user nova-compute[75071]:   </clock>
Dec 05 12:28:30 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:28:30 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:28:30 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:28:30 user nova-compute[75071]:   </cpu>
Dec 05 12:28:30 user nova-compute[75071]:   <devices>
Dec 05 12:28:30 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:28:30 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:28:30 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/disk"/>
Dec 05 12:28:30 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:28:30 user nova-compute[75071]:     </disk>
Dec 05 12:28:30 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:28:30 user nova-compute[75071]:       <mac address="fa:16:3e:18:69:a2"/>
Dec 05 12:28:30 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:28:30 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:28:30 user nova-compute[75071]:       <target dev="tapc5c11572-db"/>
Dec 05 12:28:30 user nova-compute[75071]:     </interface>
Dec 05 12:28:30 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:28:30 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/console.log" append="off"/>
Dec 05 12:28:30 user nova-compute[75071]:     </serial>
Dec 05 12:28:30 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:28:30 user nova-compute[75071]:     <video>
Dec 05 12:28:30 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:28:30 user nova-compute[75071]:     </video>
Dec 05 12:28:30 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:28:30 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:28:30 user nova-compute[75071]:     </rng>
Dec 05 12:28:30 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:28:30 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:28:30 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:28:30 user nova-compute[75071]:     </memballoon>
Dec 05 12:28:30 user nova-compute[75071]:   </devices>
Dec 05 12:28:30 user nova-compute[75071]: </domain>
Dec 05 12:28:30 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:28:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-934876001',display_name='tempest-TestStampPattern-server-934876001',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-934876001',id=30,image_ref='941fa97d-2297-4ef3-94fe-15656d9f346c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5oir8WHtqBRqryIYkB3I8UlaFk+dqU7IU6/ODmrxiWXhJiAujDIqqNL9Se9MN5Cfk4XMMDLRzpXzZGmiliVEnSL3Carc5WXCaALVz8WrwdnaIjjhGdD2iq63mJ07QOLA==',key_name='tempest-TestStampPattern-141813427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b30662558d734f36ac8edbe9532d0d8a',ramdisk_id='',reservation_id='r-eimlbog8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a99a0331-1d77-4b71-9ef7-0794778b3ef1',image_min_disk='1',image_min_ram='0',image_owner_id='b30662558d734f36ac8edbe9532d0d8a',image_owner_project_name='tempest-TestStampPattern-979532490',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-979532490-project-member',image_user_id='809ec3faecd845e0ada2fc55ee6a8f39',network_allocated='True',owner_project_name='tempest-TestStampPattern-979532490',owner_user_name='tempest-TestStampPattern-979532490-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:28:27Z,user_data=None,user_id='809ec3faecd845e0ada2fc55ee6a8f39',uuid=20883e1b-4595-44c9-9855-3160fb16d148,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5c11572-db63-48c5-9899-b3fd621d1819", "address": "fa:16:3e:18:69:a2", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c11572-db", "ovs_interfaceid": "c5c11572-db63-48c5-9899-b3fd621d1819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Converting VIF {"id": "c5c11572-db63-48c5-9899-b3fd621d1819", "address": "fa:16:3e:18:69:a2", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c11572-db", "ovs_interfaceid": "c5c11572-db63-48c5-9899-b3fd621d1819", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:a2,bridge_name='br-int',has_traffic_filtering=True,id=c5c11572-db63-48c5-9899-b3fd621d1819,network=Network(cbf3c2f9-f756-4283-b6d9-236fb2d2faed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c11572-db') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_vif [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:a2,bridge_name='br-int',has_traffic_filtering=True,id=c5c11572-db63-48c5-9899-b3fd621d1819,network=Network(cbf3c2f9-f756-4283-b6d9-236fb2d2faed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c11572-db') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '816559c7-31de-5ee4-afb6-3f376f988708', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5c11572-db, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5c11572-db, col_values=(('qos', UUID('8ae96426-75d3-43a1-aaed-7a6924c187b6')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5c11572-db, col_values=(('external_ids', {'iface-id': 'c5c11572-db63-48c5-9899-b3fd621d1819', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:69:a2', 'vm-uuid': '20883e1b-4595-44c9-9855-3160fb16d148'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:17e7e797-0041-4e40-93bc-c90c42e45a98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d098e5-9456-40f7-aec3-72dfb871a32f]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] <== disconnect_volume: return (390ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:30 user nova-compute[75071]: INFO os_vif [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:a2,bridge_name='br-int',has_traffic_filtering=True,id=c5c11572-db63-48c5-9899-b3fd621d1819,network=Network(cbf3c2f9-f756-4283-b6d9-236fb2d2faed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c11572-db')
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:28:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] No VIF found with MAC fa:16:3e:18:69:a2, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:28:31 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lazy-loading 'flavor' on Instance uuid 386e93a2-2435-4d5f-bee2-fdb5f52fd476 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:28:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b3963f68-7320-4392-9d3b-b9da404ecad2 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.944s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-7114de1b-ae56-4cd6-a237-78b96481dd94 req-71494c68-ecb6-483c-9b87-96274c77b913 service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Received event network-vif-plugged-c5c11572-db63-48c5-9899-b3fd621d1819 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7114de1b-ae56-4cd6-a237-78b96481dd94 req-71494c68-ecb6-483c-9b87-96274c77b913 service nova] Acquiring lock "20883e1b-4595-44c9-9855-3160fb16d148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7114de1b-ae56-4cd6-a237-78b96481dd94 req-71494c68-ecb6-483c-9b87-96274c77b913 service nova] Lock "20883e1b-4595-44c9-9855-3160fb16d148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7114de1b-ae56-4cd6-a237-78b96481dd94 req-71494c68-ecb6-483c-9b87-96274c77b913 service nova] Lock "20883e1b-4595-44c9-9855-3160fb16d148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-7114de1b-ae56-4cd6-a237-78b96481dd94 req-71494c68-ecb6-483c-9b87-96274c77b913 service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] No waiting events found dispatching network-vif-plugged-c5c11572-db63-48c5-9899-b3fd621d1819 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:32 user nova-compute[75071]: WARNING nova.compute.manager [req-7114de1b-ae56-4cd6-a237-78b96481dd94 req-71494c68-ecb6-483c-9b87-96274c77b913 service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Received unexpected event network-vif-plugged-c5c11572-db63-48c5-9899-b3fd621d1819 for instance with vm_state building and task_state spawning.
Dec 05 12:28:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:28:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:28:34 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Instance spawned successfully.
Dec 05 12:28:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:28:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:28:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:28:34 user nova-compute[75071]: INFO nova.compute.manager [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Took 7.42 seconds to spawn the instance on the hypervisor.
Dec 05 12:28:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:28:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-7b33f3d1-669b-44ec-bcd6-d2b9ce763128 req-1e010d91-ca72-4b9b-a916-88fcd0abb2d3 service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Received event network-vif-plugged-c5c11572-db63-48c5-9899-b3fd621d1819 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7b33f3d1-669b-44ec-bcd6-d2b9ce763128 req-1e010d91-ca72-4b9b-a916-88fcd0abb2d3 service nova] Acquiring lock "20883e1b-4595-44c9-9855-3160fb16d148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7b33f3d1-669b-44ec-bcd6-d2b9ce763128 req-1e010d91-ca72-4b9b-a916-88fcd0abb2d3 service nova] Lock "20883e1b-4595-44c9-9855-3160fb16d148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7b33f3d1-669b-44ec-bcd6-d2b9ce763128 req-1e010d91-ca72-4b9b-a916-88fcd0abb2d3 service nova] Lock "20883e1b-4595-44c9-9855-3160fb16d148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-7b33f3d1-669b-44ec-bcd6-d2b9ce763128 req-1e010d91-ca72-4b9b-a916-88fcd0abb2d3 service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] No waiting events found dispatching network-vif-plugged-c5c11572-db63-48c5-9899-b3fd621d1819 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:34 user nova-compute[75071]: WARNING nova.compute.manager [req-7b33f3d1-669b-44ec-bcd6-d2b9ce763128 req-1e010d91-ca72-4b9b-a916-88fcd0abb2d3 service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Received unexpected event network-vif-plugged-c5c11572-db63-48c5-9899-b3fd621d1819 for instance with vm_state building and task_state spawning.
Dec 05 12:28:34 user nova-compute[75071]: INFO nova.compute.manager [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Took 8.43 seconds to build instance.
Dec 05 12:28:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-90c32582-f375-4fd3-b4ee-15ecd1718f46 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "20883e1b-4595-44c9-9855-3160fb16d148" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.565s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:28:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:28:45 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:28:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:28:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:28:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:49 user nova-compute[75071]: INFO nova.compute.manager [None req-ff9b4d97-30c5-41db-8ef4-e22b7d2ac56b tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Unrescuing
Dec 05 12:28:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ff9b4d97-30c5-41db-8ef4-e22b7d2ac56b tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:28:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ff9b4d97-30c5-41db-8ef4-e22b7d2ac56b tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquired lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:28:49 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ff9b4d97-30c5-41db-8ef4-e22b7d2ac56b tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:28:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ff9b4d97-30c5-41db-8ef4-e22b7d2ac56b tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Updating instance_info_cache with network_info: [{"id": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "address": "fa:16:3e:53:ed:01", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd15e936-54", "ovs_interfaceid": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ff9b4d97-30c5-41db-8ef4-e22b7d2ac56b tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Releasing lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG nova.objects.instance [None req-ff9b4d97-30c5-41db-8ef4-e22b7d2ac56b tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'flavor' on Instance uuid 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-0092c974-351b-41c8-a75c-6ef5e5025ad9 req-d8b1d5f6-a2ad-4609-aeb2-c32b77eb4be9 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received event network-vif-unplugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0092c974-351b-41c8-a75c-6ef5e5025ad9 req-d8b1d5f6-a2ad-4609-aeb2-c32b77eb4be9 service nova] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0092c974-351b-41c8-a75c-6ef5e5025ad9 req-d8b1d5f6-a2ad-4609-aeb2-c32b77eb4be9 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0092c974-351b-41c8-a75c-6ef5e5025ad9 req-d8b1d5f6-a2ad-4609-aeb2-c32b77eb4be9 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-0092c974-351b-41c8-a75c-6ef5e5025ad9 req-d8b1d5f6-a2ad-4609-aeb2-c32b77eb4be9 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] No waiting events found dispatching network-vif-unplugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:50 user nova-compute[75071]: WARNING nova.compute.manager [req-0092c974-351b-41c8-a75c-6ef5e5025ad9 req-d8b1d5f6-a2ad-4609-aeb2-c32b77eb4be9 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received unexpected event network-vif-unplugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:28:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:51 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Instance destroyed successfully.
Dec 05 12:28:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:28:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:28:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:28:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:28:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ff9b4d97-30c5-41db-8ef4-e22b7d2ac56b tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] No waiting events found dispatching network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:55 user nova-compute[75071]: WARNING nova.compute.manager [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received unexpected event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] No waiting events found dispatching network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:55 user nova-compute[75071]: WARNING nova.compute.manager [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received unexpected event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] No waiting events found dispatching network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:55 user nova-compute[75071]: WARNING nova.compute.manager [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received unexpected event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received event network-vif-unplugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] No waiting events found dispatching network-vif-unplugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:55 user nova-compute[75071]: WARNING nova.compute.manager [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received unexpected event network-vif-unplugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] No waiting events found dispatching network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:55 user nova-compute[75071]: WARNING nova.compute.manager [req-f528e362-ba96-4724-8dc8-daeded1b4682 req-7c8b69da-5439-425c-9372-149c6092e684 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received unexpected event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-76c60799-bba7-44a6-a140-f4eb7dfed08f req-47855ed3-cebc-4a1b-944e-4d26676a217d service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-76c60799-bba7-44a6-a140-f4eb7dfed08f req-47855ed3-cebc-4a1b-944e-4d26676a217d service nova] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-76c60799-bba7-44a6-a140-f4eb7dfed08f req-47855ed3-cebc-4a1b-944e-4d26676a217d service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-76c60799-bba7-44a6-a140-f4eb7dfed08f req-47855ed3-cebc-4a1b-944e-4d26676a217d service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-76c60799-bba7-44a6-a140-f4eb7dfed08f req-47855ed3-cebc-4a1b-944e-4d26676a217d service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] No waiting events found dispatching network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:55 user nova-compute[75071]: WARNING nova.compute.manager [req-76c60799-bba7-44a6-a140-f4eb7dfed08f req-47855ed3-cebc-4a1b-944e-4d26676a217d service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received unexpected event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-76c60799-bba7-44a6-a140-f4eb7dfed08f req-47855ed3-cebc-4a1b-944e-4d26676a217d service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-76c60799-bba7-44a6-a140-f4eb7dfed08f req-47855ed3-cebc-4a1b-944e-4d26676a217d service nova] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-76c60799-bba7-44a6-a140-f4eb7dfed08f req-47855ed3-cebc-4a1b-944e-4d26676a217d service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-76c60799-bba7-44a6-a140-f4eb7dfed08f req-47855ed3-cebc-4a1b-944e-4d26676a217d service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-76c60799-bba7-44a6-a140-f4eb7dfed08f req-47855ed3-cebc-4a1b-944e-4d26676a217d service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] No waiting events found dispatching network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:28:55 user nova-compute[75071]: WARNING nova.compute.manager [req-76c60799-bba7-44a6-a140-f4eb7dfed08f req-47855ed3-cebc-4a1b-944e-4d26676a217d service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received unexpected event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:28:55 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:28:55 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=7263MB free_disk=24.879722595214844GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e08be776-0fa9-4871-86eb-2093530c00f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 386e93a2-2435-4d5f-bee2-fdb5f52fd476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance a99a0331-1d77-4b71-9ef7-0794778b3ef1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance cad9a071-e232-4629-a3cc-9cb9d3fe9333 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 2704ba7b-5e66-4348-a0fb-181465476095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c2b46f1c-dce6-4436-8e1e-062ffda80732 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 20883e1b-4595-44c9-9855-3160fb16d148 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:28:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:28:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:28:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:28:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 12:28:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:28:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:28:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:28:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:28:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:28:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:28:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:28:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:28:59 user nova-compute[75071]: INFO nova.compute.manager [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Detaching volume e27c2098-3dd5-4d73-8694-8698769ed883
Dec 05 12:28:59 user nova-compute[75071]: INFO nova.virt.block_device [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Attempting to driver detach volume e27c2098-3dd5-4d73-8694-8698769ed883 from mountpoint /dev/vdc
Dec 05 12:28:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Attempting to detach device vdc from instance cad9a071-e232-4629-a3cc-9cb9d3fe9333 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:28:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:28:59 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:28:59 user nova-compute[75071]:   <source dev="/dev/sdf"/>
Dec 05 12:28:59 user nova-compute[75071]:   <target dev="vdc" bus="virtio"/>
Dec 05 12:28:59 user nova-compute[75071]:   <serial>e27c2098-3dd5-4d73-8694-8698769ed883</serial>
Dec 05 12:28:59 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 12:28:59 user nova-compute[75071]: </disk>
Dec 05 12:28:59 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:28:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Successfully detached device vdc from instance cad9a071-e232-4629-a3cc-9cb9d3fe9333 from the persistent domain config.
Dec 05 12:28:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance cad9a071-e232-4629-a3cc-9cb9d3fe9333 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:28:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:28:59 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:28:59 user nova-compute[75071]:   <source dev="/dev/sdf"/>
Dec 05 12:28:59 user nova-compute[75071]:   <target dev="vdc" bus="virtio"/>
Dec 05 12:28:59 user nova-compute[75071]:   <serial>e27c2098-3dd5-4d73-8694-8698769ed883</serial>
Dec 05 12:28:59 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 12:28:59 user nova-compute[75071]: </disk>
Dec 05 12:28:59 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:29:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance cad9a071-e232-4629-a3cc-9cb9d3fe9333 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:29:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:04 user nova-compute[75071]: INFO nova.compute.manager [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Terminating instance
Dec 05 12:29:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:29:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-81413a12-b414-432d-b087-2927f1316dee req-1e9bc0d9-8609-4a4c-a526-9ae16721c258 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received event network-vif-unplugged-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:29:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-81413a12-b414-432d-b087-2927f1316dee req-1e9bc0d9-8609-4a4c-a526-9ae16721c258 service nova] Acquiring lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-81413a12-b414-432d-b087-2927f1316dee req-1e9bc0d9-8609-4a4c-a526-9ae16721c258 service nova] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-81413a12-b414-432d-b087-2927f1316dee req-1e9bc0d9-8609-4a4c-a526-9ae16721c258 service nova] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-81413a12-b414-432d-b087-2927f1316dee req-1e9bc0d9-8609-4a4c-a526-9ae16721c258 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] No waiting events found dispatching network-vif-unplugged-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:29:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-81413a12-b414-432d-b087-2927f1316dee req-1e9bc0d9-8609-4a4c-a526-9ae16721c258 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received event network-vif-unplugged-580a2511-2f94-4e37-af8e-3a3b72654b35 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:29:05 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Instance destroyed successfully.
Dec 05 12:29:05 user nova-compute[75071]: DEBUG nova.objects.instance [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lazy-loading 'resources' on Instance uuid 386e93a2-2435-4d5f-bee2-fdb5f52fd476 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:29:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:23:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1840068028',display_name='tempest-TestMinimumBasicScenario-server-1840068028',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1840068028',id=23,image_ref='dadec85f-a232-41ae-a859-c4f45f17f685',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgYMh9m/slisf+9eEjgMwJqp26BZoxHiS18Q50W2wVpua8bBzoOPb8JZBddNfzVLxaFl9d7uvsRsNK9UBDNxU25Bg3r71t7m+QxWjc+CF2KmO3pHsDIjEe7HS4xaBQ2gQ==',key_name='tempest-TestMinimumBasicScenario-459970224',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:24:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b9ac01e22eb428885981285a18f34fc',ramdisk_id='',reservation_id='r-oa91ac1g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dadec85f-a232-41ae-a859-c4f45f17f685',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-901409176',owner_user_name='tempest-TestMinimumBasicScenario-901409176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:26:24Z,user_data=None,user_id='1feef67013ea4c4db4be3a352eeaec7f',uuid=386e93a2-2435-4d5f-bee2-fdb5f52fd476,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:29:05 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Converting VIF {"id": "580a2511-2f94-4e37-af8e-3a3b72654b35", "address": "fa:16:3e:c5:10:6a", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap580a2511-2f", "ovs_interfaceid": "580a2511-2f94-4e37-af8e-3a3b72654b35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:29:05 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=580a2511-2f94-4e37-af8e-3a3b72654b35,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580a2511-2f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:29:05 user nova-compute[75071]: DEBUG os_vif [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=580a2511-2f94-4e37-af8e-3a3b72654b35,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580a2511-2f') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:29:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap580a2511-2f, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:29:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:29:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7490352-86d4-4794-96b7-e072d2b63de7) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:29:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:05 user nova-compute[75071]: INFO os_vif [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:10:6a,bridge_name='br-int',has_traffic_filtering=True,id=580a2511-2f94-4e37-af8e-3a3b72654b35,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap580a2511-2f')
Dec 05 12:29:05 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Deleting instance files /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476_del
Dec 05 12:29:05 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Deletion of /opt/stack/data/nova/instances/386e93a2-2435-4d5f-bee2-fdb5f52fd476_del complete
Dec 05 12:29:05 user nova-compute[75071]: INFO nova.compute.manager [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 05 12:29:05 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:29:05 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:29:05 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:29:06 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:29:06 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Took 0.91 seconds to deallocate network for instance.
Dec 05 12:29:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-87b50453-5286-4b8b-9454-c4c6cf899a4a req-b824e335-77e1-466d-b15f-5ef9bc99ea29 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received event network-vif-deleted-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:29:06 user nova-compute[75071]: INFO nova.compute.manager [req-87b50453-5286-4b8b-9454-c4c6cf899a4a req-b824e335-77e1-466d-b15f-5ef9bc99ea29 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Neutron deleted interface 580a2511-2f94-4e37-af8e-3a3b72654b35; detaching it from the instance and deleting it from the info cache
Dec 05 12:29:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-87b50453-5286-4b8b-9454-c4c6cf899a4a req-b824e335-77e1-466d-b15f-5ef9bc99ea29 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:29:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-87b50453-5286-4b8b-9454-c4c6cf899a4a req-b824e335-77e1-466d-b15f-5ef9bc99ea29 service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Detach interface failed, port_id=580a2511-2f94-4e37-af8e-3a3b72654b35, reason: Instance 386e93a2-2435-4d5f-bee2-fdb5f52fd476 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:29:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:06 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:29:06 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:29:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:06 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Deleted allocations for instance 386e93a2-2435-4d5f-bee2-fdb5f52fd476
Dec 05 12:29:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-4fb3ef18-1371-4d55-8460-965a00cec3ae req-390f5037-889b-4336-91ad-3f3f702c4d3a service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received event network-vif-plugged-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:29:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4fb3ef18-1371-4d55-8460-965a00cec3ae req-390f5037-889b-4336-91ad-3f3f702c4d3a service nova] Acquiring lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4fb3ef18-1371-4d55-8460-965a00cec3ae req-390f5037-889b-4336-91ad-3f3f702c4d3a service nova] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4fb3ef18-1371-4d55-8460-965a00cec3ae req-390f5037-889b-4336-91ad-3f3f702c4d3a service nova] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-4fb3ef18-1371-4d55-8460-965a00cec3ae req-390f5037-889b-4336-91ad-3f3f702c4d3a service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] No waiting events found dispatching network-vif-plugged-580a2511-2f94-4e37-af8e-3a3b72654b35 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:29:07 user nova-compute[75071]: WARNING nova.compute.manager [req-4fb3ef18-1371-4d55-8460-965a00cec3ae req-390f5037-889b-4336-91ad-3f3f702c4d3a service nova] [instance: 386e93a2-2435-4d5f-bee2-fdb5f52fd476] Received unexpected event network-vif-plugged-580a2511-2f94-4e37-af8e-3a3b72654b35 for instance with vm_state deleted and task_state None.
Dec 05 12:29:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8489c3c3-2314-44b8-9e43-d89408cf0ae5 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "386e93a2-2435-4d5f-bee2-fdb5f52fd476" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.486s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:12 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:29:12 user nova-compute[75071]: INFO nova.compute.manager [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] instance snapshotting
Dec 05 12:29:12 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Beginning live snapshot process
Dec 05 12:29:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json -f qcow2 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json -f qcow2 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcladbber/2fc94d0017024eb5b2e370f21333fe55.delta 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpcladbber/2fc94d0017024eb5b2e370f21333fe55.delta 1073741824" returned: 0 in 0.052s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:13 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 05 12:29:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:29:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:29:14 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 05 12:29:14 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 12:29:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcladbber/2fc94d0017024eb5b2e370f21333fe55.delta /opt/stack/data/nova/instances/snapshots/tmpcladbber/2fc94d0017024eb5b2e370f21333fe55 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpcladbber/2fc94d0017024eb5b2e370f21333fe55.delta /opt/stack/data/nova/instances/snapshots/tmpcladbber/2fc94d0017024eb5b2e370f21333fe55" returned: 0 in 0.498s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:15 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Snapshot extracted, beginning image upload
Dec 05 12:29:17 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Snapshot image upload complete
Dec 05 12:29:17 user nova-compute[75071]: INFO nova.compute.manager [None req-1a21dcae-ca8b-4a6f-a779-afaf09c0eec8 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Took 5.34 seconds to snapshot the instance on the hypervisor.
Dec 05 12:29:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:20 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance cad9a071-e232-4629-a3cc-9cb9d3fe9333 is timed out.
Dec 05 12:29:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Successfully detached device vdc from instance cad9a071-e232-4629-a3cc-9cb9d3fe9333 from the live domain config.
Dec 05 12:29:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VENfGTmi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:29:20 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98e8f9b-9ed5-4ac2-9151-43862ac7ccbe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:29:20 user nova-compute[75071]: No targets found.
Dec 05 12:29:20 user nova-compute[75071]: iSNS:
Dec 05 12:29:20 user nova-compute[75071]: No targets found.
Dec 05 12:29:20 user nova-compute[75071]: STATIC:
Dec 05 12:29:20 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:29:20 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:29:20 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:29:20 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883
Dec 05 12:29:20 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:29:20 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:29:20 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0
Dec 05 12:29:20 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:29:20 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:29:20 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546
Dec 05 12:29:20 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:29:20 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:29:20 user nova-compute[75071]: FIRMWARE:
Dec 05 12:29:20 user nova-compute[75071]: No targets found.
Dec 05 12:29:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:29:20 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:29:20 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38a0a1c-c384-43aa-96e5-a86bd0ef7ffa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0672816-eafb-4f51-baef-36932cca584b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:29:20 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)
Dec 05 12:29:20 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:29:20 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:29:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:29:20 user nova-compute[75071]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 (non-flash)
Dec 05 12:29:20 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:29:20 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:29:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82407695a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883'): ({'sdf'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Removing single pathed devices sdf {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4905d6f-d1ba-47dc-8f86-d32f5b5d5b87]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba96d5ba-7e95-4566-ad41-fc0f94291a16]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Flushing IO for device /dev/sdf {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d99d24f-0fce-461d-a963-ddc8014f91bd]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[53789604-9178-40cf-b024-4751afdab401]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83a201b-29f6-4e2f-a420-6b3a95b9cfe8]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed512d1-2237-495f-b517-d96b86d249c0]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883, portal: 172.16.0.220,3260]
Dec 05 12:29:20 user nova-compute[75071]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883, portal: 172.16.0.220,3260] successful.
Dec 05 12:29:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e27c2098-3dd5-4d73-8694-8698769ed883 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[23886a76-4216-4a68-ae66-7748717aeb3c]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] <== disconnect_volume: return (335ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:29:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:29:21 user nova-compute[75071]: DEBUG nova.objects.instance [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'flavor' on Instance uuid cad9a071-e232-4629-a3cc-9cb9d3fe9333 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:29:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ad26da91-4f26-4b5b-b88c-50107323e6ae tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.708s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-206e56f1-2dfa-4d95-aa60-b562440b767b req-12d6b6eb-85a5-4cdb-bdd5-adc5948cfaaf service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Received event network-changed-084a2a59-92f8-433d-be29-18eb5444cf18 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:29:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-206e56f1-2dfa-4d95-aa60-b562440b767b req-12d6b6eb-85a5-4cdb-bdd5-adc5948cfaaf service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Refreshing instance network info cache due to event network-changed-084a2a59-92f8-433d-be29-18eb5444cf18. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-206e56f1-2dfa-4d95-aa60-b562440b767b req-12d6b6eb-85a5-4cdb-bdd5-adc5948cfaaf service nova] Acquiring lock "refresh_cache-2704ba7b-5e66-4348-a0fb-181465476095" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:29:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-206e56f1-2dfa-4d95-aa60-b562440b767b req-12d6b6eb-85a5-4cdb-bdd5-adc5948cfaaf service nova] Acquired lock "refresh_cache-2704ba7b-5e66-4348-a0fb-181465476095" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:29:27 user nova-compute[75071]: DEBUG nova.network.neutron [req-206e56f1-2dfa-4d95-aa60-b562440b767b req-12d6b6eb-85a5-4cdb-bdd5-adc5948cfaaf service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Refreshing network info cache for port 084a2a59-92f8-433d-be29-18eb5444cf18 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:29:28 user nova-compute[75071]: DEBUG nova.network.neutron [req-206e56f1-2dfa-4d95-aa60-b562440b767b req-12d6b6eb-85a5-4cdb-bdd5-adc5948cfaaf service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Updated VIF entry in instance network info cache for port 084a2a59-92f8-433d-be29-18eb5444cf18. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:29:28 user nova-compute[75071]: DEBUG nova.network.neutron [req-206e56f1-2dfa-4d95-aa60-b562440b767b req-12d6b6eb-85a5-4cdb-bdd5-adc5948cfaaf service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Updating instance_info_cache with network_info: [{"id": "084a2a59-92f8-433d-be29-18eb5444cf18", "address": "fa:16:3e:54:c7:a3", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a2a59-92", "ovs_interfaceid": "084a2a59-92f8-433d-be29-18eb5444cf18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:29:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-206e56f1-2dfa-4d95-aa60-b562440b767b req-12d6b6eb-85a5-4cdb-bdd5-adc5948cfaaf service nova] Releasing lock "refresh_cache-2704ba7b-5e66-4348-a0fb-181465476095" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:29:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "2704ba7b-5e66-4348-a0fb-181465476095" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "2704ba7b-5e66-4348-a0fb-181465476095" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG nova.objects.instance [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lazy-loading 'flavor' on Instance uuid 2704ba7b-5e66-4348-a0fb-181465476095 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "2704ba7b-5e66-4348-a0fb-181465476095" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "2704ba7b-5e66-4348-a0fb-181465476095" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "2704ba7b-5e66-4348-a0fb-181465476095" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:30 user nova-compute[75071]: INFO nova.compute.manager [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Attaching volume 52141164-b40a-4222-bcb3-5889c02b4256 to /dev/vdb
Dec 05 12:29:30 user nova-compute[75071]: DEBUG os_brick.utils [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9c6a04-bda0-405f-a02f-d44f4006c674]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6b5808-313f-444d-a96a-7c4d2f00fc69]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[784fab27-027b-4854-b448-2d2df036c4c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e941c36-8966-4b05-8268-5208fcef4ae6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:29:30 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:29:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8a560f-9b5b-4526-8631-b93c3b9baab1]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG os_brick.utils [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:29:30 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Updating existing volume attachment record: a6b905af-0d9d-4c54-b9fb-4a2caca6b6e1 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:29:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-0960a0ac-a3db-4562-90b6-e5207d7d8014 req-acb874f5-6471-4ad4-9572-f523ea3cc11f service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Received event network-changed-8f59600f-fe54-49ac-b95c-fc44bad6b5d7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-0960a0ac-a3db-4562-90b6-e5207d7d8014 req-acb874f5-6471-4ad4-9572-f523ea3cc11f service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Refreshing instance network info cache due to event network-changed-8f59600f-fe54-49ac-b95c-fc44bad6b5d7. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0960a0ac-a3db-4562-90b6-e5207d7d8014 req-acb874f5-6471-4ad4-9572-f523ea3cc11f service nova] Acquiring lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0960a0ac-a3db-4562-90b6-e5207d7d8014 req-acb874f5-6471-4ad4-9572-f523ea3cc11f service nova] Acquired lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG nova.network.neutron [req-0960a0ac-a3db-4562-90b6-e5207d7d8014 req-acb874f5-6471-4ad4-9572-f523ea3cc11f service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Refreshing network info cache for port 8f59600f-fe54-49ac-b95c-fc44bad6b5d7 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG nova.network.neutron [req-0960a0ac-a3db-4562-90b6-e5207d7d8014 req-acb874f5-6471-4ad4-9572-f523ea3cc11f service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Updated VIF entry in instance network info cache for port 8f59600f-fe54-49ac-b95c-fc44bad6b5d7. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG nova.network.neutron [req-0960a0ac-a3db-4562-90b6-e5207d7d8014 req-acb874f5-6471-4ad4-9572-f523ea3cc11f service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Updating instance_info_cache with network_info: [{"id": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "address": "fa:16:3e:32:a2:62", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f59600f-fe", "ovs_interfaceid": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0960a0ac-a3db-4562-90b6-e5207d7d8014 req-acb874f5-6471-4ad4-9572-f523ea3cc11f service nova] Releasing lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tfUPcQvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:29:39 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:29:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:29:39 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:29:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:29:39 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef57a905-88ef-45cd-ac7e-c94849de189e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:29:39 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8791246-6e19-419f-83ff-9b884056651a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256] added
Dec 05 12:29:39 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd8f920-ff8e-41fb-ab9d-f541f1347bf4]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[389fb2da-37c4-4746-9abb-e6ad6145b64d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tfUPcQvN {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tfUPcQvN" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10e57c7-262c-4321-a181-ba66f02706d3]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tfUPcQvN'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acebac0-771d-49f7-988d-aace386d5ed7]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3710a0b3-e989-44f7-87d8-5deb3a12696f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:29:39 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:29:39 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:29:39 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:29:39 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:29:39 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:29:39 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:29:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda63e33-5df0-4ebb-982a-c24660cd8d18]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256, portal: 172.16.0.220,3260]
Dec 05 12:29:40 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256, portal: 172.16.0.220,3260] successful.
Dec 05 12:29:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0512d481-b0b3-4e42-a6bd-555d452c6fb0]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0984e147-7312-458c-9d8e-fad454011a97]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:29:40 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:29:40 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:29:40 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 (non-flash)
Dec 05 12:29:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:29:40 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:29:40 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:29:40 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 (non-flash)
Dec 05 12:29:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4d5bbe-2f6b-4067-85ed-000392967b51]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tfUPcQvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Stashing vm_state: active {{(pid=75071) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:40 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:29:40 user nova-compute[75071]: INFO nova.compute.claims [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Claim successful on node user
Dec 05 12:29:40 user nova-compute[75071]: INFO nova.compute.resource_tracker [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Updating resource usage from migration 7fb04b32-6cdf-47c3-9e01-f299ef6c8815
Dec 05 12:29:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-0931cf88-6eb2-4e40-b71b-d8e9a42d1ec7 req-f8dbaf4c-9afc-48e3-9af6-4d90a1de542c service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Received event network-changed-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-0931cf88-6eb2-4e40-b71b-d8e9a42d1ec7 req-f8dbaf4c-9afc-48e3-9af6-4d90a1de542c service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Refreshing instance network info cache due to event network-changed-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0931cf88-6eb2-4e40-b71b-d8e9a42d1ec7 req-f8dbaf4c-9afc-48e3-9af6-4d90a1de542c service nova] Acquiring lock "refresh_cache-c2b46f1c-dce6-4436-8e1e-062ffda80732" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0931cf88-6eb2-4e40-b71b-d8e9a42d1ec7 req-f8dbaf4c-9afc-48e3-9af6-4d90a1de542c service nova] Acquired lock "refresh_cache-c2b46f1c-dce6-4436-8e1e-062ffda80732" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG nova.network.neutron [req-0931cf88-6eb2-4e40-b71b-d8e9a42d1ec7 req-f8dbaf4c-9afc-48e3-9af6-4d90a1de542c service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Refreshing network info cache for port 0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26235313462396163', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235313462396163', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG nova.objects.instance [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lazy-loading 'flavor' on Instance uuid 2704ba7b-5e66-4348-a0fb-181465476095 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:29:41 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:29:41 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:29:41 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:29:41 user nova-compute[75071]:   <serial>52141164-b40a-4222-bcb3-5889c02b4256</serial>
Dec 05 12:29:41 user nova-compute[75071]: </disk>
Dec 05 12:29:41 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.450s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:41 user nova-compute[75071]: INFO nova.compute.manager [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Migrating
Dec 05 12:29:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "refresh_cache-c2b46f1c-dce6-4436-8e1e-062ffda80732" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG nova.network.neutron [req-0931cf88-6eb2-4e40-b71b-d8e9a42d1ec7 req-f8dbaf4c-9afc-48e3-9af6-4d90a1de542c service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Updated VIF entry in instance network info cache for port 0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG nova.network.neutron [req-0931cf88-6eb2-4e40-b71b-d8e9a42d1ec7 req-f8dbaf4c-9afc-48e3-9af6-4d90a1de542c service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Updating instance_info_cache with network_info: [{"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0931cf88-6eb2-4e40-b71b-d8e9a42d1ec7 req-f8dbaf4c-9afc-48e3-9af6-4d90a1de542c service nova] Releasing lock "refresh_cache-c2b46f1c-dce6-4436-8e1e-062ffda80732" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquired lock "refresh_cache-c2b46f1c-dce6-4436-8e1e-062ffda80732" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] No VIF found with MAC fa:16:3e:54:c7:a3, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e969c0cc-4d3e-4f70-a503-76acd7889e07 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "2704ba7b-5e66-4348-a0fb-181465476095" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.225s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Updating instance_info_cache with network_info: [{"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Releasing lock "refresh_cache-c2b46f1c-dce6-4436-8e1e-062ffda80732" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:29:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Starting migrate_disk_and_power_off {{(pid=75071) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11481}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-13773d74-069b-4828-bbd6-7455a2cea461 req-577ce6bf-c0af-4142-ab71-79ea2309f906 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Received event network-vif-unplugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-13773d74-069b-4828-bbd6-7455a2cea461 req-577ce6bf-c0af-4142-ab71-79ea2309f906 service nova] Acquiring lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-13773d74-069b-4828-bbd6-7455a2cea461 req-577ce6bf-c0af-4142-ab71-79ea2309f906 service nova] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-13773d74-069b-4828-bbd6-7455a2cea461 req-577ce6bf-c0af-4142-ab71-79ea2309f906 service nova] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-13773d74-069b-4828-bbd6-7455a2cea461 req-577ce6bf-c0af-4142-ab71-79ea2309f906 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] No waiting events found dispatching network-vif-unplugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:29:42 user nova-compute[75071]: WARNING nova.compute.manager [req-13773d74-069b-4828-bbd6-7455a2cea461 req-577ce6bf-c0af-4142-ab71-79ea2309f906 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Received unexpected event network-vif-unplugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 for instance with vm_state active and task_state resize_migrating.
Dec 05 12:29:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "2704ba7b-5e66-4348-a0fb-181465476095" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "2704ba7b-5e66-4348-a0fb-181465476095" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:42 user nova-compute[75071]: INFO nova.compute.manager [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Detaching volume 52141164-b40a-4222-bcb3-5889c02b4256
Dec 05 12:29:42 user nova-compute[75071]: INFO nova.virt.block_device [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Attempting to driver detach volume 52141164-b40a-4222-bcb3-5889c02b4256 from mountpoint /dev/vdb
Dec 05 12:29:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Attempting to detach device vdb from instance 2704ba7b-5e66-4348-a0fb-181465476095 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:29:42 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:29:42 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:29:42 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:29:42 user nova-compute[75071]:   <serial>52141164-b40a-4222-bcb3-5889c02b4256</serial>
Dec 05 12:29:42 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:29:42 user nova-compute[75071]: </disk>
Dec 05 12:29:42 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:29:42 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Successfully detached device vdb from instance 2704ba7b-5e66-4348-a0fb-181465476095 from the persistent domain config.
Dec 05 12:29:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2704ba7b-5e66-4348-a0fb-181465476095 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:29:42 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:29:42 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:29:42 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:29:42 user nova-compute[75071]:   <serial>52141164-b40a-4222-bcb3-5889c02b4256</serial>
Dec 05 12:29:42 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:29:42 user nova-compute[75071]: </disk>
Dec 05 12:29:42 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:29:42 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Instance destroyed successfully.
Dec 05 12:29:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-838854064',display_name='tempest-ServerActionsTestOtherA-server-838854064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-838854064',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr4CxHIGILJKylwCAW1k5g9hHm3DpT3NJj15aFaT5zmT7LmQxPRChXNHnUJDBNGMOIF2KjOMuY9sG7Diwqrmevv8WAXt0F+z6Y+uzBIRaBoBEcSXjeLaXdD3Dv6NXOVGQ==',key_name='tempest-keypair-237629817',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:28:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='59b6bfae34944fcfbd49d2f18b232ec8',ramdisk_id='',reservation_id='r-34l73x5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1523780015',owner_user_name='tempest-ServerActionsTestOtherA-1523780015-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:29:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e73e24d5b1489c813f06690b12eef4',uuid=c2b46f1c-dce6-4436-8e1e-062ffda80732,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-447918098-network", "vif_mac": "fa:16:3e:39:95:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converting VIF {"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-447918098-network", "vif_mac": "fa:16:3e:39:95:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7fb9d1-89') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG os_vif [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7fb9d1-89') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a7fb9d1-89, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e47eea3e-59db-42ec-9cc7-1486ce6ed6cd) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:29:42 user nova-compute[75071]: INFO os_vif [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7fb9d1-89')
Dec 05 12:29:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMDuqjzy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:29:42 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:29:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[246e7095-2510-4a03-9897-6e0f68a2c643]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:29:42 user nova-compute[75071]: No targets found.
Dec 05 12:29:42 user nova-compute[75071]: iSNS:
Dec 05 12:29:42 user nova-compute[75071]: No targets found.
Dec 05 12:29:42 user nova-compute[75071]: STATIC:
Dec 05 12:29:42 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:29:42 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:29:42 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:29:42 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256
Dec 05 12:29:42 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:29:42 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:29:42 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0
Dec 05 12:29:42 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:29:42 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:29:42 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546
Dec 05 12:29:42 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:29:42 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:29:42 user nova-compute[75071]: FIRMWARE:
Dec 05 12:29:42 user nova-compute[75071]: No targets found.
Dec 05 12:29:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:29:42 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:29:42 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[791b7341-e077-4705-b022-20f7ac723d02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2539516b-75d1-4b0f-a336-9f2d4631cd16]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:29:42 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:29:42 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:29:42 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 (non-flash)
Dec 05 12:29:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:29:42 user nova-compute[75071]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:29:42 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:29:42 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 (non-flash)
Dec 05 12:29:42 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8274256b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0'): ({'sde'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Removing single pathed devices sde {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[33387726-ca0c-4582-99b8-67b735abdc6c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[36036d6f-d74c-4d2f-a402-f2a9ca94fdbf]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Flushing IO for device /dev/sde {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.036s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[591dce48-5d37-4bc3-99c7-05c8308624f5]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:29:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34b5658-d773-4238-8f2b-9b120b508ea4]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2a2f5e-4c57-4108-8599-c3a6646c8283]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[990b29a0-87fb-44ae-ab6e-f7696a7f3eb1]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0, portal: 172.16.0.220,3260]
Dec 05 12:29:43 user nova-compute[75071]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0, portal: 172.16.0.220,3260] successful.
Dec 05 12:29:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d3aea6-2b7c-4d38-b1f1-7cc09b334558]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] <== disconnect_volume: return (366ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2704ba7b-5e66-4348-a0fb-181465476095 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:29:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Port 0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 binding to destination host user is already ACTIVE {{(pid=75071) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-55048b7e-7c38-4336-9b59-9c3b8f9af93a req-42941f09-d3cd-4586-b553-91be02726e39 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Received event network-vif-plugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-55048b7e-7c38-4336-9b59-9c3b8f9af93a req-42941f09-d3cd-4586-b553-91be02726e39 service nova] Acquiring lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-55048b7e-7c38-4336-9b59-9c3b8f9af93a req-42941f09-d3cd-4586-b553-91be02726e39 service nova] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-55048b7e-7c38-4336-9b59-9c3b8f9af93a req-42941f09-d3cd-4586-b553-91be02726e39 service nova] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-55048b7e-7c38-4336-9b59-9c3b8f9af93a req-42941f09-d3cd-4586-b553-91be02726e39 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] No waiting events found dispatching network-vif-plugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:29:44 user nova-compute[75071]: WARNING nova.compute.manager [req-55048b7e-7c38-4336-9b59-9c3b8f9af93a req-42941f09-d3cd-4586-b553-91be02726e39 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Received unexpected event network-vif-plugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 for instance with vm_state active and task_state resize_migrated.
Dec 05 12:29:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "refresh_cache-c2b46f1c-dce6-4436-8e1e-062ffda80732" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquired lock "refresh_cache-c2b46f1c-dce6-4436-8e1e-062ffda80732" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Updating instance_info_cache with network_info: [{"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Releasing lock "refresh_cache-c2b46f1c-dce6-4436-8e1e-062ffda80732" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG os_brick.utils [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc30220e-100f-4605-8e92-8f8fa5a334ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87db79c-7542-4a5f-9a8a-fbf8a0415c10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3640cd39-cd3f-4063-babe-e77431343dfc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff28dc5-f3bc-4ae4-ae15-cd248b84d169]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:29:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:29:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:29:45 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:29:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4ccb24-3bdf-4183-9fed-dd1d5b00719f]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:29:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:29:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:29:45 user nova-compute[75071]: DEBUG os_brick.utils [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:29:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:29:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:29:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:29:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:29:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:29:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:29:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:50 user nova-compute[75071]: INFO nova.compute.manager [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Terminating instance
Dec 05 12:29:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-81967190-ebb7-46a3-943e-89639cf4c377 req-56b36af7-32a4-425c-a202-10e5db7efdec service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received event network-vif-unplugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-81967190-ebb7-46a3-943e-89639cf4c377 req-56b36af7-32a4-425c-a202-10e5db7efdec service nova] Acquiring lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-81967190-ebb7-46a3-943e-89639cf4c377 req-56b36af7-32a4-425c-a202-10e5db7efdec service nova] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-81967190-ebb7-46a3-943e-89639cf4c377 req-56b36af7-32a4-425c-a202-10e5db7efdec service nova] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-81967190-ebb7-46a3-943e-89639cf4c377 req-56b36af7-32a4-425c-a202-10e5db7efdec service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] No waiting events found dispatching network-vif-unplugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-81967190-ebb7-46a3-943e-89639cf4c377 req-56b36af7-32a4-425c-a202-10e5db7efdec service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received event network-vif-unplugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:50 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Instance destroyed successfully.
Dec 05 12:29:50 user nova-compute[75071]: DEBUG nova.objects.instance [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'resources' on Instance uuid cad9a071-e232-4629-a3cc-9cb9d3fe9333 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T12:23:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-6013421',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-6013421',id=21,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4ojfp9xi4tIHEe5RUJWGaicVoCqfOcH9OAOng/6HjRCsqOv8KiR+xZvXDUbR4ocmbrJ48luSYFcwek/7Ldu8YJzwjPZxeE+cTAt0k9n2mCG+3kSNO0REXWDGwoZVYSrA==',key_name='tempest-keypair-399432094',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:27:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36cda9a88b434e66ad6d8ac75790d141',ramdisk_id='',reservation_id='r-xmrtzxbg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1822750901',owner_user_name='tempest-AttachVolumeShelveTestJSON-1822750901-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:27:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a70218d8181040818ed8290e743bd2db',uuid=cad9a071-e232-4629-a3cc-9cb9d3fe9333,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converting VIF {"id": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "address": "fa:16:3e:ad:51:89", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8db5130-7b", "ovs_interfaceid": "a8db5130-7bc3-414c-b8bf-469e4fa0eb7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:89,bridge_name='br-int',has_traffic_filtering=True,id=a8db5130-7bc3-414c-b8bf-469e4fa0eb7b,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db5130-7b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG os_vif [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:89,bridge_name='br-int',has_traffic_filtering=True,id=a8db5130-7bc3-414c-b8bf-469e4fa0eb7b,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db5130-7b') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8db5130-7b, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df5d5700-8b4c-4da9-9206-832660efdc06) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:29:50 user nova-compute[75071]: INFO os_vif [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:51:89,bridge_name='br-int',has_traffic_filtering=True,id=a8db5130-7bc3-414c-b8bf-469e4fa0eb7b,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8db5130-7b')
Dec 05 12:29:50 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Deleting instance files /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333_del
Dec 05 12:29:51 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Deletion of /opt/stack/data/nova/instances/cad9a071-e232-4629-a3cc-9cb9d3fe9333_del complete
Dec 05 12:29:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:51 user nova-compute[75071]: INFO nova.compute.manager [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Took 0.89 seconds to destroy the instance on the hypervisor.
Dec 05 12:29:51 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:29:51 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:29:51 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:29:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:29:51 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:29:51 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=7507MB free_disk=24.85494613647461GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:29:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:51 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:29:51 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Took 0.79 seconds to deallocate network for instance.
Dec 05 12:29:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Applying migration context for instance c2b46f1c-dce6-4436-8e1e-062ffda80732 as it has an incoming, in-progress migration 7fb04b32-6cdf-47c3-9e01-f299ef6c8815. Migration status is post-migrating {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 05 12:29:51 user nova-compute[75071]: INFO nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Updating resource usage from migration 7fb04b32-6cdf-47c3-9e01-f299ef6c8815
Dec 05 12:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e08be776-0fa9-4871-86eb-2093530c00f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance a99a0331-1d77-4b71-9ef7-0794778b3ef1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance cad9a071-e232-4629-a3cc-9cb9d3fe9333 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:29:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:29:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 2704ba7b-5e66-4348-a0fb-181465476095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:29:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 20883e1b-4595-44c9-9855-3160fb16d148 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:29:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Migration 7fb04b32-6cdf-47c3-9e01-f299ef6c8815 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Dec 05 12:29:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c2b46f1c-dce6-4436-8e1e-062ffda80732 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:29:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:29:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:29:52 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:29:52 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:29:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:29:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.385s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-37ba4124-77dc-4102-8021-720755fa42be req-d69e2518-46c7-45ef-b9ac-101e143f63d5 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received event network-vif-plugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:29:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-37ba4124-77dc-4102-8021-720755fa42be req-d69e2518-46c7-45ef-b9ac-101e143f63d5 service nova] Acquiring lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-37ba4124-77dc-4102-8021-720755fa42be req-d69e2518-46c7-45ef-b9ac-101e143f63d5 service nova] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-37ba4124-77dc-4102-8021-720755fa42be req-d69e2518-46c7-45ef-b9ac-101e143f63d5 service nova] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-37ba4124-77dc-4102-8021-720755fa42be req-d69e2518-46c7-45ef-b9ac-101e143f63d5 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] No waiting events found dispatching network-vif-plugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:29:52 user nova-compute[75071]: WARNING nova.compute.manager [req-37ba4124-77dc-4102-8021-720755fa42be req-d69e2518-46c7-45ef-b9ac-101e143f63d5 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received unexpected event network-vif-plugged-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b for instance with vm_state deleted and task_state None.
Dec 05 12:29:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-37ba4124-77dc-4102-8021-720755fa42be req-d69e2518-46c7-45ef-b9ac-101e143f63d5 service nova] [instance: cad9a071-e232-4629-a3cc-9cb9d3fe9333] Received event network-vif-deleted-a8db5130-7bc3-414c-b8bf-469e4fa0eb7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:29:52 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:29:52 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:29:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:52 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Deleted allocations for instance cad9a071-e232-4629-a3cc-9cb9d3fe9333
Dec 05 12:29:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-76772d0c-b3bf-4d8b-a76e-9fe732519083 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "cad9a071-e232-4629-a3cc-9cb9d3fe9333" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.710s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:29:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:29:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:29:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:29:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:29:53 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:29:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:29:53 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:29:53 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 12:29:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:29:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:29:53 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:29:53 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lazy-loading 'info_cache' on Instance uuid e08be776-0fa9-4871-86eb-2093530c00f3 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Updating instance_info_cache with network_info: [{"id": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "address": "fa:16:3e:32:a2:62", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f59600f-fe", "ovs_interfaceid": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-e08be776-0fa9-4871-86eb-2093530c00f3" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Starting finish_migration {{(pid=75071) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11668}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Instance directory exists: not creating {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 05 12:29:54 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Creating image(s)
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Ensure instance console log exists: /opt/stack/data/nova/instances/c2b46f1c-dce6-4436-8e1e-062ffda80732/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Start _get_guest_xml network_info=[{"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-447918098-network", "vif_mac": "fa:16:3e:39:95:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '0ae8e93a-4d46-432d-a449-4a6879088f3c', 'device_type': 'disk', 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMDuqjzy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c2b46f1c-dce6-4436-8e1e-062ffda80732', 'attached_at': '2023-12-05T12:29:54.000000', 'detached_at': '', 'volume_id': '8ec07bbd-2382-4b77-9612-c773344113f0', 'serial': '8ec07bbd-2382-4b77-9612-c773344113f0'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:29:54 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:29:54 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:53Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMDuqjzy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:29:54 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:29:54 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:29:54 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3bc576-c8e4-4e6f-9ec2-079a27d4ce80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:29:54 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f33f12b-0abd-4c3b-ba27-ba32cbc125d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0] added
Dec 05 12:29:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5f0e4a-23cd-4cb0-a859-97c06a69efe4]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[82864148-2dd3-466b-9acb-10494ee6b6be]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sMDuqjzy {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sMDuqjzy" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[523ee93c-bff1-4ac5-a0b1-3dbe56a95027]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sMDuqjzy'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[625f3ea7-0f3c-4246-a899-9d52a6705be5]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f96fd6-1b52-40e1-8a22-8be9425d3eda]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:29:54 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:29:54 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 (non-flash)
Dec 05 12:29:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:29:54 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:29:54 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 (non-flash)
Dec 05 12:29:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[295d3382-53e4-42dc-add1-0fdce6e8e249]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0, portal: 172.16.0.220,3260]
Dec 05 12:29:54 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0, portal: 172.16.0.220,3260] successful.
Dec 05 12:29:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4564703-66d8-4931-b57b-e1d4292cd521]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a325ca-33c7-4073-b8e9-df684bbb81b4]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:29:54 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:29:54 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 (non-flash)
Dec 05 12:29:54 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:29:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:29:54 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:29:54 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 (non-flash)
Dec 05 12:29:54 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:29:54 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6655ef-1dc2-434a-9e01-e94c455318d0]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:29:54 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMDuqjzy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23133613339663534', 'path': '/dev/sde'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133613339663534', 'path': '/dev/sde'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-838854064',display_name='tempest-ServerActionsTestOtherA-server-838854064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-838854064',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr4CxHIGILJKylwCAW1k5g9hHm3DpT3NJj15aFaT5zmT7LmQxPRChXNHnUJDBNGMOIF2KjOMuY9sG7Diwqrmevv8WAXt0F+z6Y+uzBIRaBoBEcSXjeLaXdD3Dv6NXOVGQ==',key_name='tempest-keypair-237629817',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:28:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='59b6bfae34944fcfbd49d2f18b232ec8',ramdisk_id='',reservation_id='r-34l73x5j',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1523780015',owner_user_name='tempest-ServerActionsTestOtherA-1523780015-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:29:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e73e24d5b1489c813f06690b12eef4',uuid=c2b46f1c-dce6-4436-8e1e-062ffda80732,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-447918098-network", "vif_mac": "fa:16:3e:39:95:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converting VIF {"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-447918098-network", "vif_mac": "fa:16:3e:39:95:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7fb9d1-89') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:29:55 user nova-compute[75071]:   <uuid>c2b46f1c-dce6-4436-8e1e-062ffda80732</uuid>
Dec 05 12:29:55 user nova-compute[75071]:   <name>instance-0000001d</name>
Dec 05 12:29:55 user nova-compute[75071]:   <memory>2097152</memory>
Dec 05 12:29:55 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:29:55 user nova-compute[75071]:   <metadata>
Dec 05 12:29:55 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:29:55 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:29:55 user nova-compute[75071]:       <nova:name>tempest-ServerActionsTestOtherA-server-838854064</nova:name>
Dec 05 12:29:55 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:29:54</nova:creationTime>
Dec 05 12:29:55 user nova-compute[75071]:       <nova:flavor name="m1.small">
Dec 05 12:29:55 user nova-compute[75071]:         <nova:memory>2048</nova:memory>
Dec 05 12:29:55 user nova-compute[75071]:         <nova:disk>20</nova:disk>
Dec 05 12:29:55 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:29:55 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:29:55 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:29:55 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:29:55 user nova-compute[75071]:       <nova:owner>
Dec 05 12:29:55 user nova-compute[75071]:         <nova:user uuid="d7e73e24d5b1489c813f06690b12eef4">tempest-ServerActionsTestOtherA-1523780015-project-member</nova:user>
Dec 05 12:29:55 user nova-compute[75071]:         <nova:project uuid="59b6bfae34944fcfbd49d2f18b232ec8">tempest-ServerActionsTestOtherA-1523780015</nova:project>
Dec 05 12:29:55 user nova-compute[75071]:       </nova:owner>
Dec 05 12:29:55 user nova-compute[75071]:       <nova:ports>
Dec 05 12:29:55 user nova-compute[75071]:         <nova:port uuid="0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258">
Dec 05 12:29:55 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 05 12:29:55 user nova-compute[75071]:         </nova:port>
Dec 05 12:29:55 user nova-compute[75071]:       </nova:ports>
Dec 05 12:29:55 user nova-compute[75071]:     </nova:instance>
Dec 05 12:29:55 user nova-compute[75071]:   </metadata>
Dec 05 12:29:55 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:29:55 user nova-compute[75071]:     <system>
Dec 05 12:29:55 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:29:55 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:29:55 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:29:55 user nova-compute[75071]:       <entry name="serial">c2b46f1c-dce6-4436-8e1e-062ffda80732</entry>
Dec 05 12:29:55 user nova-compute[75071]:       <entry name="uuid">c2b46f1c-dce6-4436-8e1e-062ffda80732</entry>
Dec 05 12:29:55 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:29:55 user nova-compute[75071]:     </system>
Dec 05 12:29:55 user nova-compute[75071]:   </sysinfo>
Dec 05 12:29:55 user nova-compute[75071]:   <os>
Dec 05 12:29:55 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:29:55 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:29:55 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:29:55 user nova-compute[75071]:   </os>
Dec 05 12:29:55 user nova-compute[75071]:   <features>
Dec 05 12:29:55 user nova-compute[75071]:     <acpi/>
Dec 05 12:29:55 user nova-compute[75071]:     <apic/>
Dec 05 12:29:55 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:29:55 user nova-compute[75071]:   </features>
Dec 05 12:29:55 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:29:55 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:29:55 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:29:55 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:29:55 user nova-compute[75071]:   </clock>
Dec 05 12:29:55 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:29:55 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:29:55 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:29:55 user nova-compute[75071]:   </cpu>
Dec 05 12:29:55 user nova-compute[75071]:   <devices>
Dec 05 12:29:55 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:29:55 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:29:55 user nova-compute[75071]:       <source dev="/dev/sde"/>
Dec 05 12:29:55 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:29:55 user nova-compute[75071]:       <serial>8ec07bbd-2382-4b77-9612-c773344113f0</serial>
Dec 05 12:29:55 user nova-compute[75071]:     </disk>
Dec 05 12:29:55 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:29:55 user nova-compute[75071]:       <mac address="fa:16:3e:39:95:8a"/>
Dec 05 12:29:55 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:29:55 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:29:55 user nova-compute[75071]:       <target dev="tap0a7fb9d1-89"/>
Dec 05 12:29:55 user nova-compute[75071]:     </interface>
Dec 05 12:29:55 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:29:55 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/c2b46f1c-dce6-4436-8e1e-062ffda80732/console.log" append="off"/>
Dec 05 12:29:55 user nova-compute[75071]:     </serial>
Dec 05 12:29:55 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:29:55 user nova-compute[75071]:     <video>
Dec 05 12:29:55 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:29:55 user nova-compute[75071]:     </video>
Dec 05 12:29:55 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:29:55 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:29:55 user nova-compute[75071]:     </rng>
Dec 05 12:29:55 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:29:55 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:29:55 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:29:55 user nova-compute[75071]:     </memballoon>
Dec 05 12:29:55 user nova-compute[75071]:   </devices>
Dec 05 12:29:55 user nova-compute[75071]: </domain>
Dec 05 12:29:55 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-838854064',display_name='tempest-ServerActionsTestOtherA-server-838854064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-838854064',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr4CxHIGILJKylwCAW1k5g9hHm3DpT3NJj15aFaT5zmT7LmQxPRChXNHnUJDBNGMOIF2KjOMuY9sG7Diwqrmevv8WAXt0F+z6Y+uzBIRaBoBEcSXjeLaXdD3Dv6NXOVGQ==',key_name='tempest-keypair-237629817',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:28:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='59b6bfae34944fcfbd49d2f18b232ec8',ramdisk_id='',reservation_id='r-34l73x5j',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1523780015',owner_user_name='tempest-ServerActionsTestOtherA-1523780015-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:29:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e73e24d5b1489c813f06690b12eef4',uuid=c2b46f1c-dce6-4436-8e1e-062ffda80732,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-447918098-network", "vif_mac": "fa:16:3e:39:95:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converting VIF {"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-447918098-network", "vif_mac": "fa:16:3e:39:95:8a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7fb9d1-89') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG os_vif [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7fb9d1-89') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd26f9cc-c606-5a38-ada5-988c16c5fbb8', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a7fb9d1-89, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a7fb9d1-89, col_values=(('qos', UUID('a36ff4d9-b891-47b0-9061-a8be6da27f36')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a7fb9d1-89, col_values=(('external_ids', {'iface-id': '0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:95:8a', 'vm-uuid': 'c2b46f1c-dce6-4436-8e1e-062ffda80732'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:55 user nova-compute[75071]: INFO os_vif [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7fb9d1-89')
Dec 05 12:29:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:29:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] No VIF found with MAC fa:16:3e:39:95:8a, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:29:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-2b8f9f63-b9f5-44ab-a7f4-efd1526e9dc5 req-b193bbec-e39d-4830-994f-7e985359dd4c service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Received event network-vif-plugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:29:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2b8f9f63-b9f5-44ab-a7f4-efd1526e9dc5 req-b193bbec-e39d-4830-994f-7e985359dd4c service nova] Acquiring lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2b8f9f63-b9f5-44ab-a7f4-efd1526e9dc5 req-b193bbec-e39d-4830-994f-7e985359dd4c service nova] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2b8f9f63-b9f5-44ab-a7f4-efd1526e9dc5 req-b193bbec-e39d-4830-994f-7e985359dd4c service nova] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-2b8f9f63-b9f5-44ab-a7f4-efd1526e9dc5 req-b193bbec-e39d-4830-994f-7e985359dd4c service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] No waiting events found dispatching network-vif-plugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:29:57 user nova-compute[75071]: WARNING nova.compute.manager [req-2b8f9f63-b9f5-44ab-a7f4-efd1526e9dc5 req-b193bbec-e39d-4830-994f-7e985359dd4c service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Received unexpected event network-vif-plugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 for instance with vm_state active and task_state resize_finish.
Dec 05 12:29:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "43653273-2337-43a0-981a-e28d1ba26655" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "43653273-2337-43a0-981a-e28d1ba26655" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:29:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:29:58 user nova-compute[75071]: INFO nova.compute.claims [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Claim successful on node user
Dec 05 12:29:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:29:58 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:29:58 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:29:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:29:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:29:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:29:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:29:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:29:59 user nova-compute[75071]: DEBUG nova.policy [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1feef67013ea4c4db4be3a352eeaec7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b9ac01e22eb428885981285a18f34fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:29:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:29:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:29:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Creating image(s)
Dec 05 12:29:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "/opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "/opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "/opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "b9228069741ba74612c0465323e6f8c394d84bb9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "b9228069741ba74612c0465323e6f8c394d84bb9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9228069741ba74612c0465323e6f8c394d84bb9.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:29:59 user nova-compute[75071]: DEBUG nova.network.neutron [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Successfully created port: b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:29:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-6cc43449-918c-4ac5-a794-582d23029840 req-a0993418-0c6c-4499-8fdd-aa73ee3363d9 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Received event network-vif-plugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:29:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6cc43449-918c-4ac5-a794-582d23029840 req-a0993418-0c6c-4499-8fdd-aa73ee3363d9 service nova] Acquiring lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:29:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6cc43449-918c-4ac5-a794-582d23029840 req-a0993418-0c6c-4499-8fdd-aa73ee3363d9 service nova] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:29:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6cc43449-918c-4ac5-a794-582d23029840 req-a0993418-0c6c-4499-8fdd-aa73ee3363d9 service nova] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:29:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-6cc43449-918c-4ac5-a794-582d23029840 req-a0993418-0c6c-4499-8fdd-aa73ee3363d9 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] No waiting events found dispatching network-vif-plugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:29:59 user nova-compute[75071]: WARNING nova.compute.manager [req-6cc43449-918c-4ac5-a794-582d23029840 req-a0993418-0c6c-4499-8fdd-aa73ee3363d9 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Received unexpected event network-vif-plugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 for instance with vm_state active and task_state resize_finish.
Dec 05 12:29:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:29:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Instance running successfully.
Dec 05 12:29:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Failed to set time: agent not configured {{(pid=75071) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Dec 05 12:29:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d40185cd-7000-4189-892a-f2b02003b1f5 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] finish_migration finished successfully. {{(pid=75071) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11763}}
Dec 05 12:29:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9228069741ba74612c0465323e6f8c394d84bb9.part --force-share --output=json" returned: 0 in 0.218s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:29:59 user nova-compute[75071]: DEBUG nova.virt.images [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] 77ee73b9-3d1b-4a47-a0f8-b6c438a32b85 was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 12:29:59 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 12:29:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b9228069741ba74612c0465323e6f8c394d84bb9.part /opt/stack/data/nova/instances/_base/b9228069741ba74612c0465323e6f8c394d84bb9.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b9228069741ba74612c0465323e6f8c394d84bb9.part /opt/stack/data/nova/instances/_base/b9228069741ba74612c0465323e6f8c394d84bb9.converted" returned: 0 in 0.597s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9228069741ba74612c0465323e6f8c394d84bb9.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9228069741ba74612c0465323e6f8c394d84bb9.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "b9228069741ba74612c0465323e6f8c394d84bb9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.534s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9228069741ba74612c0465323e6f8c394d84bb9 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9228069741ba74612c0465323e6f8c394d84bb9 --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "b9228069741ba74612c0465323e6f8c394d84bb9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "b9228069741ba74612c0465323e6f8c394d84bb9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9228069741ba74612c0465323e6f8c394d84bb9 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Successfully updated port: b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9228069741ba74612c0465323e6f8c394d84bb9 --force-share --output=json" returned: 0 in 0.212s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9228069741ba74612c0465323e6f8c394d84bb9,backing_fmt=raw /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquired lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b9228069741ba74612c0465323e6f8c394d84bb9,backing_fmt=raw /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk 1073741824" returned: 0 in 0.051s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "b9228069741ba74612c0465323e6f8c394d84bb9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9228069741ba74612c0465323e6f8c394d84bb9 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b9228069741ba74612c0465323e6f8c394d84bb9 --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Updating instance_info_cache with network_info: [{"id": "b2236786-98e2-461a-ba60-9ded45e0c725", "address": "fa:16:3e:44:f4:af", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2236786-98", "ovs_interfaceid": "b2236786-98e2-461a-ba60-9ded45e0c725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Cannot resize image /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Ensure instance console log exists: /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Releasing lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Instance network_info: |[{"id": "b2236786-98e2-461a-ba60-9ded45e0c725", "address": "fa:16:3e:44:f4:af", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2236786-98", "ovs_interfaceid": "b2236786-98e2-461a-ba60-9ded45e0c725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Start _get_guest_xml network_info=[{"id": "b2236786-98e2-461a-ba60-9ded45e0c725", "address": "fa:16:3e:44:f4:af", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2236786-98", "ovs_interfaceid": "b2236786-98e2-461a-ba60-9ded45e0c725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:29:56Z,direct_url=<?>,disk_format='qcow2',id=77ee73b9-3d1b-4a47-a0f8-b6c438a32b85,min_disk=0,min_ram=0,name='tempest-scenario-img--69922863',owner='9b9ac01e22eb428885981285a18f34fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:29:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': '77ee73b9-3d1b-4a47-a0f8-b6c438a32b85'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:30:01 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:30:01 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:29:56Z,direct_url=<?>,disk_format='qcow2',id=77ee73b9-3d1b-4a47-a0f8-b6c438a32b85,min_disk=0,min_ram=0,name='tempest-scenario-img--69922863',owner='9b9ac01e22eb428885981285a18f34fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:29:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-84344102',display_name='tempest-TestMinimumBasicScenario-server-84344102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-84344102',id=31,image_ref='77ee73b9-3d1b-4a47-a0f8-b6c438a32b85',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKONl1OXL6Thqly9LaJZ5HI5p17NwwllIEnCSxrlABCfEo+myFZ46DggDl6BKwcFw1tWq9AcQ/2hy6ELVE0uQaiDqgJ2pqGpUFANw0r8VDYtKxkXFrzo0gzHfRiJ4B42Tg==',key_name='tempest-TestMinimumBasicScenario-272122578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b9ac01e22eb428885981285a18f34fc',ramdisk_id='',reservation_id='r-y59w45ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77ee73b9-3d1b-4a47-a0f8-b6c438a32b85',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-901409176',owner_user_name='tempest-TestMinimumBasicScenario-901409176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:29:59Z,user_data=None,user_id='1feef67013ea4c4db4be3a352eeaec7f',uuid=43653273-2337-43a0-981a-e28d1ba26655,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2236786-98e2-461a-ba60-9ded45e0c725", "address": "fa:16:3e:44:f4:af", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2236786-98", "ovs_interfaceid": "b2236786-98e2-461a-ba60-9ded45e0c725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Converting VIF {"id": "b2236786-98e2-461a-ba60-9ded45e0c725", "address": "fa:16:3e:44:f4:af", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2236786-98", "ovs_interfaceid": "b2236786-98e2-461a-ba60-9ded45e0c725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:f4:af,bridge_name='br-int',has_traffic_filtering=True,id=b2236786-98e2-461a-ba60-9ded45e0c725,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2236786-98') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.objects.instance [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lazy-loading 'pci_devices' on Instance uuid 43653273-2337-43a0-981a-e28d1ba26655 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:30:01 user nova-compute[75071]:   <uuid>43653273-2337-43a0-981a-e28d1ba26655</uuid>
Dec 05 12:30:01 user nova-compute[75071]:   <name>instance-0000001f</name>
Dec 05 12:30:01 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:30:01 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:30:01 user nova-compute[75071]:   <metadata>
Dec 05 12:30:01 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:30:01 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:30:01 user nova-compute[75071]:       <nova:name>tempest-TestMinimumBasicScenario-server-84344102</nova:name>
Dec 05 12:30:01 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:30:01</nova:creationTime>
Dec 05 12:30:01 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:30:01 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:30:01 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:30:01 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:30:01 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:30:01 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:30:01 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:30:01 user nova-compute[75071]:       <nova:owner>
Dec 05 12:30:01 user nova-compute[75071]:         <nova:user uuid="1feef67013ea4c4db4be3a352eeaec7f">tempest-TestMinimumBasicScenario-901409176-project-member</nova:user>
Dec 05 12:30:01 user nova-compute[75071]:         <nova:project uuid="9b9ac01e22eb428885981285a18f34fc">tempest-TestMinimumBasicScenario-901409176</nova:project>
Dec 05 12:30:01 user nova-compute[75071]:       </nova:owner>
Dec 05 12:30:01 user nova-compute[75071]:       <nova:root type="image" uuid="77ee73b9-3d1b-4a47-a0f8-b6c438a32b85"/>
Dec 05 12:30:01 user nova-compute[75071]:       <nova:ports>
Dec 05 12:30:01 user nova-compute[75071]:         <nova:port uuid="b2236786-98e2-461a-ba60-9ded45e0c725">
Dec 05 12:30:01 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 05 12:30:01 user nova-compute[75071]:         </nova:port>
Dec 05 12:30:01 user nova-compute[75071]:       </nova:ports>
Dec 05 12:30:01 user nova-compute[75071]:     </nova:instance>
Dec 05 12:30:01 user nova-compute[75071]:   </metadata>
Dec 05 12:30:01 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:30:01 user nova-compute[75071]:     <system>
Dec 05 12:30:01 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:30:01 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:30:01 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:30:01 user nova-compute[75071]:       <entry name="serial">43653273-2337-43a0-981a-e28d1ba26655</entry>
Dec 05 12:30:01 user nova-compute[75071]:       <entry name="uuid">43653273-2337-43a0-981a-e28d1ba26655</entry>
Dec 05 12:30:01 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:30:01 user nova-compute[75071]:     </system>
Dec 05 12:30:01 user nova-compute[75071]:   </sysinfo>
Dec 05 12:30:01 user nova-compute[75071]:   <os>
Dec 05 12:30:01 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:30:01 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:30:01 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:30:01 user nova-compute[75071]:   </os>
Dec 05 12:30:01 user nova-compute[75071]:   <features>
Dec 05 12:30:01 user nova-compute[75071]:     <acpi/>
Dec 05 12:30:01 user nova-compute[75071]:     <apic/>
Dec 05 12:30:01 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:30:01 user nova-compute[75071]:   </features>
Dec 05 12:30:01 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:30:01 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:30:01 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:30:01 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:30:01 user nova-compute[75071]:   </clock>
Dec 05 12:30:01 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:30:01 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:30:01 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:30:01 user nova-compute[75071]:   </cpu>
Dec 05 12:30:01 user nova-compute[75071]:   <devices>
Dec 05 12:30:01 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:30:01 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:30:01 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk"/>
Dec 05 12:30:01 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:30:01 user nova-compute[75071]:     </disk>
Dec 05 12:30:01 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:30:01 user nova-compute[75071]:       <mac address="fa:16:3e:44:f4:af"/>
Dec 05 12:30:01 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:30:01 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:30:01 user nova-compute[75071]:       <target dev="tapb2236786-98"/>
Dec 05 12:30:01 user nova-compute[75071]:     </interface>
Dec 05 12:30:01 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:30:01 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/console.log" append="off"/>
Dec 05 12:30:01 user nova-compute[75071]:     </serial>
Dec 05 12:30:01 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:30:01 user nova-compute[75071]:     <video>
Dec 05 12:30:01 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:30:01 user nova-compute[75071]:     </video>
Dec 05 12:30:01 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:30:01 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:30:01 user nova-compute[75071]:     </rng>
Dec 05 12:30:01 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:30:01 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:30:01 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:30:01 user nova-compute[75071]:     </memballoon>
Dec 05 12:30:01 user nova-compute[75071]:   </devices>
Dec 05 12:30:01 user nova-compute[75071]: </domain>
Dec 05 12:30:01 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-84344102',display_name='tempest-TestMinimumBasicScenario-server-84344102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-84344102',id=31,image_ref='77ee73b9-3d1b-4a47-a0f8-b6c438a32b85',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKONl1OXL6Thqly9LaJZ5HI5p17NwwllIEnCSxrlABCfEo+myFZ46DggDl6BKwcFw1tWq9AcQ/2hy6ELVE0uQaiDqgJ2pqGpUFANw0r8VDYtKxkXFrzo0gzHfRiJ4B42Tg==',key_name='tempest-TestMinimumBasicScenario-272122578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b9ac01e22eb428885981285a18f34fc',ramdisk_id='',reservation_id='r-y59w45ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77ee73b9-3d1b-4a47-a0f8-b6c438a32b85',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-901409176',owner_user_name='tempest-TestMinimumBasicScenario-901409176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:29:59Z,user_data=None,user_id='1feef67013ea4c4db4be3a352eeaec7f',uuid=43653273-2337-43a0-981a-e28d1ba26655,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2236786-98e2-461a-ba60-9ded45e0c725", "address": "fa:16:3e:44:f4:af", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2236786-98", "ovs_interfaceid": "b2236786-98e2-461a-ba60-9ded45e0c725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Converting VIF {"id": "b2236786-98e2-461a-ba60-9ded45e0c725", "address": "fa:16:3e:44:f4:af", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2236786-98", "ovs_interfaceid": "b2236786-98e2-461a-ba60-9ded45e0c725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:f4:af,bridge_name='br-int',has_traffic_filtering=True,id=b2236786-98e2-461a-ba60-9ded45e0c725,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2236786-98') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG os_vif [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:f4:af,bridge_name='br-int',has_traffic_filtering=True,id=b2236786-98e2-461a-ba60-9ded45e0c725,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2236786-98') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9fd14141-3a30-557b-a85c-5c3c7e3ede94', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-30201045-8943-4a5f-ab58-bfd511a6b89a req-4d13f274-c217-4e5c-bf70-e6564bc70529 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received event network-changed-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-30201045-8943-4a5f-ab58-bfd511a6b89a req-4d13f274-c217-4e5c-bf70-e6564bc70529 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Refreshing instance network info cache due to event network-changed-b2236786-98e2-461a-ba60-9ded45e0c725. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-30201045-8943-4a5f-ab58-bfd511a6b89a req-4d13f274-c217-4e5c-bf70-e6564bc70529 service nova] Acquiring lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-30201045-8943-4a5f-ab58-bfd511a6b89a req-4d13f274-c217-4e5c-bf70-e6564bc70529 service nova] Acquired lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.network.neutron [req-30201045-8943-4a5f-ab58-bfd511a6b89a req-4d13f274-c217-4e5c-bf70-e6564bc70529 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Refreshing network info cache for port b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2236786-98, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb2236786-98, col_values=(('qos', UUID('0000e522-f98b-44a9-a631-c6983d2613a2')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb2236786-98, col_values=(('external_ids', {'iface-id': 'b2236786-98e2-461a-ba60-9ded45e0c725', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:f4:af', 'vm-uuid': '43653273-2337-43a0-981a-e28d1ba26655'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:01 user nova-compute[75071]: INFO os_vif [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:f4:af,bridge_name='br-int',has_traffic_filtering=True,id=b2236786-98e2-461a-ba60-9ded45e0c725,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2236786-98')
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:30:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] No VIF found with MAC fa:16:3e:44:f4:af, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:30:02 user nova-compute[75071]: DEBUG nova.network.neutron [req-30201045-8943-4a5f-ab58-bfd511a6b89a req-4d13f274-c217-4e5c-bf70-e6564bc70529 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Updated VIF entry in instance network info cache for port b2236786-98e2-461a-ba60-9ded45e0c725. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:30:02 user nova-compute[75071]: DEBUG nova.network.neutron [req-30201045-8943-4a5f-ab58-bfd511a6b89a req-4d13f274-c217-4e5c-bf70-e6564bc70529 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Updating instance_info_cache with network_info: [{"id": "b2236786-98e2-461a-ba60-9ded45e0c725", "address": "fa:16:3e:44:f4:af", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2236786-98", "ovs_interfaceid": "b2236786-98e2-461a-ba60-9ded45e0c725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:30:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-30201045-8943-4a5f-ab58-bfd511a6b89a req-4d13f274-c217-4e5c-bf70-e6564bc70529 service nova] Releasing lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:30:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:03 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2704ba7b-5e66-4348-a0fb-181465476095 is timed out.
Dec 05 12:30:03 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Successfully detached device vdb from instance 2704ba7b-5e66-4348-a0fb-181465476095 from the live domain config.
Dec 05 12:30:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tfUPcQvN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:30:03 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa602c7-fdcd-4ff4-a521-1ca7cf896408]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:30:03 user nova-compute[75071]: No targets found.
Dec 05 12:30:03 user nova-compute[75071]: iSNS:
Dec 05 12:30:03 user nova-compute[75071]: No targets found.
Dec 05 12:30:03 user nova-compute[75071]: STATIC:
Dec 05 12:30:03 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:30:03 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:30:03 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:30:03 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256
Dec 05 12:30:03 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:30:03 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:30:03 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0
Dec 05 12:30:03 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:30:03 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:30:03 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546
Dec 05 12:30:03 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:30:03 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:30:03 user nova-compute[75071]: FIRMWARE:
Dec 05 12:30:03 user nova-compute[75071]: No targets found.
Dec 05 12:30:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:30:03 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:30:03 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[984d1588-16a9-442e-9760-c4bbdab13657]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[10db8b29-af1e-480f-92c6-399605a00f36]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:30:03 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:30:03 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 (non-flash)
Dec 05 12:30:03 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:30:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:30:03 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:30:03 user nova-compute[75071]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 (non-flash)
Dec 05 12:30:03 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:30:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f827c1dd3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ef2134-d005-4a13-a74f-608c44730daf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4eba3c-cb68-4cd0-8cde-81fe7b11d748]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.030s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7678f72a-3ac0-4945-bede-1ad589763501]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-1fc14ad6-3139-407f-a7fc-72d1f69be640 req-86be3647-fa4e-4328-bd1a-a2e1d4fa0591 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received event network-vif-plugged-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1fc14ad6-3139-407f-a7fc-72d1f69be640 req-86be3647-fa4e-4328-bd1a-a2e1d4fa0591 service nova] Acquiring lock "43653273-2337-43a0-981a-e28d1ba26655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1fc14ad6-3139-407f-a7fc-72d1f69be640 req-86be3647-fa4e-4328-bd1a-a2e1d4fa0591 service nova] Lock "43653273-2337-43a0-981a-e28d1ba26655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1fc14ad6-3139-407f-a7fc-72d1f69be640 req-86be3647-fa4e-4328-bd1a-a2e1d4fa0591 service nova] Lock "43653273-2337-43a0-981a-e28d1ba26655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-1fc14ad6-3139-407f-a7fc-72d1f69be640 req-86be3647-fa4e-4328-bd1a-a2e1d4fa0591 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] No waiting events found dispatching network-vif-plugged-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:30:03 user nova-compute[75071]: WARNING nova.compute.manager [req-1fc14ad6-3139-407f-a7fc-72d1f69be640 req-86be3647-fa4e-4328-bd1a-a2e1d4fa0591 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received unexpected event network-vif-plugged-b2236786-98e2-461a-ba60-9ded45e0c725 for instance with vm_state building and task_state spawning.
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2958d224-462e-4b68-9f26-458c49ae28d8]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e8c156-3912-432a-a51a-27d1f6e49f01]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8ca8a9-23cf-4a34-9a50-c4cdebba6653]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256, portal: 172.16.0.220,3260]
Dec 05 12:30:03 user nova-compute[75071]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256, portal: 172.16.0.220,3260] successful.
Dec 05 12:30:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52141164-b40a-4222-bcb3-5889c02b4256 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b4de0c-dbdb-4736-83f3-cc063926b0c4]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] <== disconnect_volume: return (423ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:04 user nova-compute[75071]: DEBUG nova.objects.instance [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lazy-loading 'flavor' on Instance uuid 2704ba7b-5e66-4348-a0fb-181465476095 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:30:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7aef5c29-8d1e-421e-8256-29fc2075a744 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "2704ba7b-5e66-4348-a0fb-181465476095" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.275s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-58a022fe-2127-472f-bdcd-8388c722e2ef req-969421b4-16f6-494e-ac58-78c3d73ac4f0 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received event network-vif-plugged-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:30:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-58a022fe-2127-472f-bdcd-8388c722e2ef req-969421b4-16f6-494e-ac58-78c3d73ac4f0 service nova] Acquiring lock "43653273-2337-43a0-981a-e28d1ba26655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-58a022fe-2127-472f-bdcd-8388c722e2ef req-969421b4-16f6-494e-ac58-78c3d73ac4f0 service nova] Lock "43653273-2337-43a0-981a-e28d1ba26655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-58a022fe-2127-472f-bdcd-8388c722e2ef req-969421b4-16f6-494e-ac58-78c3d73ac4f0 service nova] Lock "43653273-2337-43a0-981a-e28d1ba26655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-58a022fe-2127-472f-bdcd-8388c722e2ef req-969421b4-16f6-494e-ac58-78c3d73ac4f0 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] No waiting events found dispatching network-vif-plugged-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:30:05 user nova-compute[75071]: WARNING nova.compute.manager [req-58a022fe-2127-472f-bdcd-8388c722e2ef req-969421b4-16f6-494e-ac58-78c3d73ac4f0 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received unexpected event network-vif-plugged-b2236786-98e2-461a-ba60-9ded45e0c725 for instance with vm_state building and task_state spawning.
Dec 05 12:30:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:30:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:30:05 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Instance spawned successfully.
Dec 05 12:30:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:30:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:05 user nova-compute[75071]: INFO nova.compute.manager [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Took 6.69 seconds to spawn the instance on the hypervisor.
Dec 05 12:30:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:30:05 user nova-compute[75071]: INFO nova.compute.manager [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Took 7.45 seconds to build instance.
Dec 05 12:30:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-682caa38-8e40-45b9-99d5-473f01732b9f tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "43653273-2337-43a0-981a-e28d1ba26655" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.552s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-3034b04c-17d2-4451-bcc0-219aaa9310a4 req-fa11924f-86d5-4a21-9369-ffc485d89039 service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Received event network-changed-c5c11572-db63-48c5-9899-b3fd621d1819 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:30:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-3034b04c-17d2-4451-bcc0-219aaa9310a4 req-fa11924f-86d5-4a21-9369-ffc485d89039 service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Refreshing instance network info cache due to event network-changed-c5c11572-db63-48c5-9899-b3fd621d1819. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:30:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3034b04c-17d2-4451-bcc0-219aaa9310a4 req-fa11924f-86d5-4a21-9369-ffc485d89039 service nova] Acquiring lock "refresh_cache-20883e1b-4595-44c9-9855-3160fb16d148" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:30:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3034b04c-17d2-4451-bcc0-219aaa9310a4 req-fa11924f-86d5-4a21-9369-ffc485d89039 service nova] Acquired lock "refresh_cache-20883e1b-4595-44c9-9855-3160fb16d148" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:30:18 user nova-compute[75071]: DEBUG nova.network.neutron [req-3034b04c-17d2-4451-bcc0-219aaa9310a4 req-fa11924f-86d5-4a21-9369-ffc485d89039 service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Refreshing network info cache for port c5c11572-db63-48c5-9899-b3fd621d1819 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:30:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG nova.network.neutron [req-3034b04c-17d2-4451-bcc0-219aaa9310a4 req-fa11924f-86d5-4a21-9369-ffc485d89039 service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Updated VIF entry in instance network info cache for port c5c11572-db63-48c5-9899-b3fd621d1819. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG nova.network.neutron [req-3034b04c-17d2-4451-bcc0-219aaa9310a4 req-fa11924f-86d5-4a21-9369-ffc485d89039 service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Updating instance_info_cache with network_info: [{"id": "c5c11572-db63-48c5-9899-b3fd621d1819", "address": "fa:16:3e:18:69:a2", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c11572-db", "ovs_interfaceid": "c5c11572-db63-48c5-9899-b3fd621d1819", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "20883e1b-4595-44c9-9855-3160fb16d148" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "20883e1b-4595-44c9-9855-3160fb16d148" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3034b04c-17d2-4451-bcc0-219aaa9310a4 req-fa11924f-86d5-4a21-9369-ffc485d89039 service nova] Releasing lock "refresh_cache-20883e1b-4595-44c9-9855-3160fb16d148" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG nova.objects.instance [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lazy-loading 'flavor' on Instance uuid 20883e1b-4595-44c9-9855-3160fb16d148 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "20883e1b-4595-44c9-9855-3160fb16d148" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "20883e1b-4595-44c9-9855-3160fb16d148" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "20883e1b-4595-44c9-9855-3160fb16d148" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:19 user nova-compute[75071]: INFO nova.compute.manager [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Attaching volume 72d0871f-ee1e-4e67-81e2-069ecea74929 to /dev/vdb
Dec 05 12:30:19 user nova-compute[75071]: DEBUG os_brick.utils [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[791b0613-6575-4cd3-94ab-4325480f6acc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4b7518-3eb1-45d5-b029-be13dbf951a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b88cd10-6b4a-4055-84f7-1afb5b560a83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6c52b0-97e5-4c2a-97c2-afb28a8e1a84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:30:19 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:30:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e3d25c-044b-4d9a-ae14-30c4cf8dcafb]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG os_brick.utils [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:30:19 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Updating existing volume attachment record: 53d88d08-0a8c-4a1f-9cec-323fdb910812 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:30:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "42776e73-1ef0-4c57-a50a-942f6f4881de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:30:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:20 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:30:20 user nova-compute[75071]: INFO nova.compute.claims [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Claim successful on node user
Dec 05 12:30:20 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:30:20 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:30:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:30:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:30:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:30:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:30:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:30:20 user nova-compute[75071]: DEBUG nova.policy [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '201cbbb8b3dc4a3aa8164d69c1257489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77a4b1baadd43e1be69eecb1f5370bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:30:20 user nova-compute[75071]: INFO nova.virt.block_device [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Booting with blank volume at /dev/vda
Dec 05 12:30:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Successfully created port: 3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:30:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Successfully updated port: 3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:30:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "refresh_cache-42776e73-1ef0-4c57-a50a-942f6f4881de" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:30:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquired lock "refresh_cache-42776e73-1ef0-4c57-a50a-942f6f4881de" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:30:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:30:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-7b76dba8-fc0c-4f76-8bb4-631f65a71589 req-146381ca-6a0a-4d67-9332-403bf50b497b service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received event network-changed-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:30:22 user nova-compute[75071]: DEBUG nova.compute.manager [req-7b76dba8-fc0c-4f76-8bb4-631f65a71589 req-146381ca-6a0a-4d67-9332-403bf50b497b service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Refreshing instance network info cache due to event network-changed-3774446d-0014-4060-b722-f3480e92a274. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:30:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7b76dba8-fc0c-4f76-8bb4-631f65a71589 req-146381ca-6a0a-4d67-9332-403bf50b497b service nova] Acquiring lock "refresh_cache-42776e73-1ef0-4c57-a50a-942f6f4881de" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:30:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:30:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Updating instance_info_cache with network_info: [{"id": "3774446d-0014-4060-b722-f3480e92a274", "address": "fa:16:3e:c9:ac:48", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3774446d-00", "ovs_interfaceid": "3774446d-0014-4060-b722-f3480e92a274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:30:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Releasing lock "refresh_cache-42776e73-1ef0-4c57-a50a-942f6f4881de" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:30:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Instance network_info: |[{"id": "3774446d-0014-4060-b722-f3480e92a274", "address": "fa:16:3e:c9:ac:48", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3774446d-00", "ovs_interfaceid": "3774446d-0014-4060-b722-f3480e92a274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:30:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7b76dba8-fc0c-4f76-8bb4-631f65a71589 req-146381ca-6a0a-4d67-9332-403bf50b497b service nova] Acquired lock "refresh_cache-42776e73-1ef0-4c57-a50a-942f6f4881de" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:30:22 user nova-compute[75071]: DEBUG nova.network.neutron [req-7b76dba8-fc0c-4f76-8bb4-631f65a71589 req-146381ca-6a0a-4d67-9332-403bf50b497b service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Refreshing network info cache for port 3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:30:22 user nova-compute[75071]: DEBUG nova.network.neutron [req-7b76dba8-fc0c-4f76-8bb4-631f65a71589 req-146381ca-6a0a-4d67-9332-403bf50b497b service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Updated VIF entry in instance network info cache for port 3774446d-0014-4060-b722-f3480e92a274. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:30:22 user nova-compute[75071]: DEBUG nova.network.neutron [req-7b76dba8-fc0c-4f76-8bb4-631f65a71589 req-146381ca-6a0a-4d67-9332-403bf50b497b service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Updating instance_info_cache with network_info: [{"id": "3774446d-0014-4060-b722-f3480e92a274", "address": "fa:16:3e:c9:ac:48", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3774446d-00", "ovs_interfaceid": "3774446d-0014-4060-b722-f3480e92a274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:30:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7b76dba8-fc0c-4f76-8bb4-631f65a71589 req-146381ca-6a0a-4d67-9332-403bf50b497b service nova] Releasing lock "refresh_cache-42776e73-1ef0-4c57-a50a-942f6f4881de" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:30:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG os_brick.utils [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cf41e6-89a1-4c77-9c4f-217eff9b5f44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[903d58ea-51f7-45c7-8cd2-085a3bd40fa8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a14683-3a90-435a-a533-568fab199509]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[397f4cfd-50ec-4416-8480-2bbf0eae8eb5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:30:26 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:30:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0279cb97-60b8-4672-a70e-792860fc13b5]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG os_brick.utils [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:30:26 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Updating existing volume attachment record: 06ab0279-f222-4ed9-9b5c-bed55aab4802 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:30:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tdGLEZSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:30:28 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:30:28 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:30:28 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c518a8-3d6f-448b-bb9d-b069ac1ef60e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:30:28 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08e9b91-1b5c-45c5-a3cf-3e80876fba99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929] added
Dec 05 12:30:29 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8135b831-6120-4ddf-ab4b-7836fd1510a2]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b067f01c-3358-4f37-ae48-d8de8d1fec01]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tdGLEZSa {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tdGLEZSa" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[20047253-79c3-4923-b949-e46943beb4f6]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tdGLEZSa'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1de0a1-2a41-4b67-aac8-db6885fde8d2]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[355bf241-b693-42f5-b803-137b6643eb18]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:30:29 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:30:29 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:30:29 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:30:29 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:30:29 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:30:29 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d48f98-c958-47b5-865e-ff808c81df89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929, portal: 172.16.0.220,3260]
Dec 05 12:30:29 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929, portal: 172.16.0.220,3260] successful.
Dec 05 12:30:29 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[12736ef3-d9a9-49aa-9ec4-d255f48b5b58]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e121fd65-87a1-49f7-9bde-b2c088a6f9b8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:30:29 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:30:29 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:30:29 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 (non-flash)
Dec 05 12:30:29 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:30:29 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:30:29 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:30:29 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 (non-flash)
Dec 05 12:30:29 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1a171a-b74f-4e15-b61b-fb698d07c13f]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:30:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tdGLEZSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:30:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:30:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23235376238313464', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:30:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235376238313464', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:30:30 user nova-compute[75071]: DEBUG nova.objects.instance [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lazy-loading 'flavor' on Instance uuid 20883e1b-4595-44c9-9855-3160fb16d148 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:30:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:30:30 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:30:30 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:30:30 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:30:30 user nova-compute[75071]:   <serial>72d0871f-ee1e-4e67-81e2-069ecea74929</serial>
Dec 05 12:30:30 user nova-compute[75071]: </disk>
Dec 05 12:30:30 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:30:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:30:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:30:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] No VIF found with MAC fa:16:3e:18:69:a2, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:30:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-26046c77-db7f-4db0-862c-0381d19018e4 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "20883e1b-4595-44c9-9855-3160fb16d148" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.601s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "20883e1b-4595-44c9-9855-3160fb16d148" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "20883e1b-4595-44c9-9855-3160fb16d148" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:32 user nova-compute[75071]: INFO nova.compute.manager [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Detaching volume 72d0871f-ee1e-4e67-81e2-069ecea74929
Dec 05 12:30:32 user nova-compute[75071]: INFO nova.virt.block_device [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Attempting to driver detach volume 72d0871f-ee1e-4e67-81e2-069ecea74929 from mountpoint /dev/vdb
Dec 05 12:30:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Attempting to detach device vdb from instance 20883e1b-4595-44c9-9855-3160fb16d148 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:30:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:30:32 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:30:32 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:30:32 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:30:32 user nova-compute[75071]:   <serial>72d0871f-ee1e-4e67-81e2-069ecea74929</serial>
Dec 05 12:30:32 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:30:32 user nova-compute[75071]: </disk>
Dec 05 12:30:32 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:30:32 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Successfully detached device vdb from instance 20883e1b-4595-44c9-9855-3160fb16d148 from the persistent domain config.
Dec 05 12:30:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 20883e1b-4595-44c9-9855-3160fb16d148 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:30:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:30:32 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:30:32 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:30:32 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:30:32 user nova-compute[75071]:   <serial>72d0871f-ee1e-4e67-81e2-069ecea74929</serial>
Dec 05 12:30:32 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:30:32 user nova-compute[75071]: </disk>
Dec 05 12:30:32 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:30:32 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 20883e1b-4595-44c9-9855-3160fb16d148 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:30:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "2704ba7b-5e66-4348-a0fb-181465476095" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "2704ba7b-5e66-4348-a0fb-181465476095" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "2704ba7b-5e66-4348-a0fb-181465476095-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "2704ba7b-5e66-4348-a0fb-181465476095-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "2704ba7b-5e66-4348-a0fb-181465476095-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:32 user nova-compute[75071]: INFO nova.compute.manager [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Terminating instance
Dec 05 12:30:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-b9527f2f-51d9-4fca-ae7c-dc8c12a64440 req-548a7452-b2cb-4cea-8009-1ea84054e338 service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Received event network-vif-unplugged-084a2a59-92f8-433d-be29-18eb5444cf18 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b9527f2f-51d9-4fca-ae7c-dc8c12a64440 req-548a7452-b2cb-4cea-8009-1ea84054e338 service nova] Acquiring lock "2704ba7b-5e66-4348-a0fb-181465476095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b9527f2f-51d9-4fca-ae7c-dc8c12a64440 req-548a7452-b2cb-4cea-8009-1ea84054e338 service nova] Lock "2704ba7b-5e66-4348-a0fb-181465476095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b9527f2f-51d9-4fca-ae7c-dc8c12a64440 req-548a7452-b2cb-4cea-8009-1ea84054e338 service nova] Lock "2704ba7b-5e66-4348-a0fb-181465476095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-b9527f2f-51d9-4fca-ae7c-dc8c12a64440 req-548a7452-b2cb-4cea-8009-1ea84054e338 service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] No waiting events found dispatching network-vif-unplugged-084a2a59-92f8-433d-be29-18eb5444cf18 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-b9527f2f-51d9-4fca-ae7c-dc8c12a64440 req-548a7452-b2cb-4cea-8009-1ea84054e338 service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Received event network-vif-unplugged-084a2a59-92f8-433d-be29-18eb5444cf18 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:30:33 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Instance destroyed successfully.
Dec 05 12:30:33 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lazy-loading 'resources' on Instance uuid 2704ba7b-5e66-4348-a0fb-181465476095 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:27:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-688610055',display_name='tempest-AttachVolumeNegativeTest-server-688610055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-688610055',id=27,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsvGSq3wxJ16ef0Ypt89B8VjEUQMfUjwgY2R0unFCnT+/5X0OY7wcKF2/kOZJ3qWtUjYI9dCvVl7dRvjQiCoepD9Ga0fP139KYIdSB4GYeouSgjg8cQc46aWDBYuF3hGA==',key_name='tempest-keypair-1264295312',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:27:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5c1a038a4eb45508b7f5aa3eb435229',ramdisk_id='',reservation_id='r-k5c76l01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1152460930',owner_user_name='tempest-AttachVolumeNegativeTest-1152460930-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:27:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7d78c212de2e426fad0cba51a2e7bf52',uuid=2704ba7b-5e66-4348-a0fb-181465476095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "084a2a59-92f8-433d-be29-18eb5444cf18", "address": "fa:16:3e:54:c7:a3", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a2a59-92", "ovs_interfaceid": "084a2a59-92f8-433d-be29-18eb5444cf18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converting VIF {"id": "084a2a59-92f8-433d-be29-18eb5444cf18", "address": "fa:16:3e:54:c7:a3", "network": {"id": "4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-838862263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5c1a038a4eb45508b7f5aa3eb435229", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap084a2a59-92", "ovs_interfaceid": "084a2a59-92f8-433d-be29-18eb5444cf18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:c7:a3,bridge_name='br-int',has_traffic_filtering=True,id=084a2a59-92f8-433d-be29-18eb5444cf18,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084a2a59-92') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG os_vif [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:c7:a3,bridge_name='br-int',has_traffic_filtering=True,id=084a2a59-92f8-433d-be29-18eb5444cf18,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084a2a59-92') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap084a2a59-92, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a5c8fec-9101-4cba-997f-d861c490086c) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:33 user nova-compute[75071]: INFO os_vif [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:c7:a3,bridge_name='br-int',has_traffic_filtering=True,id=084a2a59-92f8-433d-be29-18eb5444cf18,network=Network(4ecea2ef-bc3a-40d9-87d1-a8c21a0172b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap084a2a59-92')
Dec 05 12:30:33 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Deleting instance files /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095_del
Dec 05 12:30:33 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Deletion of /opt/stack/data/nova/instances/2704ba7b-5e66-4348-a0fb-181465476095_del complete
Dec 05 12:30:33 user nova-compute[75071]: INFO nova.compute.manager [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Took 0.86 seconds to destroy the instance on the hypervisor.
Dec 05 12:30:33 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:30:33 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:30:34 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:30:34 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Took 0.69 seconds to deallocate network for instance.
Dec 05 12:30:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:34 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:30:34 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:30:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:35 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Deleted allocations for instance 2704ba7b-5e66-4348-a0fb-181465476095
Dec 05 12:30:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f2e62e09-5740-4860-9a64-2ad041179fd1 tempest-AttachVolumeNegativeTest-1152460930 tempest-AttachVolumeNegativeTest-1152460930-project-member] Lock "2704ba7b-5e66-4348-a0fb-181465476095" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.103s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba5ebfc8-780f-493f-875c-021976751b20 req-e7d7b5c6-423d-43e4-8fe1-9b3ff120130d service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Received event network-vif-plugged-084a2a59-92f8-433d-be29-18eb5444cf18 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:30:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba5ebfc8-780f-493f-875c-021976751b20 req-e7d7b5c6-423d-43e4-8fe1-9b3ff120130d service nova] Acquiring lock "2704ba7b-5e66-4348-a0fb-181465476095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba5ebfc8-780f-493f-875c-021976751b20 req-e7d7b5c6-423d-43e4-8fe1-9b3ff120130d service nova] Lock "2704ba7b-5e66-4348-a0fb-181465476095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba5ebfc8-780f-493f-875c-021976751b20 req-e7d7b5c6-423d-43e4-8fe1-9b3ff120130d service nova] Lock "2704ba7b-5e66-4348-a0fb-181465476095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba5ebfc8-780f-493f-875c-021976751b20 req-e7d7b5c6-423d-43e4-8fe1-9b3ff120130d service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] No waiting events found dispatching network-vif-plugged-084a2a59-92f8-433d-be29-18eb5444cf18 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:30:35 user nova-compute[75071]: WARNING nova.compute.manager [req-ba5ebfc8-780f-493f-875c-021976751b20 req-e7d7b5c6-423d-43e4-8fe1-9b3ff120130d service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Received unexpected event network-vif-plugged-084a2a59-92f8-433d-be29-18eb5444cf18 for instance with vm_state deleted and task_state None.
Dec 05 12:30:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba5ebfc8-780f-493f-875c-021976751b20 req-e7d7b5c6-423d-43e4-8fe1-9b3ff120130d service nova] [instance: 2704ba7b-5e66-4348-a0fb-181465476095] Received event network-vif-deleted-084a2a59-92f8-433d-be29-18eb5444cf18 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:30:36 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Creating image(s)
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Ensure instance console log exists: /opt/stack/data/nova/instances/42776e73-1ef0-4c57-a50a-942f6f4881de/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Start _get_guest_xml network_info=[{"id": "3774446d-0014-4060-b722-f3480e92a274", "address": "fa:16:3e:c9:ac:48", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3774446d-00", "ovs_interfaceid": "3774446d-0014-4060-b722-f3480e92a274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '06ab0279-f222-4ed9-9b5c-bed55aab4802', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbZmcXIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '42776e73-1ef0-4c57-a50a-942f6f4881de', 'attached_at': '', 'detached_at': '', 'volume_id': '8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c', 'serial': '8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:30:36 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:30:36 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbZmcXIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:30:36 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:30:36 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:30:36 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[41488b48-358b-4ddd-8394-ec33a1a19a2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:30:36 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5358114-3822-4a87-99a3-d2a14ebdc139]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c] added
Dec 05 12:30:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24abd62-04d3-43b7-b45b-e497c56df3ee]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c422e293-b1dc-4455-b22a-dbfac8340b9d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VbZmcXIq {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VbZmcXIq" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2c0c5d-7688-4f62-905d-8042a01a7409]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VbZmcXIq'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b928dbd7-ce78-4cd0-94b8-e51e37486a55]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24e812f-d443-4f23-86dc-a01e11759e50]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:30:36 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:30:36 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:30:36 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 (non-flash)
Dec 05 12:30:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:30:36 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:30:36 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:30:36 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 (non-flash)
Dec 05 12:30:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20472e1-8b20-47ab-bbc4-ec962270ed4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c, portal: 172.16.0.220,3260]
Dec 05 12:30:36 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c, portal: 172.16.0.220,3260] successful.
Dec 05 12:30:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa3f995-f708-49a5-80ed-1196169240d3]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3775a6cc-aa10-4f92-98d2-8b2937c553ad]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:30:36 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:30:36 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:30:36 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 (non-flash)
Dec 05 12:30:36 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:30:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:30:36 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:30:36 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:30:36 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 (non-flash)
Dec 05 12:30:36 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:30:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d559e3b2-e678-4960-b8b1-c2e996afcafa]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:30:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbZmcXIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:30:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:30:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23830623662373337', 'path': '/dev/sdf'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:30:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830623662373337', 'path': '/dev/sdf'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:30:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-53509066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-53509066',id=32,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b77a4b1baadd43e1be69eecb1f5370bd',ramdisk_id='',reservation_id='r-jps7gm02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86909184',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:30:21Z,user_data=None,user_id='201cbbb8b3dc4a3aa8164d69c1257489',uuid=42776e73-1ef0-4c57-a50a-942f6f4881de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3774446d-0014-4060-b722-f3480e92a274", "address": "fa:16:3e:c9:ac:48", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3774446d-00", "ovs_interfaceid": "3774446d-0014-4060-b722-f3480e92a274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converting VIF {"id": "3774446d-0014-4060-b722-f3480e92a274", "address": "fa:16:3e:c9:ac:48", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3774446d-00", "ovs_interfaceid": "3774446d-0014-4060-b722-f3480e92a274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:ac:48,bridge_name='br-int',has_traffic_filtering=True,id=3774446d-0014-4060-b722-f3480e92a274,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3774446d-00') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG nova.objects.instance [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'pci_devices' on Instance uuid 42776e73-1ef0-4c57-a50a-942f6f4881de {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:30:38 user nova-compute[75071]:   <uuid>42776e73-1ef0-4c57-a50a-942f6f4881de</uuid>
Dec 05 12:30:38 user nova-compute[75071]:   <name>instance-00000020</name>
Dec 05 12:30:38 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:30:38 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:30:38 user nova-compute[75071]:   <metadata>
Dec 05 12:30:38 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:30:38 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:30:38 user nova-compute[75071]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-53509066</nova:name>
Dec 05 12:30:38 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:30:36</nova:creationTime>
Dec 05 12:30:38 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:30:38 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:30:38 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:30:38 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:30:38 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:30:38 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:30:38 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:30:38 user nova-compute[75071]:       <nova:owner>
Dec 05 12:30:38 user nova-compute[75071]:         <nova:user uuid="201cbbb8b3dc4a3aa8164d69c1257489">tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member</nova:user>
Dec 05 12:30:38 user nova-compute[75071]:         <nova:project uuid="b77a4b1baadd43e1be69eecb1f5370bd">tempest-ServerBootFromVolumeStableRescueTest-86909184</nova:project>
Dec 05 12:30:38 user nova-compute[75071]:       </nova:owner>
Dec 05 12:30:38 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:30:38 user nova-compute[75071]:       <nova:ports>
Dec 05 12:30:38 user nova-compute[75071]:         <nova:port uuid="3774446d-0014-4060-b722-f3480e92a274">
Dec 05 12:30:38 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 12:30:38 user nova-compute[75071]:         </nova:port>
Dec 05 12:30:38 user nova-compute[75071]:       </nova:ports>
Dec 05 12:30:38 user nova-compute[75071]:     </nova:instance>
Dec 05 12:30:38 user nova-compute[75071]:   </metadata>
Dec 05 12:30:38 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:30:38 user nova-compute[75071]:     <system>
Dec 05 12:30:38 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:30:38 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:30:38 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:30:38 user nova-compute[75071]:       <entry name="serial">42776e73-1ef0-4c57-a50a-942f6f4881de</entry>
Dec 05 12:30:38 user nova-compute[75071]:       <entry name="uuid">42776e73-1ef0-4c57-a50a-942f6f4881de</entry>
Dec 05 12:30:38 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:30:38 user nova-compute[75071]:     </system>
Dec 05 12:30:38 user nova-compute[75071]:   </sysinfo>
Dec 05 12:30:38 user nova-compute[75071]:   <os>
Dec 05 12:30:38 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:30:38 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:30:38 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:30:38 user nova-compute[75071]:   </os>
Dec 05 12:30:38 user nova-compute[75071]:   <features>
Dec 05 12:30:38 user nova-compute[75071]:     <acpi/>
Dec 05 12:30:38 user nova-compute[75071]:     <apic/>
Dec 05 12:30:38 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:30:38 user nova-compute[75071]:   </features>
Dec 05 12:30:38 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:30:38 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:30:38 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:30:38 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:30:38 user nova-compute[75071]:   </clock>
Dec 05 12:30:38 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:30:38 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:30:38 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:30:38 user nova-compute[75071]:   </cpu>
Dec 05 12:30:38 user nova-compute[75071]:   <devices>
Dec 05 12:30:38 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:30:38 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:30:38 user nova-compute[75071]:       <source dev="/dev/sdf"/>
Dec 05 12:30:38 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:30:38 user nova-compute[75071]:       <serial>8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c</serial>
Dec 05 12:30:38 user nova-compute[75071]:     </disk>
Dec 05 12:30:38 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:30:38 user nova-compute[75071]:       <mac address="fa:16:3e:c9:ac:48"/>
Dec 05 12:30:38 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:30:38 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:30:38 user nova-compute[75071]:       <target dev="tap3774446d-00"/>
Dec 05 12:30:38 user nova-compute[75071]:     </interface>
Dec 05 12:30:38 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:30:38 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/42776e73-1ef0-4c57-a50a-942f6f4881de/console.log" append="off"/>
Dec 05 12:30:38 user nova-compute[75071]:     </serial>
Dec 05 12:30:38 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:30:38 user nova-compute[75071]:     <video>
Dec 05 12:30:38 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:30:38 user nova-compute[75071]:     </video>
Dec 05 12:30:38 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:30:38 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:30:38 user nova-compute[75071]:     </rng>
Dec 05 12:30:38 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:30:38 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:30:38 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:30:38 user nova-compute[75071]:     </memballoon>
Dec 05 12:30:38 user nova-compute[75071]:   </devices>
Dec 05 12:30:38 user nova-compute[75071]: </domain>
Dec 05 12:30:38 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:30:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-53509066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-53509066',id=32,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b77a4b1baadd43e1be69eecb1f5370bd',ramdisk_id='',reservation_id='r-jps7gm02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86909184',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:30:21Z,user_data=None,user_id='201cbbb8b3dc4a3aa8164d69c1257489',uuid=42776e73-1ef0-4c57-a50a-942f6f4881de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3774446d-0014-4060-b722-f3480e92a274", "address": "fa:16:3e:c9:ac:48", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3774446d-00", "ovs_interfaceid": "3774446d-0014-4060-b722-f3480e92a274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converting VIF {"id": "3774446d-0014-4060-b722-f3480e92a274", "address": "fa:16:3e:c9:ac:48", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3774446d-00", "ovs_interfaceid": "3774446d-0014-4060-b722-f3480e92a274", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:ac:48,bridge_name='br-int',has_traffic_filtering=True,id=3774446d-0014-4060-b722-f3480e92a274,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3774446d-00') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG os_vif [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:ac:48,bridge_name='br-int',has_traffic_filtering=True,id=3774446d-0014-4060-b722-f3480e92a274,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3774446d-00') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34611ef4-ade9-5a4c-a0a1-8c06f6c31a65', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3774446d-00, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3774446d-00, col_values=(('qos', UUID('8afc65b8-6b94-4ec5-aa02-f7760f740108')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3774446d-00, col_values=(('external_ids', {'iface-id': '3774446d-0014-4060-b722-f3480e92a274', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:ac:48', 'vm-uuid': '42776e73-1ef0-4c57-a50a-942f6f4881de'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:38 user nova-compute[75071]: INFO os_vif [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:ac:48,bridge_name='br-int',has_traffic_filtering=True,id=3774446d-0014-4060-b722-f3480e92a274,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3774446d-00')
Dec 05 12:30:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] No VIF found with MAC fa:16:3e:c9:ac:48, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:30:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-70c3b209-9af4-4c63-a150-555363a570be req-945712b9-799f-42fa-be8c-f0fb0beb9d57 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received event network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:30:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-70c3b209-9af4-4c63-a150-555363a570be req-945712b9-799f-42fa-be8c-f0fb0beb9d57 service nova] Acquiring lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-70c3b209-9af4-4c63-a150-555363a570be req-945712b9-799f-42fa-be8c-f0fb0beb9d57 service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-70c3b209-9af4-4c63-a150-555363a570be req-945712b9-799f-42fa-be8c-f0fb0beb9d57 service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-70c3b209-9af4-4c63-a150-555363a570be req-945712b9-799f-42fa-be8c-f0fb0beb9d57 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] No waiting events found dispatching network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:30:39 user nova-compute[75071]: WARNING nova.compute.manager [req-70c3b209-9af4-4c63-a150-555363a570be req-945712b9-799f-42fa-be8c-f0fb0beb9d57 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received unexpected event network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 for instance with vm_state building and task_state spawning.
Dec 05 12:30:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:30:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:30:41 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Instance spawned successfully.
Dec 05 12:30:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:30:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:41 user nova-compute[75071]: INFO nova.compute.manager [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Took 4.99 seconds to spawn the instance on the hypervisor.
Dec 05 12:30:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:30:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-96c79888-dd4a-4bc2-8ab0-94c997661513 req-418e7126-b68f-447a-a109-a94af313c3b4 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received event network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:30:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-96c79888-dd4a-4bc2-8ab0-94c997661513 req-418e7126-b68f-447a-a109-a94af313c3b4 service nova] Acquiring lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-96c79888-dd4a-4bc2-8ab0-94c997661513 req-418e7126-b68f-447a-a109-a94af313c3b4 service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-96c79888-dd4a-4bc2-8ab0-94c997661513 req-418e7126-b68f-447a-a109-a94af313c3b4 service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-96c79888-dd4a-4bc2-8ab0-94c997661513 req-418e7126-b68f-447a-a109-a94af313c3b4 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] No waiting events found dispatching network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:30:41 user nova-compute[75071]: WARNING nova.compute.manager [req-96c79888-dd4a-4bc2-8ab0-94c997661513 req-418e7126-b68f-447a-a109-a94af313c3b4 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received unexpected event network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 for instance with vm_state building and task_state spawning.
Dec 05 12:30:41 user nova-compute[75071]: INFO nova.compute.manager [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Took 21.43 seconds to build instance.
Dec 05 12:30:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ee199f12-9ac7-4f76-8fb3-0330cb8e003b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.528s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "77c962a7-587a-41be-b87d-ab416b8b43fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:43 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:30:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:43 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:30:43 user nova-compute[75071]: INFO nova.compute.claims [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Claim successful on node user
Dec 05 12:30:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:30:44 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:30:44 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG nova.policy [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a70218d8181040818ed8290e743bd2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36cda9a88b434e66ad6d8ac75790d141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:30:44 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Creating image(s)
Dec 05 12:30:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "/opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "/opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "/opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk 1073741824" returned: 0 in 0.057s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:44 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Successfully created port: 52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:30:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:45 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Checking if we can resize image /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:30:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:45 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Cannot resize image /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:30:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:30:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Ensure instance console log exists: /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:30:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "015e89c3-73ad-4bfd-b55c-68323fae2b29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:30:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:45 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:30:45 user nova-compute[75071]: INFO nova.compute.claims [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Claim successful on node user
Dec 05 12:30:45 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Successfully updated port: 52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquired lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-41335def-048c-480e-ad20-35094de9e627 req-1c4b483c-49ac-42f0-9acb-35fa89ecc7ff service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received event network-changed-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-41335def-048c-480e-ad20-35094de9e627 req-1c4b483c-49ac-42f0-9acb-35fa89ecc7ff service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Refreshing instance network info cache due to event network-changed-52df8e8e-e80a-4f0a-b496-63771b5e63a7. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-41335def-048c-480e-ad20-35094de9e627 req-1c4b483c-49ac-42f0-9acb-35fa89ecc7ff service nova] Acquiring lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Updating instance_info_cache with network_info: [{"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Releasing lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Instance network_info: |[{"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-41335def-048c-480e-ad20-35094de9e627 req-1c4b483c-49ac-42f0-9acb-35fa89ecc7ff service nova] Acquired lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.network.neutron [req-41335def-048c-480e-ad20-35094de9e627 req-1c4b483c-49ac-42f0-9acb-35fa89ecc7ff service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Refreshing network info cache for port 52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Start _get_guest_xml network_info=[{"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:30:46 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:30:46 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1984475382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1984475382',id=33,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtoYRtON/k5tbb0b0mgSufh1T0fJ18q1yNdUUxwZ8FGHqcIPsw8eGqRqkMKmw0v8fjb0z41I1/TPnK4YuntSP9PKw0rISU/kk/utjGYcC3dcCXudabG3EjjbwL3JZGM1g==',key_name='tempest-keypair-1201033063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36cda9a88b434e66ad6d8ac75790d141',ramdisk_id='',reservation_id='r-clu35i2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1822750901',owner_user_name='tempest-AttachVolumeShelveTestJSON-1822750901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:30:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a70218d8181040818ed8290e743bd2db',uuid=77c962a7-587a-41be-b87d-ab416b8b43fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converting VIF {"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:34:f9,bridge_name='br-int',has_traffic_filtering=True,id=52df8e8e-e80a-4f0a-b496-63771b5e63a7,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52df8e8e-e8') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'pci_devices' on Instance uuid 77c962a7-587a-41be-b87d-ab416b8b43fd {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:30:46 user nova-compute[75071]:   <uuid>77c962a7-587a-41be-b87d-ab416b8b43fd</uuid>
Dec 05 12:30:46 user nova-compute[75071]:   <name>instance-00000021</name>
Dec 05 12:30:46 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:30:46 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:30:46 user nova-compute[75071]:   <metadata>
Dec 05 12:30:46 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:30:46 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:30:46 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1984475382</nova:name>
Dec 05 12:30:46 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:30:46</nova:creationTime>
Dec 05 12:30:46 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:30:46 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:30:46 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:30:46 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:30:46 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:30:46 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:30:46 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:30:46 user nova-compute[75071]:       <nova:owner>
Dec 05 12:30:46 user nova-compute[75071]:         <nova:user uuid="a70218d8181040818ed8290e743bd2db">tempest-AttachVolumeShelveTestJSON-1822750901-project-member</nova:user>
Dec 05 12:30:46 user nova-compute[75071]:         <nova:project uuid="36cda9a88b434e66ad6d8ac75790d141">tempest-AttachVolumeShelveTestJSON-1822750901</nova:project>
Dec 05 12:30:46 user nova-compute[75071]:       </nova:owner>
Dec 05 12:30:46 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:30:46 user nova-compute[75071]:       <nova:ports>
Dec 05 12:30:46 user nova-compute[75071]:         <nova:port uuid="52df8e8e-e80a-4f0a-b496-63771b5e63a7">
Dec 05 12:30:46 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 12:30:46 user nova-compute[75071]:         </nova:port>
Dec 05 12:30:46 user nova-compute[75071]:       </nova:ports>
Dec 05 12:30:46 user nova-compute[75071]:     </nova:instance>
Dec 05 12:30:46 user nova-compute[75071]:   </metadata>
Dec 05 12:30:46 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:30:46 user nova-compute[75071]:     <system>
Dec 05 12:30:46 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:30:46 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:30:46 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:30:46 user nova-compute[75071]:       <entry name="serial">77c962a7-587a-41be-b87d-ab416b8b43fd</entry>
Dec 05 12:30:46 user nova-compute[75071]:       <entry name="uuid">77c962a7-587a-41be-b87d-ab416b8b43fd</entry>
Dec 05 12:30:46 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:30:46 user nova-compute[75071]:     </system>
Dec 05 12:30:46 user nova-compute[75071]:   </sysinfo>
Dec 05 12:30:46 user nova-compute[75071]:   <os>
Dec 05 12:30:46 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:30:46 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:30:46 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:30:46 user nova-compute[75071]:   </os>
Dec 05 12:30:46 user nova-compute[75071]:   <features>
Dec 05 12:30:46 user nova-compute[75071]:     <acpi/>
Dec 05 12:30:46 user nova-compute[75071]:     <apic/>
Dec 05 12:30:46 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:30:46 user nova-compute[75071]:   </features>
Dec 05 12:30:46 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:30:46 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:30:46 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:30:46 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:30:46 user nova-compute[75071]:   </clock>
Dec 05 12:30:46 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:30:46 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:30:46 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:30:46 user nova-compute[75071]:   </cpu>
Dec 05 12:30:46 user nova-compute[75071]:   <devices>
Dec 05 12:30:46 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:30:46 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:30:46 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk"/>
Dec 05 12:30:46 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:30:46 user nova-compute[75071]:     </disk>
Dec 05 12:30:46 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:30:46 user nova-compute[75071]:       <mac address="fa:16:3e:c6:34:f9"/>
Dec 05 12:30:46 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:30:46 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:30:46 user nova-compute[75071]:       <target dev="tap52df8e8e-e8"/>
Dec 05 12:30:46 user nova-compute[75071]:     </interface>
Dec 05 12:30:46 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:30:46 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/console.log" append="off"/>
Dec 05 12:30:46 user nova-compute[75071]:     </serial>
Dec 05 12:30:46 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:30:46 user nova-compute[75071]:     <video>
Dec 05 12:30:46 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:30:46 user nova-compute[75071]:     </video>
Dec 05 12:30:46 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:30:46 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:30:46 user nova-compute[75071]:     </rng>
Dec 05 12:30:46 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:30:46 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:30:46 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:30:46 user nova-compute[75071]:     </memballoon>
Dec 05 12:30:46 user nova-compute[75071]:   </devices>
Dec 05 12:30:46 user nova-compute[75071]: </domain>
Dec 05 12:30:46 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1984475382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1984475382',id=33,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtoYRtON/k5tbb0b0mgSufh1T0fJ18q1yNdUUxwZ8FGHqcIPsw8eGqRqkMKmw0v8fjb0z41I1/TPnK4YuntSP9PKw0rISU/kk/utjGYcC3dcCXudabG3EjjbwL3JZGM1g==',key_name='tempest-keypair-1201033063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36cda9a88b434e66ad6d8ac75790d141',ramdisk_id='',reservation_id='r-clu35i2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1822750901',owner_user_name='tempest-AttachVolumeShelveTestJSON-1822750901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:30:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a70218d8181040818ed8290e743bd2db',uuid=77c962a7-587a-41be-b87d-ab416b8b43fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converting VIF {"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:34:f9,bridge_name='br-int',has_traffic_filtering=True,id=52df8e8e-e80a-4f0a-b496-63771b5e63a7,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52df8e8e-e8') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG os_vif [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:34:f9,bridge_name='br-int',has_traffic_filtering=True,id=52df8e8e-e80a-4f0a-b496-63771b5e63a7,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52df8e8e-e8') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '980f257b-62ef-53ab-bc94-46e99d55cb79', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:30:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52df8e8e-e8, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap52df8e8e-e8, col_values=(('qos', UUID('f68f0e4d-e105-44c3-b271-70671bcfbb0b')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap52df8e8e-e8, col_values=(('external_ids', {'iface-id': '52df8e8e-e80a-4f0a-b496-63771b5e63a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:34:f9', 'vm-uuid': '77c962a7-587a-41be-b87d-ab416b8b43fd'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:46 user nova-compute[75071]: INFO os_vif [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:34:f9,bridge_name='br-int',has_traffic_filtering=True,id=52df8e8e-e80a-4f0a-b496-63771b5e63a7,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52df8e8e-e8')
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] No VIF found with MAC fa:16:3e:c6:34:f9, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.policy [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3312b55016d34680b6873eedf97e9a8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b958a2138af24f5a860e7a0c99d9ebb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:30:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Creating image(s)
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "/opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "/opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "/opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG nova.network.neutron [req-41335def-048c-480e-ad20-35094de9e627 req-1c4b483c-49ac-42f0-9acb-35fa89ecc7ff service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Updated VIF entry in instance network info cache for port 52df8e8e-e80a-4f0a-b496-63771b5e63a7. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG nova.network.neutron [req-41335def-048c-480e-ad20-35094de9e627 req-1c4b483c-49ac-42f0-9acb-35fa89ecc7ff service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Updating instance_info_cache with network_info: [{"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk 1073741824" returned: 0 in 0.063s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-41335def-048c-480e-ad20-35094de9e627 req-1c4b483c-49ac-42f0-9acb-35fa89ecc7ff service nova] Releasing lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Checking if we can resize image /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Successfully created port: bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Cannot resize image /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Ensure instance console log exists: /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Successfully updated port: bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquired lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-daea21cd-2ee2-4522-8356-6b6f3264be52 req-5b17bb59-47f7-4f26-bf23-0c0615530b8e service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received event network-vif-plugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-daea21cd-2ee2-4522-8356-6b6f3264be52 req-5b17bb59-47f7-4f26-bf23-0c0615530b8e service nova] Acquiring lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-daea21cd-2ee2-4522-8356-6b6f3264be52 req-5b17bb59-47f7-4f26-bf23-0c0615530b8e service nova] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-daea21cd-2ee2-4522-8356-6b6f3264be52 req-5b17bb59-47f7-4f26-bf23-0c0615530b8e service nova] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-daea21cd-2ee2-4522-8356-6b6f3264be52 req-5b17bb59-47f7-4f26-bf23-0c0615530b8e service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] No waiting events found dispatching network-vif-plugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:30:48 user nova-compute[75071]: WARNING nova.compute.manager [req-daea21cd-2ee2-4522-8356-6b6f3264be52 req-5b17bb59-47f7-4f26-bf23-0c0615530b8e service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received unexpected event network-vif-plugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 for instance with vm_state building and task_state spawning.
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-22ac39fa-ed9a-41de-83c3-f4cc05297762 req-bbbbc809-d8a1-47c9-bd56-3a4dfba7fc33 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received event network-changed-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-22ac39fa-ed9a-41de-83c3-f4cc05297762 req-bbbbc809-d8a1-47c9-bd56-3a4dfba7fc33 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Refreshing instance network info cache due to event network-changed-bf98e48b-bb55-447a-88ce-caed2d082b9b. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-22ac39fa-ed9a-41de-83c3-f4cc05297762 req-bbbbc809-d8a1-47c9-bd56-3a4dfba7fc33 service nova] Acquiring lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.network.neutron [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Updating instance_info_cache with network_info: [{"id": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "address": "fa:16:3e:40:8d:36", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf98e48b-bb", "ovs_interfaceid": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Releasing lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Instance network_info: |[{"id": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "address": "fa:16:3e:40:8d:36", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf98e48b-bb", "ovs_interfaceid": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-22ac39fa-ed9a-41de-83c3-f4cc05297762 req-bbbbc809-d8a1-47c9-bd56-3a4dfba7fc33 service nova] Acquired lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.network.neutron [req-22ac39fa-ed9a-41de-83c3-f4cc05297762 req-bbbbc809-d8a1-47c9-bd56-3a4dfba7fc33 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Refreshing network info cache for port bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Start _get_guest_xml network_info=[{"id": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "address": "fa:16:3e:40:8d:36", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf98e48b-bb", "ovs_interfaceid": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:30:48 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:30:48 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:30:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2020941888',display_name='tempest-ServerRescueNegativeTestJSON-server-2020941888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2020941888',id=34,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFth0oBwzOM1o5M+S301WBgFD1bDBox6dwVpPgnPJPuFdVExY6JDCk+kMORijWFHc7di8Z2h3DrLTrM16EW06eFFgSSHFESCZZN6ETdKv+69qC+C5Ro0WG5ROvMgSQkRQ==',key_name='tempest-keypair-955735893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b958a2138af24f5a860e7a0c99d9ebb5',ramdisk_id='',reservation_id='r-jbvwgw0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-170727457',owner_user_name='tempest-ServerRescueNegativeTestJSON-170727457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3312b55016d34680b6873eedf97e9a8f',uuid=015e89c3-73ad-4bfd-b55c-68323fae2b29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "address": "fa:16:3e:40:8d:36", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf98e48b-bb", "ovs_interfaceid": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converting VIF {"id": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "address": "fa:16:3e:40:8d:36", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf98e48b-bb", "ovs_interfaceid": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:8d:36,bridge_name='br-int',has_traffic_filtering=True,id=bf98e48b-bb55-447a-88ce-caed2d082b9b,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf98e48b-bb') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'pci_devices' on Instance uuid 015e89c3-73ad-4bfd-b55c-68323fae2b29 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:30:48 user nova-compute[75071]:   <uuid>015e89c3-73ad-4bfd-b55c-68323fae2b29</uuid>
Dec 05 12:30:48 user nova-compute[75071]:   <name>instance-00000022</name>
Dec 05 12:30:48 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:30:48 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:30:48 user nova-compute[75071]:   <metadata>
Dec 05 12:30:48 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:30:48 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:30:48 user nova-compute[75071]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2020941888</nova:name>
Dec 05 12:30:48 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:30:48</nova:creationTime>
Dec 05 12:30:48 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:30:48 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:30:48 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:30:48 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:30:48 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:30:48 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:30:48 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:30:48 user nova-compute[75071]:       <nova:owner>
Dec 05 12:30:48 user nova-compute[75071]:         <nova:user uuid="3312b55016d34680b6873eedf97e9a8f">tempest-ServerRescueNegativeTestJSON-170727457-project-member</nova:user>
Dec 05 12:30:48 user nova-compute[75071]:         <nova:project uuid="b958a2138af24f5a860e7a0c99d9ebb5">tempest-ServerRescueNegativeTestJSON-170727457</nova:project>
Dec 05 12:30:48 user nova-compute[75071]:       </nova:owner>
Dec 05 12:30:48 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:30:48 user nova-compute[75071]:       <nova:ports>
Dec 05 12:30:48 user nova-compute[75071]:         <nova:port uuid="bf98e48b-bb55-447a-88ce-caed2d082b9b">
Dec 05 12:30:48 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 05 12:30:48 user nova-compute[75071]:         </nova:port>
Dec 05 12:30:48 user nova-compute[75071]:       </nova:ports>
Dec 05 12:30:48 user nova-compute[75071]:     </nova:instance>
Dec 05 12:30:48 user nova-compute[75071]:   </metadata>
Dec 05 12:30:48 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:30:48 user nova-compute[75071]:     <system>
Dec 05 12:30:48 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:30:48 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:30:48 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:30:48 user nova-compute[75071]:       <entry name="serial">015e89c3-73ad-4bfd-b55c-68323fae2b29</entry>
Dec 05 12:30:48 user nova-compute[75071]:       <entry name="uuid">015e89c3-73ad-4bfd-b55c-68323fae2b29</entry>
Dec 05 12:30:48 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:30:48 user nova-compute[75071]:     </system>
Dec 05 12:30:48 user nova-compute[75071]:   </sysinfo>
Dec 05 12:30:48 user nova-compute[75071]:   <os>
Dec 05 12:30:48 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:30:48 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:30:48 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:30:48 user nova-compute[75071]:   </os>
Dec 05 12:30:48 user nova-compute[75071]:   <features>
Dec 05 12:30:48 user nova-compute[75071]:     <acpi/>
Dec 05 12:30:48 user nova-compute[75071]:     <apic/>
Dec 05 12:30:48 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:30:48 user nova-compute[75071]:   </features>
Dec 05 12:30:48 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:30:48 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:30:48 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:30:48 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:30:48 user nova-compute[75071]:   </clock>
Dec 05 12:30:48 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:30:48 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:30:48 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:30:48 user nova-compute[75071]:   </cpu>
Dec 05 12:30:48 user nova-compute[75071]:   <devices>
Dec 05 12:30:48 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:30:48 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:30:48 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk"/>
Dec 05 12:30:48 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:30:48 user nova-compute[75071]:     </disk>
Dec 05 12:30:48 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:30:48 user nova-compute[75071]:       <mac address="fa:16:3e:40:8d:36"/>
Dec 05 12:30:48 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:30:48 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:30:48 user nova-compute[75071]:       <target dev="tapbf98e48b-bb"/>
Dec 05 12:30:48 user nova-compute[75071]:     </interface>
Dec 05 12:30:48 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:30:48 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/console.log" append="off"/>
Dec 05 12:30:48 user nova-compute[75071]:     </serial>
Dec 05 12:30:48 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:30:48 user nova-compute[75071]:     <video>
Dec 05 12:30:48 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:30:48 user nova-compute[75071]:     </video>
Dec 05 12:30:48 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:30:48 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:30:48 user nova-compute[75071]:     </rng>
Dec 05 12:30:48 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:30:48 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:30:48 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:30:48 user nova-compute[75071]:     </memballoon>
Dec 05 12:30:48 user nova-compute[75071]:   </devices>
Dec 05 12:30:48 user nova-compute[75071]: </domain>
Dec 05 12:30:48 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:30:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2020941888',display_name='tempest-ServerRescueNegativeTestJSON-server-2020941888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2020941888',id=34,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFth0oBwzOM1o5M+S301WBgFD1bDBox6dwVpPgnPJPuFdVExY6JDCk+kMORijWFHc7di8Z2h3DrLTrM16EW06eFFgSSHFESCZZN6ETdKv+69qC+C5Ro0WG5ROvMgSQkRQ==',key_name='tempest-keypair-955735893',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b958a2138af24f5a860e7a0c99d9ebb5',ramdisk_id='',reservation_id='r-jbvwgw0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-170727457',owner_user_name='tempest-ServerRescueNegativeTestJSON-170727457-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3312b55016d34680b6873eedf97e9a8f',uuid=015e89c3-73ad-4bfd-b55c-68323fae2b29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "address": "fa:16:3e:40:8d:36", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf98e48b-bb", "ovs_interfaceid": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converting VIF {"id": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "address": "fa:16:3e:40:8d:36", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf98e48b-bb", "ovs_interfaceid": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:8d:36,bridge_name='br-int',has_traffic_filtering=True,id=bf98e48b-bb55-447a-88ce-caed2d082b9b,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf98e48b-bb') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG os_vif [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:8d:36,bridge_name='br-int',has_traffic_filtering=True,id=bf98e48b-bb55-447a-88ce-caed2d082b9b,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf98e48b-bb') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'acb38ea8-dc7b-56b8-a72d-53bac3f45222', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf98e48b-bb, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf98e48b-bb, col_values=(('qos', UUID('aead94b3-d5f2-466a-bf05-263424a5acdc')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf98e48b-bb, col_values=(('external_ids', {'iface-id': 'bf98e48b-bb55-447a-88ce-caed2d082b9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:8d:36', 'vm-uuid': '015e89c3-73ad-4bfd-b55c-68323fae2b29'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:48 user nova-compute[75071]: INFO os_vif [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:8d:36,bridge_name='br-int',has_traffic_filtering=True,id=bf98e48b-bb55-447a-88ce-caed2d082b9b,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf98e48b-bb')
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] No VIF found with MAC fa:16:3e:40:8d:36, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.network.neutron [req-22ac39fa-ed9a-41de-83c3-f4cc05297762 req-bbbbc809-d8a1-47c9-bd56-3a4dfba7fc33 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Updated VIF entry in instance network info cache for port bf98e48b-bb55-447a-88ce-caed2d082b9b. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG nova.network.neutron [req-22ac39fa-ed9a-41de-83c3-f4cc05297762 req-bbbbc809-d8a1-47c9-bd56-3a4dfba7fc33 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Updating instance_info_cache with network_info: [{"id": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "address": "fa:16:3e:40:8d:36", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf98e48b-bb", "ovs_interfaceid": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-22ac39fa-ed9a-41de-83c3-f4cc05297762 req-bbbbc809-d8a1-47c9-bd56-3a4dfba7fc33 service nova] Releasing lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:30:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:30:50 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Instance spawned successfully.
Dec 05 12:30:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-5afdbe65-1ba5-4b6b-a33a-9cb1f38e451f req-d9e12f06-ed3f-45ea-b290-504aad9b0454 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received event network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5afdbe65-1ba5-4b6b-a33a-9cb1f38e451f req-d9e12f06-ed3f-45ea-b290-504aad9b0454 service nova] Acquiring lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5afdbe65-1ba5-4b6b-a33a-9cb1f38e451f req-d9e12f06-ed3f-45ea-b290-504aad9b0454 service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5afdbe65-1ba5-4b6b-a33a-9cb1f38e451f req-d9e12f06-ed3f-45ea-b290-504aad9b0454 service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-5afdbe65-1ba5-4b6b-a33a-9cb1f38e451f req-d9e12f06-ed3f-45ea-b290-504aad9b0454 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] No waiting events found dispatching network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:30:50 user nova-compute[75071]: WARNING nova.compute.manager [req-5afdbe65-1ba5-4b6b-a33a-9cb1f38e451f req-d9e12f06-ed3f-45ea-b290-504aad9b0454 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received unexpected event network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b for instance with vm_state building and task_state spawning.
Dec 05 12:30:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-39c53871-6d59-4338-ad69-666f6c167bf7 req-1d943572-931c-41cb-9588-66b379d404ee service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received event network-vif-plugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-39c53871-6d59-4338-ad69-666f6c167bf7 req-1d943572-931c-41cb-9588-66b379d404ee service nova] Acquiring lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-39c53871-6d59-4338-ad69-666f6c167bf7 req-1d943572-931c-41cb-9588-66b379d404ee service nova] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-39c53871-6d59-4338-ad69-666f6c167bf7 req-1d943572-931c-41cb-9588-66b379d404ee service nova] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-39c53871-6d59-4338-ad69-666f6c167bf7 req-1d943572-931c-41cb-9588-66b379d404ee service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] No waiting events found dispatching network-vif-plugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:30:50 user nova-compute[75071]: WARNING nova.compute.manager [req-39c53871-6d59-4338-ad69-666f6c167bf7 req-1d943572-931c-41cb-9588-66b379d404ee service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received unexpected event network-vif-plugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 for instance with vm_state building and task_state spawning.
Dec 05 12:30:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:50 user nova-compute[75071]: INFO nova.compute.manager [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Took 5.86 seconds to spawn the instance on the hypervisor.
Dec 05 12:30:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:30:50 user nova-compute[75071]: INFO nova.compute.manager [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Took 6.65 seconds to build instance.
Dec 05 12:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e42939d-47f2-47df-b4d7-fcd4d18da197 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.756s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:30:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:30:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Instance spawned successfully.
Dec 05 12:30:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-6357c743-9b44-4613-b139-4fe9f701a097 req-cde84308-f721-4c50-a164-7679b360cc83 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received event network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6357c743-9b44-4613-b139-4fe9f701a097 req-cde84308-f721-4c50-a164-7679b360cc83 service nova] Acquiring lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6357c743-9b44-4613-b139-4fe9f701a097 req-cde84308-f721-4c50-a164-7679b360cc83 service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6357c743-9b44-4613-b139-4fe9f701a097 req-cde84308-f721-4c50-a164-7679b360cc83 service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-6357c743-9b44-4613-b139-4fe9f701a097 req-cde84308-f721-4c50-a164-7679b360cc83 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] No waiting events found dispatching network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:30:52 user nova-compute[75071]: WARNING nova.compute.manager [req-6357c743-9b44-4613-b139-4fe9f701a097 req-cde84308-f721-4c50-a164-7679b360cc83 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received unexpected event network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b for instance with vm_state building and task_state spawning.
Dec 05 12:30:52 user nova-compute[75071]: INFO nova.compute.manager [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Took 5.69 seconds to spawn the instance on the hypervisor.
Dec 05 12:30:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:52 user nova-compute[75071]: INFO nova.compute.manager [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Took 6.71 seconds to build instance.
Dec 05 12:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f9fdedec-f0b0-4f17-b128-cd6e72198999 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.818s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:30:53 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 20883e1b-4595-44c9-9855-3160fb16d148 is timed out.
Dec 05 12:30:53 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Successfully detached device vdb from instance 20883e1b-4595-44c9-9855-3160fb16d148 from the live domain config.
Dec 05 12:30:53 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:30:53 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=7480MB free_disk=24.848796844482422GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tdGLEZSa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:30:53 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02c157a-e5d3-4479-9e8a-6107c06460c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:30:53 user nova-compute[75071]: No targets found.
Dec 05 12:30:53 user nova-compute[75071]: iSNS:
Dec 05 12:30:53 user nova-compute[75071]: No targets found.
Dec 05 12:30:53 user nova-compute[75071]: STATIC:
Dec 05 12:30:53 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c
Dec 05 12:30:53 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:30:53 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:30:53 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:30:53 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:30:53 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:30:53 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929
Dec 05 12:30:53 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:30:53 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:30:53 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0
Dec 05 12:30:53 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:30:53 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:30:53 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546
Dec 05 12:30:53 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:30:53 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:30:53 user nova-compute[75071]: FIRMWARE:
Dec 05 12:30:53 user nova-compute[75071]: No targets found.
Dec 05 12:30:53 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:30:53 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:30:53 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fa7827-4b11-420f-a89d-a7c3489a0372]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0b62bd-1629-4038-ae3c-d1ce5c2bf14a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:30:53 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:30:53 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:30:53 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 (non-flash)
Dec 05 12:30:53 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:30:53 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:30:53 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:30:53 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:30:53 user nova-compute[75071]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 (non-flash)
Dec 05 12:30:53 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:30:53 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82643b4dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6ca505-4db7-4cb0-983d-7cf7e6c07e91]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Applying migration context for instance c2b46f1c-dce6-4436-8e1e-062ffda80732 as it has an incoming, in-progress migration 7fb04b32-6cdf-47c3-9e01-f299ef6c8815. Migration status is finished {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 05 12:30:53 user nova-compute[75071]: INFO nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Updating resource usage from migration 7fb04b32-6cdf-47c3-9e01-f299ef6c8815
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[21248829-1834-485f-8c81-80d8d1db01b4]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e08be776-0fa9-4871-86eb-2093530c00f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance a99a0331-1d77-4b71-9ef7-0794778b3ef1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 20883e1b-4595-44c9-9855-3160fb16d148 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Migration 7fb04b32-6cdf-47c3-9e01-f299ef6c8815 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c2b46f1c-dce6-4436-8e1e-062ffda80732 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 43653273-2337-43a0-981a-e28d1ba26655 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 42776e73-1ef0-4c57-a50a-942f6f4881de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 77c962a7-587a-41be-b87d-ab416b8b43fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 015e89c3-73ad-4bfd-b55c-68323fae2b29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d367fbb5-30c7-4341-b839-f6c9f3316fad]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[27097381-7c32-4f35-8f52-c61ecd610cc1]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[149764ce-12ba-4ecf-a711-8d48da332c17]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6deff552-7ca3-4618-94aa-ce3c569d2193]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929, portal: 172.16.0.220,3260]
Dec 05 12:30:53 user nova-compute[75071]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929, portal: 172.16.0.220,3260] successful.
Dec 05 12:30:53 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:72d0871f-ee1e-4e67-81e2-069ecea74929 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72428b6-dc0b-47e7-b4fc-e785e7b6172c]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] <== disconnect_volume: return (374ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:30:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.694s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:54 user nova-compute[75071]: DEBUG nova.objects.instance [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lazy-loading 'flavor' on Instance uuid 20883e1b-4595-44c9-9855-3160fb16d148 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:30:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7a91d876-5636-4254-874c-4a972e9db9ba tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "20883e1b-4595-44c9-9855-3160fb16d148" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.231s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:30:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:30:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:30:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:30:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:30:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:30:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:30:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:30:55 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:30:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:30:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:30:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:30:55 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:30:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updating instance_info_cache with network_info: [{"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:30:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:30:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:30:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:57 user nova-compute[75071]: INFO nova.compute.manager [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Terminating instance
Dec 05 12:30:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:30:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-f268b62d-47b4-4681-92c9-169f8098066e req-aaa67e08-7bda-4d27-856f-82ac400fc24f service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-unplugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f268b62d-47b4-4681-92c9-169f8098066e req-aaa67e08-7bda-4d27-856f-82ac400fc24f service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f268b62d-47b4-4681-92c9-169f8098066e req-aaa67e08-7bda-4d27-856f-82ac400fc24f service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f268b62d-47b4-4681-92c9-169f8098066e req-aaa67e08-7bda-4d27-856f-82ac400fc24f service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-f268b62d-47b4-4681-92c9-169f8098066e req-aaa67e08-7bda-4d27-856f-82ac400fc24f service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-unplugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-f268b62d-47b4-4681-92c9-169f8098066e req-aaa67e08-7bda-4d27-856f-82ac400fc24f service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-unplugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Instance destroyed successfully.
Dec 05 12:30:58 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lazy-loading 'resources' on Instance uuid c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:22:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-610057875',display_name='tempest-ServerActionsTestOtherB-server-610057875',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-610057875',id=19,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD//5LMlmnSypPzSdRI5jpZ9XqSwL0meBfIrwjAimv5kjQelxMdWSK8Bf7Pi316SOZkmu0iNhVkGJ6EvGf+c87dPNcnj3FJiHI1f2q3NnaFYTTYG6q/U8Y9vdkHGXYuKCg==',key_name='tempest-keypair-186552237',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:28:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee29a575739045dd9db612290cfa9620',ramdisk_id='',reservation_id='r-0dy2tt38',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1001076821',owner_user_name='tempest-ServerActionsTestOtherB-1001076821-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:28:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a213d662f65e41fa8cc3a20e736ca757',uuid=c89c29d3-b60e-4dc5-a895-f9fe84ed69a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Converting VIF {"id": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "address": "fa:16:3e:de:d7:62", "network": {"id": "65bf91f5-9041-4c9e-9923-a3e6e7c06072", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1949724505-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee29a575739045dd9db612290cfa9620", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5077ca66-d7", "ovs_interfaceid": "5077ca66-d74d-4ad0-abee-fe0ea86d67ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG os_vif [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5077ca66-d7, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11acedbd-2b0f-4dbe-a76c-87a7cff61c5c) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:58 user nova-compute[75071]: INFO os_vif [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:d7:62,bridge_name='br-int',has_traffic_filtering=True,id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac,network=Network(65bf91f5-9041-4c9e-9923-a3e6e7c06072),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5077ca66-d7')
Dec 05 12:30:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNozAuVF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:30:58 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:30:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[154d996e-31b2-49bc-8b31-fda4aa547e44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:30:58 user nova-compute[75071]: No targets found.
Dec 05 12:30:58 user nova-compute[75071]: iSNS:
Dec 05 12:30:58 user nova-compute[75071]: No targets found.
Dec 05 12:30:58 user nova-compute[75071]: STATIC:
Dec 05 12:30:58 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c
Dec 05 12:30:58 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:30:58 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:30:58 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:30:58 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:30:58 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:30:58 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0
Dec 05 12:30:58 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:30:58 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:30:58 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546
Dec 05 12:30:58 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:30:58 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:30:58 user nova-compute[75071]: FIRMWARE:
Dec 05 12:30:58 user nova-compute[75071]: No targets found.
Dec 05 12:30:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:30:58 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:30:58 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9654be2e-04c6-48cd-8832-402f300ffcec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[129f3d29-df9e-455f-b38c-664341821d25]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:30:58 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:30:58 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:30:58 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:30:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:30:58 user nova-compute[75071]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 (non-flash)
Dec 05 12:30:58 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:30:58 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:30:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8264796710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546'): ({'sdd'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Removing single pathed devices sdd {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e7a57a-1c8b-458b-9024-74a4b674890b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68307e9-0ec7-48fa-83ae-d348ec457206]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Flushing IO for device /dev/sdd {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b104f7c8-e21d-48c4-a86f-0eb69c425066]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[502afd99-02f7-4b92-aaf1-8fefed8c361a]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.045s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab565a6b-a48b-4c7b-942d-de651018eaf0]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f3bacd-642d-4599-abd7-6b7777496504]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260]
Dec 05 12:30:59 user nova-compute[75071]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546, portal: 172.16.0.220,3260] successful.
Dec 05 12:30:59 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:30:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48cf8d9f-f91d-4855-b810-453ede3eb546 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:30:59 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fff6a5-edbf-4f7c-b0a8-651a67db346b]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:30:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:30:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.427s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:30:59 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] <== disconnect_volume: return (428ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:30:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:30:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Deleting instance files /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7_del
Dec 05 12:30:59 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Deletion of /opt/stack/data/nova/instances/c89c29d3-b60e-4dc5-a895-f9fe84ed69a7_del complete
Dec 05 12:30:59 user nova-compute[75071]: INFO nova.compute.manager [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Took 1.34 seconds to destroy the instance on the hypervisor.
Dec 05 12:30:59 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:30:59 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:30:59 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:30:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:30:59 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:30:59 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Took 0.70 seconds to deallocate network for instance.
Dec 05 12:30:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-4cb0a296-0443-40fb-8d5a-9df7d81d2eb4 req-388dc564-94f7-48ba-9c63-942e4bf4c541 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-deleted-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:30:59 user nova-compute[75071]: INFO nova.compute.manager [req-4cb0a296-0443-40fb-8d5a-9df7d81d2eb4 req-388dc564-94f7-48ba-9c63-942e4bf4c541 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Neutron deleted interface 5077ca66-d74d-4ad0-abee-fe0ea86d67ac; detaching it from the instance and deleting it from the info cache
Dec 05 12:30:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-4cb0a296-0443-40fb-8d5a-9df7d81d2eb4 req-388dc564-94f7-48ba-9c63-942e4bf4c541 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:30:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-4cb0a296-0443-40fb-8d5a-9df7d81d2eb4 req-388dc564-94f7-48ba-9c63-942e4bf4c541 service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Detach interface failed, port_id=5077ca66-d74d-4ad0-abee-fe0ea86d67ac, reason: Instance c89c29d3-b60e-4dc5-a895-f9fe84ed69a7 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:31:00 user nova-compute[75071]: WARNING nova.compute.manager [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received unexpected event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with vm_state active and task_state deleting.
Dec 05 12:31:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:31:00 user nova-compute[75071]: WARNING nova.compute.manager [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received unexpected event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with vm_state active and task_state deleting.
Dec 05 12:31:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:31:00 user nova-compute[75071]: WARNING nova.compute.manager [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received unexpected event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with vm_state active and task_state deleting.
Dec 05 12:31:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-unplugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-unplugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-unplugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] Acquiring lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] No waiting events found dispatching network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:31:00 user nova-compute[75071]: WARNING nova.compute.manager [req-b89cd448-9022-4527-976f-0243ef6b2eff req-8a3ada87-2f6c-4c3b-89dc-586e92d327aa service nova] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Received unexpected event network-vif-plugged-5077ca66-d74d-4ad0-abee-fe0ea86d67ac for instance with vm_state active and task_state deleting.
Dec 05 12:31:00 user nova-compute[75071]: INFO nova.compute.manager [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] [instance: c89c29d3-b60e-4dc5-a895-f9fe84ed69a7] Took 0.79 seconds to detach 1 volumes for instance.
Dec 05 12:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:31:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:31:01 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:31:01 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:31:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:31:01 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Deleted allocations for instance c89c29d3-b60e-4dc5-a895-f9fe84ed69a7
Dec 05 12:31:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1bb458c5-ec31-466c-abe0-2d7373a4299d tempest-ServerActionsTestOtherB-1001076821 tempest-ServerActionsTestOtherB-1001076821-project-member] Lock "c89c29d3-b60e-4dc5-a895-f9fe84ed69a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.425s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:31:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:31:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:31:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:31:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:31:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-a7584e23-7606-45d0-b605-ca30beb8c651 req-224a824e-00ef-4a02-8ca2-bc503021342f service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Received event network-changed-c5c11572-db63-48c5-9899-b3fd621d1819 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-a7584e23-7606-45d0-b605-ca30beb8c651 req-224a824e-00ef-4a02-8ca2-bc503021342f service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Refreshing instance network info cache due to event network-changed-c5c11572-db63-48c5-9899-b3fd621d1819. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a7584e23-7606-45d0-b605-ca30beb8c651 req-224a824e-00ef-4a02-8ca2-bc503021342f service nova] Acquiring lock "refresh_cache-20883e1b-4595-44c9-9855-3160fb16d148" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a7584e23-7606-45d0-b605-ca30beb8c651 req-224a824e-00ef-4a02-8ca2-bc503021342f service nova] Acquired lock "refresh_cache-20883e1b-4595-44c9-9855-3160fb16d148" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG nova.network.neutron [req-a7584e23-7606-45d0-b605-ca30beb8c651 req-224a824e-00ef-4a02-8ca2-bc503021342f service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Refreshing network info cache for port c5c11572-db63-48c5-9899-b3fd621d1819 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "20883e1b-4595-44c9-9855-3160fb16d148" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "20883e1b-4595-44c9-9855-3160fb16d148" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "20883e1b-4595-44c9-9855-3160fb16d148-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "20883e1b-4595-44c9-9855-3160fb16d148-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "20883e1b-4595-44c9-9855-3160fb16d148-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:31:23 user nova-compute[75071]: INFO nova.compute.manager [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Terminating instance
Dec 05 12:31:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-7fa0010f-b9a5-4dbd-bbfd-5da16825ea46 req-0dc42c52-c291-4f2e-a4df-82bdc1177623 service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Received event network-vif-unplugged-c5c11572-db63-48c5-9899-b3fd621d1819 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7fa0010f-b9a5-4dbd-bbfd-5da16825ea46 req-0dc42c52-c291-4f2e-a4df-82bdc1177623 service nova] Acquiring lock "20883e1b-4595-44c9-9855-3160fb16d148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7fa0010f-b9a5-4dbd-bbfd-5da16825ea46 req-0dc42c52-c291-4f2e-a4df-82bdc1177623 service nova] Lock "20883e1b-4595-44c9-9855-3160fb16d148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7fa0010f-b9a5-4dbd-bbfd-5da16825ea46 req-0dc42c52-c291-4f2e-a4df-82bdc1177623 service nova] Lock "20883e1b-4595-44c9-9855-3160fb16d148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-7fa0010f-b9a5-4dbd-bbfd-5da16825ea46 req-0dc42c52-c291-4f2e-a4df-82bdc1177623 service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] No waiting events found dispatching network-vif-unplugged-c5c11572-db63-48c5-9899-b3fd621d1819 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-7fa0010f-b9a5-4dbd-bbfd-5da16825ea46 req-0dc42c52-c291-4f2e-a4df-82bdc1177623 service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Received event network-vif-unplugged-c5c11572-db63-48c5-9899-b3fd621d1819 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG nova.network.neutron [req-a7584e23-7606-45d0-b605-ca30beb8c651 req-224a824e-00ef-4a02-8ca2-bc503021342f service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Updated VIF entry in instance network info cache for port c5c11572-db63-48c5-9899-b3fd621d1819. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG nova.network.neutron [req-a7584e23-7606-45d0-b605-ca30beb8c651 req-224a824e-00ef-4a02-8ca2-bc503021342f service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Updating instance_info_cache with network_info: [{"id": "c5c11572-db63-48c5-9899-b3fd621d1819", "address": "fa:16:3e:18:69:a2", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c11572-db", "ovs_interfaceid": "c5c11572-db63-48c5-9899-b3fd621d1819", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a7584e23-7606-45d0-b605-ca30beb8c651 req-224a824e-00ef-4a02-8ca2-bc503021342f service nova] Releasing lock "refresh_cache-20883e1b-4595-44c9-9855-3160fb16d148" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:24 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Instance destroyed successfully.
Dec 05 12:31:24 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lazy-loading 'resources' on Instance uuid 20883e1b-4595-44c9-9855-3160fb16d148 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:31:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:28:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-934876001',display_name='tempest-TestStampPattern-server-934876001',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-934876001',id=30,image_ref='941fa97d-2297-4ef3-94fe-15656d9f346c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5oir8WHtqBRqryIYkB3I8UlaFk+dqU7IU6/ODmrxiWXhJiAujDIqqNL9Se9MN5Cfk4XMMDLRzpXzZGmiliVEnSL3Carc5WXCaALVz8WrwdnaIjjhGdD2iq63mJ07QOLA==',key_name='tempest-TestStampPattern-141813427',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:28:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b30662558d734f36ac8edbe9532d0d8a',ramdisk_id='',reservation_id='r-eimlbog8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a99a0331-1d77-4b71-9ef7-0794778b3ef1',image_min_disk='1',image_min_ram='0',image_owner_id='b30662558d734f36ac8edbe9532d0d8a',image_owner_project_name='tempest-TestStampPattern-979532490',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-979532490-project-member',image_user_id='809ec3faecd845e0ada2fc55ee6a8f39',owner_project_name='tempest-TestStampPattern-979532490',owner_user_name='tempest-TestStampPattern-979532490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:28:35Z,user_data=None,user_id='809ec3faecd845e0ada2fc55ee6a8f39',uuid=20883e1b-4595-44c9-9855-3160fb16d148,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5c11572-db63-48c5-9899-b3fd621d1819", "address": "fa:16:3e:18:69:a2", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c11572-db", "ovs_interfaceid": "c5c11572-db63-48c5-9899-b3fd621d1819", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:31:24 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Converting VIF {"id": "c5c11572-db63-48c5-9899-b3fd621d1819", "address": "fa:16:3e:18:69:a2", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5c11572-db", "ovs_interfaceid": "c5c11572-db63-48c5-9899-b3fd621d1819", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:31:24 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:69:a2,bridge_name='br-int',has_traffic_filtering=True,id=c5c11572-db63-48c5-9899-b3fd621d1819,network=Network(cbf3c2f9-f756-4283-b6d9-236fb2d2faed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c11572-db') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:31:24 user nova-compute[75071]: DEBUG os_vif [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:69:a2,bridge_name='br-int',has_traffic_filtering=True,id=c5c11572-db63-48c5-9899-b3fd621d1819,network=Network(cbf3c2f9-f756-4283-b6d9-236fb2d2faed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c11572-db') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:31:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5c11572-db, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:31:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ae96426-75d3-43a1-aaed-7a6924c187b6) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:31:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:24 user nova-compute[75071]: INFO os_vif [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:69:a2,bridge_name='br-int',has_traffic_filtering=True,id=c5c11572-db63-48c5-9899-b3fd621d1819,network=Network(cbf3c2f9-f756-4283-b6d9-236fb2d2faed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5c11572-db')
Dec 05 12:31:24 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Deleting instance files /opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148_del
Dec 05 12:31:24 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Deletion of /opt/stack/data/nova/instances/20883e1b-4595-44c9-9855-3160fb16d148_del complete
Dec 05 12:31:24 user nova-compute[75071]: INFO nova.compute.manager [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Took 0.94 seconds to destroy the instance on the hypervisor.
Dec 05 12:31:24 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:31:24 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:31:24 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:31:24 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:31:24 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Took 0.40 seconds to deallocate network for instance.
Dec 05 12:31:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:31:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:31:25 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:31:25 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:31:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:31:25 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Deleted allocations for instance 20883e1b-4595-44c9-9855-3160fb16d148
Dec 05 12:31:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-168a3d3c-a66c-4d39-82b0-c9c4c1f9e93f req-74bced6d-65bd-4a18-812a-9eac26fdb7de service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Received event network-vif-deleted-c5c11572-db63-48c5-9899-b3fd621d1819 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:31:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f492ec16-9d2c-4386-86c8-e1df7e84ecdb tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "20883e1b-4595-44c9-9855-3160fb16d148" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.030s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:31:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-e37da413-8958-43f1-a3e9-35553484aca7 req-2a258c05-4828-43df-b2cc-550f79bedf0f service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Received event network-vif-plugged-c5c11572-db63-48c5-9899-b3fd621d1819 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:31:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e37da413-8958-43f1-a3e9-35553484aca7 req-2a258c05-4828-43df-b2cc-550f79bedf0f service nova] Acquiring lock "20883e1b-4595-44c9-9855-3160fb16d148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:31:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e37da413-8958-43f1-a3e9-35553484aca7 req-2a258c05-4828-43df-b2cc-550f79bedf0f service nova] Lock "20883e1b-4595-44c9-9855-3160fb16d148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:31:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e37da413-8958-43f1-a3e9-35553484aca7 req-2a258c05-4828-43df-b2cc-550f79bedf0f service nova] Lock "20883e1b-4595-44c9-9855-3160fb16d148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:31:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-e37da413-8958-43f1-a3e9-35553484aca7 req-2a258c05-4828-43df-b2cc-550f79bedf0f service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] No waiting events found dispatching network-vif-plugged-c5c11572-db63-48c5-9899-b3fd621d1819 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:31:25 user nova-compute[75071]: WARNING nova.compute.manager [req-e37da413-8958-43f1-a3e9-35553484aca7 req-2a258c05-4828-43df-b2cc-550f79bedf0f service nova] [instance: 20883e1b-4595-44c9-9855-3160fb16d148] Received unexpected event network-vif-plugged-c5c11572-db63-48c5-9899-b3fd621d1819 for instance with vm_state deleted and task_state None.
Dec 05 12:31:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e517f24-d5cd-462a-9c79-56d555db663b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "c2b46f1c-dce6-4436-8e1e-062ffda80732" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:31:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e517f24-d5cd-462a-9c79-56d555db663b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:31:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0e517f24-d5cd-462a-9c79-56d555db663b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Going to confirm migration 2 {{(pid=75071) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Dec 05 12:31:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e517f24-d5cd-462a-9c79-56d555db663b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "refresh_cache-c2b46f1c-dce6-4436-8e1e-062ffda80732" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:31:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e517f24-d5cd-462a-9c79-56d555db663b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquired lock "refresh_cache-c2b46f1c-dce6-4436-8e1e-062ffda80732" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:31:31 user nova-compute[75071]: DEBUG nova.network.neutron [None req-0e517f24-d5cd-462a-9c79-56d555db663b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:31:31 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0e517f24-d5cd-462a-9c79-56d555db663b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lazy-loading 'info_cache' on Instance uuid c2b46f1c-dce6-4436-8e1e-062ffda80732 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:31:31 user nova-compute[75071]: DEBUG nova.network.neutron [None req-0e517f24-d5cd-462a-9c79-56d555db663b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Updating instance_info_cache with network_info: [{"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:31:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e517f24-d5cd-462a-9c79-56d555db663b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Releasing lock "refresh_cache-c2b46f1c-dce6-4436-8e1e-062ffda80732" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:31:31 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0e517f24-d5cd-462a-9c79-56d555db663b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lazy-loading 'migration_context' on Instance uuid c2b46f1c-dce6-4436-8e1e-062ffda80732 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:31:31 user nova-compute[75071]: DEBUG nova.objects.base [None req-0e517f24-d5cd-462a-9c79-56d555db663b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Object Instance<c2b46f1c-dce6-4436-8e1e-062ffda80732> lazy-loaded attributes: info_cache,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:31:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e517f24-d5cd-462a-9c79-56d555db663b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:31:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e517f24-d5cd-462a-9c79-56d555db663b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:31:32 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-0e517f24-d5cd-462a-9c79-56d555db663b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:31:32 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-0e517f24-d5cd-462a-9c79-56d555db663b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e517f24-d5cd-462a-9c79-56d555db663b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.454s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:31:32 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-0e517f24-d5cd-462a-9c79-56d555db663b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Deleted allocation for migration 7fb04b32-6cdf-47c3-9e01-f299ef6c8815
Dec 05 12:31:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0e517f24-d5cd-462a-9c79-56d555db663b tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.788s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:31:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:31:46 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:31:46 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:31:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:31:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:31:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:31:51 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:31:51 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:31:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=7526MB free_disk=24.818870544433594GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:31:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e08be776-0fa9-4871-86eb-2093530c00f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:31:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:31:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:31:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:31:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance a99a0331-1d77-4b71-9ef7-0794778b3ef1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:31:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:31:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c2b46f1c-dce6-4436-8e1e-062ffda80732 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:31:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 43653273-2337-43a0-981a-e28d1ba26655 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:31:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 42776e73-1ef0-4c57-a50a-942f6f4881de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:31:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 77c962a7-587a-41be-b87d-ab416b8b43fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:31:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 015e89c3-73ad-4bfd-b55c-68323fae2b29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:31:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:31:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:31:51 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:31:51 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:31:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:31:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.552s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "43653273-2337-43a0-981a-e28d1ba26655" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "43653273-2337-43a0-981a-e28d1ba26655" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lazy-loading 'flavor' on Instance uuid 43653273-2337-43a0-981a-e28d1ba26655 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "43653273-2337-43a0-981a-e28d1ba26655" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "43653273-2337-43a0-981a-e28d1ba26655" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "43653273-2337-43a0-981a-e28d1ba26655" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:31:52 user nova-compute[75071]: INFO nova.compute.manager [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Attaching volume 6a6ed9b5-cb7f-4ab9-a405-f2532719657d to /dev/vdb
Dec 05 12:31:52 user nova-compute[75071]: DEBUG os_brick.utils [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d270d43c-85df-4f0f-9011-26695b7e76fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecffca6-1c2f-4d57-a21e-600779bf0f9f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d3c386-7995-4268-b24c-43cfb9fcb69b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[104a2870-33ae-42df-9ef5-76c8887dced7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:31:52 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:31:52 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f63ac2-f5bc-4442-9404-ca81200ce734]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG os_brick.utils [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:31:52 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Updating existing volume attachment record: 13730ac5-f86e-4ec3-bc70-315825c14161 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:31:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:31:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:31:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:31:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:31:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:31:53 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:31:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:31:55 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:31:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:31:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:31:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:31:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:31:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:31:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Updating instance_info_cache with network_info: [{"id": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "address": "fa:16:3e:53:ed:01", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd15e936-54", "ovs_interfaceid": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:31:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:31:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:31:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:32:10 user nova-compute[75071]: INFO nova.compute.manager [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Rescuing
Dec 05 12:32:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "refresh_cache-42776e73-1ef0-4c57-a50a-942f6f4881de" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:32:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquired lock "refresh_cache-42776e73-1ef0-4c57-a50a-942f6f4881de" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:32:10 user nova-compute[75071]: DEBUG nova.network.neutron [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG nova.network.neutron [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Updating instance_info_cache with network_info: [{"id": "3774446d-0014-4060-b722-f3480e92a274", "address": "fa:16:3e:c9:ac:48", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3774446d-00", "ovs_interfaceid": "3774446d-0014-4060-b722-f3480e92a274", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iPmAURvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:32:11 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:32:11 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:32:11 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Releasing lock "refresh_cache-42776e73-1ef0-4c57-a50a-942f6f4881de" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7784f166-2258-4a56-9fb1-0cbc94f232f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:32:11 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d6b87f-55f3-44d7-a585-db38f785a62a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d] added
Dec 05 12:32:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1461350b-1f1b-4030-89d3-9f03122529ac]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e6356d-1f6e-4b07-a2bf-31cda10e4d96]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iPmAURvZ {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iPmAURvZ" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f84efd9-33bb-4615-b1b9-94a577c45cb3]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iPmAURvZ'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e69076f-b553-4913-9703-27796f1f9b83]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ada462-8e71-4216-86c1-44d044729e0c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:32:11 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:32:11 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:32:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:32:11 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:32:11 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:32:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a86960-4f45-472d-b215-acfcd64d3845]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d, portal: 172.16.0.220,3260]
Dec 05 12:32:11 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d, portal: 172.16.0.220,3260] successful.
Dec 05 12:32:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[189708b3-40e0-4857-84e9-d882254c2bbd]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba08e43-c32e-461f-b818-6a9d46f85c11]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:32:11 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:32:11 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:32:11 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d (non-flash)
Dec 05 12:32:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:32:11 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:32:11 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:32:11 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d (non-flash)
Dec 05 12:32:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57b0378-3858-46de-aa46-71a782639822]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:32:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iPmAURvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:32:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-8c1f9d60-652b-4c63-a6df-2ce336aa4bbd req-b2f50e31-97fe-479d-a95e-98e38055c634 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received event network-vif-unplugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8c1f9d60-652b-4c63-a6df-2ce336aa4bbd req-b2f50e31-97fe-479d-a95e-98e38055c634 service nova] Acquiring lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8c1f9d60-652b-4c63-a6df-2ce336aa4bbd req-b2f50e31-97fe-479d-a95e-98e38055c634 service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8c1f9d60-652b-4c63-a6df-2ce336aa4bbd req-b2f50e31-97fe-479d-a95e-98e38055c634 service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-8c1f9d60-652b-4c63-a6df-2ce336aa4bbd req-b2f50e31-97fe-479d-a95e-98e38055c634 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] No waiting events found dispatching network-vif-unplugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:32:12 user nova-compute[75071]: WARNING nova.compute.manager [req-8c1f9d60-652b-4c63-a6df-2ce336aa4bbd req-b2f50e31-97fe-479d-a95e-98e38055c634 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received unexpected event network-vif-unplugged-3774446d-0014-4060-b722-f3480e92a274 for instance with vm_state active and task_state rescuing.
Dec 05 12:32:12 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Instance destroyed successfully.
Dec 05 12:32:12 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Attempting a stable device rescue
Dec 05 12:32:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75071) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 05 12:32:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Instance directory exists: not creating {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 05 12:32:12 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Creating image(s)
Dec 05 12:32:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "/opt/stack/data/nova/instances/42776e73-1ef0-4c57-a50a-942f6f4881de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "/opt/stack/data/nova/instances/42776e73-1ef0-4c57-a50a-942f6f4881de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "/opt/stack/data/nova/instances/42776e73-1ef0-4c57-a50a-942f6f4881de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:12 user nova-compute[75071]: DEBUG nova.objects.instance [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'trusted_certs' on Instance uuid 42776e73-1ef0-4c57-a50a-942f6f4881de {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:32:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "1b45fd392320e5c8c9c34d475e76cc19409456d9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "1b45fd392320e5c8c9c34d475e76cc19409456d9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b45fd392320e5c8c9c34d475e76cc19409456d9.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.089s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:32:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] <== connect_volume: return (2093ms) {'type': 'block', 'scsi_wwn': '26234306433323362', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:32:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234306433323362', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:32:13 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lazy-loading 'flavor' on Instance uuid 43653273-2337-43a0-981a-e28d1ba26655 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:32:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:32:13 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:32:13 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:32:13 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:32:13 user nova-compute[75071]:   <serial>6a6ed9b5-cb7f-4ab9-a405-f2532719657d</serial>
Dec 05 12:32:13 user nova-compute[75071]: </disk>
Dec 05 12:32:13 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:32:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b45fd392320e5c8c9c34d475e76cc19409456d9.part --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:13 user nova-compute[75071]: DEBUG nova.virt.images [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] 2f9223bc-d4ef-46e1-af04-027f9c8e2524 was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 12:32:13 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 12:32:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1b45fd392320e5c8c9c34d475e76cc19409456d9.part /opt/stack/data/nova/instances/_base/1b45fd392320e5c8c9c34d475e76cc19409456d9.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] No VIF found with MAC fa:16:3e:44:f4:af, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1b45fd392320e5c8c9c34d475e76cc19409456d9.part /opt/stack/data/nova/instances/_base/1b45fd392320e5c8c9c34d475e76cc19409456d9.converted" returned: 0 in 0.626s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b45fd392320e5c8c9c34d475e76cc19409456d9.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-27aeac4a-f23b-455d-afa7-d0bebd97a9f3 req-7caadae9-8766-430c-8097-56b180c4c598 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received event network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-27aeac4a-f23b-455d-afa7-d0bebd97a9f3 req-7caadae9-8766-430c-8097-56b180c4c598 service nova] Acquiring lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-27aeac4a-f23b-455d-afa7-d0bebd97a9f3 req-7caadae9-8766-430c-8097-56b180c4c598 service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-27aeac4a-f23b-455d-afa7-d0bebd97a9f3 req-7caadae9-8766-430c-8097-56b180c4c598 service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-27aeac4a-f23b-455d-afa7-d0bebd97a9f3 req-7caadae9-8766-430c-8097-56b180c4c598 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] No waiting events found dispatching network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:32:14 user nova-compute[75071]: WARNING nova.compute.manager [req-27aeac4a-f23b-455d-afa7-d0bebd97a9f3 req-7caadae9-8766-430c-8097-56b180c4c598 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received unexpected event network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 for instance with vm_state active and task_state rescuing.
Dec 05 12:32:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b45fd392320e5c8c9c34d475e76cc19409456d9.converted --force-share --output=json" returned: 0 in 0.238s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "1b45fd392320e5c8c9c34d475e76cc19409456d9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.134s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "1b45fd392320e5c8c9c34d475e76cc19409456d9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "1b45fd392320e5c8c9c34d475e76cc19409456d9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b45fd392320e5c8c9c34d475e76cc19409456d9 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0275a84d-526b-4b09-a9e2-f60b565211d6 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "43653273-2337-43a0-981a-e28d1ba26655" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.546s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1b45fd392320e5c8c9c34d475e76cc19409456d9 --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1b45fd392320e5c8c9c34d475e76cc19409456d9,backing_fmt=raw /opt/stack/data/nova/instances/42776e73-1ef0-4c57-a50a-942f6f4881de/disk.rescue {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1b45fd392320e5c8c9c34d475e76cc19409456d9,backing_fmt=raw /opt/stack/data/nova/instances/42776e73-1ef0-4c57-a50a-942f6f4881de/disk.rescue" returned: 0 in 0.056s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "1b45fd392320e5c8c9c34d475e76cc19409456d9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG nova.objects.instance [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'migration_context' on Instance uuid 42776e73-1ef0-4c57-a50a-942f6f4881de {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG nova.objects.base [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Object Instance<42776e73-1ef0-4c57-a50a-942f6f4881de> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Start _get_guest_xml network_info=[{"id": "3774446d-0014-4060-b722-f3480e92a274", "address": "fa:16:3e:c9:ac:48", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "vif_mac": "fa:16:3e:c9:ac:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3774446d-00", "ovs_interfaceid": "3774446d-0014-4060-b722-f3480e92a274", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '2f9223bc-d4ef-46e1-af04-027f9c8e2524', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '06ab0279-f222-4ed9-9b5c-bed55aab4802', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbZmcXIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '42776e73-1ef0-4c57-a50a-942f6f4881de', 'attached_at': '', 'detached_at': '', 'volume_id': '8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c', 'serial': '8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG nova.objects.instance [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'resources' on Instance uuid 42776e73-1ef0-4c57-a50a-942f6f4881de {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG nova.objects.base [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Object Instance<42776e73-1ef0-4c57-a50a-942f6f4881de> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG nova.objects.instance [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'numa_topology' on Instance uuid 42776e73-1ef0-4c57-a50a-942f6f4881de {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG nova.objects.base [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Object Instance<42776e73-1ef0-4c57-a50a-942f6f4881de> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:32:14 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:32:14 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:32:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:32:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.objects.instance [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'vcpu_model' on Instance uuid 42776e73-1ef0-4c57-a50a-942f6f4881de {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.objects.base [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Object Instance<42776e73-1ef0-4c57-a50a-942f6f4881de> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbZmcXIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:32:15 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:32:15 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:32:15 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3735193f-bb84-40e6-8ca7-e0a7aa3b55bd]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = VbZmcXIq\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 05 12:32:15 user nova-compute[75071]: node.name = iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c
Dec 05 12:32:15 user nova-compute[75071]: node.tpgt = -1
Dec 05 12:32:15 user nova-compute[75071]: node.startup = automatic
Dec 05 12:32:15 user nova-compute[75071]: node.leading_login = No
Dec 05 12:32:15 user nova-compute[75071]: iface.iscsi_ifacename = default
Dec 05 12:32:15 user nova-compute[75071]: iface.net_ifacename = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.ipaddress = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.prefix_len = 0
Dec 05 12:32:15 user nova-compute[75071]: iface.hwaddress = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.transport_name = tcp
Dec 05 12:32:15 user nova-compute[75071]: iface.initiatorname = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.state = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.vlan_id = 0
Dec 05 12:32:15 user nova-compute[75071]: iface.vlan_priority = 0
Dec 05 12:32:15 user nova-compute[75071]: iface.vlan_state = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.iface_num = 0
Dec 05 12:32:15 user nova-compute[75071]: iface.mtu = 0
Dec 05 12:32:15 user nova-compute[75071]: iface.port = 0
Dec 05 12:32:15 user nova-compute[75071]: iface.bootproto = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.subnet_mask = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.gateway = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.dhcp_alt_client_id_state = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.dhcp_alt_client_id = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.dhcp_dns = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.dhcp_learn_iqn = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.dhcp_req_vendor_id_state = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.dhcp_vendor_id_state = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.dhcp_vendor_id = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.dhcp_slp_da = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.fragmentation = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.gratuitous_arp = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.incoming_forwarding = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.tos_state = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.tos = 0
Dec 05 12:32:15 user nova-compute[75071]: iface.ttl = 0
Dec 05 12:32:15 user nova-compute[75071]: iface.delayed_ack = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.tcp_nagle = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.tcp_wsf_state = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.tcp_wsf = 0
Dec 05 12:32:15 user nova-compute[75071]: iface.tcp_timer_scale = 0
Dec 05 12:32:15 user nova-compute[75071]: iface.tcp_timestamp = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.redirect = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.def_task_mgmt_timeout = 0
Dec 05 12:32:15 user nova-compute[75071]: iface.header_digest = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.data_digest = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.immediate_data = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.initial_r2t = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.data_seq_inorder = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.data_pdu_inorder = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.erl = 0
Dec 05 12:32:15 user nova-compute[75071]: iface.max_receive_data_len = 0
Dec 05 12:32:15 user nova-compute[75071]: iface.first_burst_len = 0
Dec 05 12:32:15 user nova-compute[75071]: iface.max_outstanding_r2t = 0
Dec 05 12:32:15 user nova-compute[75071]: iface.max_burst_len = 0
Dec 05 12:32:15 user nova-compute[75071]: iface.chap_auth = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.bidi_chap = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.strict_login_compliance = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.discovery_auth = <empty>
Dec 05 12:32:15 user nova-compute[75071]: iface.discovery_logout = <empty>
Dec 05 12:32:15 user nova-compute[75071]: node.discovery_address = <empty>
Dec 05 12:32:15 user nova-compute[75071]: node.discovery_port = 0
Dec 05 12:32:15 user nova-compute[75071]: node.discovery_type = static
Dec 05 12:32:15 user nova-compute[75071]: node.session.initial_cmdsn = 0
Dec 05 12:32:15 user nova-compute[75071]: node.session.initial_login_retry_max = 8
Dec 05 12:32:15 user nova-compute[75071]: node.session.xmit_thread_priority = -20
Dec 05 12:32:15 user nova-compute[75071]: node.session.cmds_max = 128
Dec 05 12:32:15 user nova-compute[75071]: node.session.queue_depth = 32
Dec 05 12:32:15 user nova-compute[75071]: node.session.nr_sessions = 1
Dec 05 12:32:15 user nova-compute[75071]: node.session.auth.authmethod = CHAP
Dec 05 12:32:15 user nova-compute[75071]: node.session.auth.username = VbZmcXIq
Dec 05 12:32:15 user nova-compute[75071]: node.session.auth.password = ***
Dec 05 12:32:15 user nova-compute[75071]: node.session.auth.username_in = <empty>
Dec 05 12:32:15 user nova-compute[75071]: node.session.auth.password_in = <empty>
Dec 05 12:32:15 user nova-compute[75071]: node.session.auth.chap_algs = MD5
Dec 05 12:32:15 user nova-compute[75071]: node.session.timeo.replacement_timeout = 120
Dec 05 12:32:15 user nova-compute[75071]: node.session.err_timeo.abort_timeout = 15
Dec 05 12:32:15 user nova-compute[75071]: node.session.err_timeo.lu_reset_timeout = 30
Dec 05 12:32:15 user nova-compute[75071]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 05 12:32:15 user nova-compute[75071]: node.session.err_timeo.host_reset_timeout = 60
Dec 05 12:32:15 user nova-compute[75071]: node.session.iscsi.FastAbort = Yes
Dec 05 12:32:15 user nova-compute[75071]: node.session.iscsi.InitialR2T = No
Dec 05 12:32:15 user nova-compute[75071]: node.session.iscsi.ImmediateData = Yes
Dec 05 12:32:15 user nova-compute[75071]: node.session.iscsi.FirstBurstLength = 262144
Dec 05 12:32:15 user nova-compute[75071]: node.session.iscsi.MaxBurstLength = 16776192
Dec 05 12:32:15 user nova-compute[75071]: node.session.iscsi.DefaultTime2Retain = 0
Dec 05 12:32:15 user nova-compute[75071]: node.session.iscsi.DefaultTime2Wait = 2
Dec 05 12:32:15 user nova-compute[75071]: node.session.iscsi.MaxConnections = 1
Dec 05 12:32:15 user nova-compute[75071]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 05 12:32:15 user nova-compute[75071]: node.session.iscsi.ERL = 0
Dec 05 12:32:15 user nova-compute[75071]: node.session.scan = manual
Dec 05 12:32:15 user nova-compute[75071]: node.session.reopen_max = 0
Dec 05 12:32:15 user nova-compute[75071]: node.conn[0].address = 172.16.0.220
Dec 05 12:32:15 user nova-compute[75071]: node.conn[0].port = 3260
Dec 05 12:32:15 user nova-compute[75071]: node.conn[0].startup = manual
Dec 05 12:32:15 user nova-compute[75071]: node.conn[0].tcp.window_size = 524288
Dec 05 12:32:15 user nova-compute[75071]: node.conn[0].tcp.type_of_service = 0
Dec 05 12:32:15 user nova-compute[75071]: node.conn[0].timeo.logout_timeout = 15
Dec 05 12:32:15 user nova-compute[75071]: node.conn[0].timeo.login_timeout = 15
Dec 05 12:32:15 user nova-compute[75071]: node.conn[0].timeo.auth_timeout = 45
Dec 05 12:32:15 user nova-compute[75071]: node.conn[0].timeo.noop_out_interval = 5
Dec 05 12:32:15 user nova-compute[75071]: node.conn[0].timeo.noop_out_timeout = 5
Dec 05 12:32:15 user nova-compute[75071]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 05 12:32:15 user nova-compute[75071]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 05 12:32:15 user nova-compute[75071]: node.conn[0].iscsi.HeaderDigest = None
Dec 05 12:32:15 user nova-compute[75071]: node.conn[0].iscsi.DataDigest = None
Dec 05 12:32:15 user nova-compute[75071]: node.conn[0].iscsi.IFMarker = No
Dec 05 12:32:15 user nova-compute[75071]: node.conn[0].iscsi.OFMarker = No
Dec 05 12:32:15 user nova-compute[75071]: # END RECORD
Dec 05 12:32:15 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c2e261-dbc9-447a-98df-5871af95387a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e1084c-e1e2-4aa3-9e44-855e922092a3]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VbZmcXIq {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VbZmcXIq" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05a1791-6e1b-44ab-b322-ae141acad694]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VbZmcXIq'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa3d606-b45e-4bfc-9269-562aadc39bc5]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6eb216-c897-4b62-89d8-8565d146b2d9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:32:15 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:32:15 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:32:15 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d (non-flash)
Dec 05 12:32:15 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:32:15 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:32:15 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:32:15 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d (non-flash)
Dec 05 12:32:15 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.132s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] HCTL ('37', '0', '0', 0) found on session 36 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14349fb-ba82-4d96-8d93-22a152a9578f]: (4, ('0 0 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Searching for a device in session 36 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbZmcXIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.154s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] <== connect_volume: return (155ms) {'type': 'block', 'scsi_wwn': '23830623662373337', 'path': '/dev/sdf'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830623662373337', 'path': '/dev/sdf'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:30:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-53509066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-53509066',id=32,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:30:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b77a4b1baadd43e1be69eecb1f5370bd',ramdisk_id='',reservation_id='r-jps7gm02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86909184',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:30:42Z,user_data=None,user_id='201cbbb8b3dc4a3aa8164d69c1257489',uuid=42776e73-1ef0-4c57-a50a-942f6f4881de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3774446d-0014-4060-b722-f3480e92a274", "address": "fa:16:3e:c9:ac:48", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "vif_mac": "fa:16:3e:c9:ac:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3774446d-00", "ovs_interfaceid": "3774446d-0014-4060-b722-f3480e92a274", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converting VIF {"id": "3774446d-0014-4060-b722-f3480e92a274", "address": "fa:16:3e:c9:ac:48", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "vif_mac": "fa:16:3e:c9:ac:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3774446d-00", "ovs_interfaceid": "3774446d-0014-4060-b722-f3480e92a274", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:ac:48,bridge_name='br-int',has_traffic_filtering=True,id=3774446d-0014-4060-b722-f3480e92a274,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3774446d-00') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.objects.instance [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'pci_devices' on Instance uuid 42776e73-1ef0-4c57-a50a-942f6f4881de {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.objects.base [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Object Instance<42776e73-1ef0-4c57-a50a-942f6f4881de> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:32:15 user nova-compute[75071]:   <uuid>42776e73-1ef0-4c57-a50a-942f6f4881de</uuid>
Dec 05 12:32:15 user nova-compute[75071]:   <name>instance-00000020</name>
Dec 05 12:32:15 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:32:15 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:32:15 user nova-compute[75071]:   <metadata>
Dec 05 12:32:15 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:32:15 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:32:15 user nova-compute[75071]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-53509066</nova:name>
Dec 05 12:32:15 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:32:14</nova:creationTime>
Dec 05 12:32:15 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:32:15 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:32:15 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:32:15 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:32:15 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:32:15 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:32:15 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:32:15 user nova-compute[75071]:       <nova:owner>
Dec 05 12:32:15 user nova-compute[75071]:         <nova:user uuid="201cbbb8b3dc4a3aa8164d69c1257489">tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member</nova:user>
Dec 05 12:32:15 user nova-compute[75071]:         <nova:project uuid="b77a4b1baadd43e1be69eecb1f5370bd">tempest-ServerBootFromVolumeStableRescueTest-86909184</nova:project>
Dec 05 12:32:15 user nova-compute[75071]:       </nova:owner>
Dec 05 12:32:15 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:32:15 user nova-compute[75071]:       <nova:ports>
Dec 05 12:32:15 user nova-compute[75071]:         <nova:port uuid="3774446d-0014-4060-b722-f3480e92a274">
Dec 05 12:32:15 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 12:32:15 user nova-compute[75071]:         </nova:port>
Dec 05 12:32:15 user nova-compute[75071]:       </nova:ports>
Dec 05 12:32:15 user nova-compute[75071]:     </nova:instance>
Dec 05 12:32:15 user nova-compute[75071]:   </metadata>
Dec 05 12:32:15 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:32:15 user nova-compute[75071]:     <system>
Dec 05 12:32:15 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:32:15 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:32:15 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:32:15 user nova-compute[75071]:       <entry name="serial">42776e73-1ef0-4c57-a50a-942f6f4881de</entry>
Dec 05 12:32:15 user nova-compute[75071]:       <entry name="uuid">42776e73-1ef0-4c57-a50a-942f6f4881de</entry>
Dec 05 12:32:15 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:32:15 user nova-compute[75071]:     </system>
Dec 05 12:32:15 user nova-compute[75071]:   </sysinfo>
Dec 05 12:32:15 user nova-compute[75071]:   <os>
Dec 05 12:32:15 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:32:15 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:32:15 user nova-compute[75071]:   </os>
Dec 05 12:32:15 user nova-compute[75071]:   <features>
Dec 05 12:32:15 user nova-compute[75071]:     <acpi/>
Dec 05 12:32:15 user nova-compute[75071]:     <apic/>
Dec 05 12:32:15 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:32:15 user nova-compute[75071]:   </features>
Dec 05 12:32:15 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:32:15 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:32:15 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:32:15 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:32:15 user nova-compute[75071]:   </clock>
Dec 05 12:32:15 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:32:15 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:32:15 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:32:15 user nova-compute[75071]:   </cpu>
Dec 05 12:32:15 user nova-compute[75071]:   <devices>
Dec 05 12:32:15 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:32:15 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:32:15 user nova-compute[75071]:       <source dev="/dev/sdf"/>
Dec 05 12:32:15 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:32:15 user nova-compute[75071]:       <serial>8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c</serial>
Dec 05 12:32:15 user nova-compute[75071]:     </disk>
Dec 05 12:32:15 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:32:15 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:32:15 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/42776e73-1ef0-4c57-a50a-942f6f4881de/disk.rescue"/>
Dec 05 12:32:15 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Dec 05 12:32:15 user nova-compute[75071]:       <boot order="1"/>
Dec 05 12:32:15 user nova-compute[75071]:     </disk>
Dec 05 12:32:15 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:32:15 user nova-compute[75071]:       <mac address="fa:16:3e:c9:ac:48"/>
Dec 05 12:32:15 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:32:15 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:32:15 user nova-compute[75071]:       <target dev="tap3774446d-00"/>
Dec 05 12:32:15 user nova-compute[75071]:     </interface>
Dec 05 12:32:15 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:32:15 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/42776e73-1ef0-4c57-a50a-942f6f4881de/console.log" append="off"/>
Dec 05 12:32:15 user nova-compute[75071]:     </serial>
Dec 05 12:32:15 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:32:15 user nova-compute[75071]:     <video>
Dec 05 12:32:15 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:32:15 user nova-compute[75071]:     </video>
Dec 05 12:32:15 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:32:15 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:32:15 user nova-compute[75071]:     </rng>
Dec 05 12:32:15 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:32:15 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:32:15 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:32:15 user nova-compute[75071]:     </memballoon>
Dec 05 12:32:15 user nova-compute[75071]:   </devices>
Dec 05 12:32:15 user nova-compute[75071]: </domain>
Dec 05 12:32:15 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:32:15 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Instance destroyed successfully.
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:32:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] No VIF found with MAC fa:16:3e:c9:ac:48, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:32:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-b5d0f62b-13f4-4c97-bc60-7a5b42893887 req-e2649c86-33d2-40de-8fb2-51b690129305 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received event network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b5d0f62b-13f4-4c97-bc60-7a5b42893887 req-e2649c86-33d2-40de-8fb2-51b690129305 service nova] Acquiring lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b5d0f62b-13f4-4c97-bc60-7a5b42893887 req-e2649c86-33d2-40de-8fb2-51b690129305 service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b5d0f62b-13f4-4c97-bc60-7a5b42893887 req-e2649c86-33d2-40de-8fb2-51b690129305 service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-b5d0f62b-13f4-4c97-bc60-7a5b42893887 req-e2649c86-33d2-40de-8fb2-51b690129305 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] No waiting events found dispatching network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:32:17 user nova-compute[75071]: WARNING nova.compute.manager [req-b5d0f62b-13f4-4c97-bc60-7a5b42893887 req-e2649c86-33d2-40de-8fb2-51b690129305 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received unexpected event network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 for instance with vm_state active and task_state rescuing.
Dec 05 12:32:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-ce8b0d9f-4c4b-4a1d-b157-0ee10059a019 req-db648d6e-e7f3-496c-b4d2-139abe960c70 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received event network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ce8b0d9f-4c4b-4a1d-b157-0ee10059a019 req-db648d6e-e7f3-496c-b4d2-139abe960c70 service nova] Acquiring lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ce8b0d9f-4c4b-4a1d-b157-0ee10059a019 req-db648d6e-e7f3-496c-b4d2-139abe960c70 service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ce8b0d9f-4c4b-4a1d-b157-0ee10059a019 req-db648d6e-e7f3-496c-b4d2-139abe960c70 service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-ce8b0d9f-4c4b-4a1d-b157-0ee10059a019 req-db648d6e-e7f3-496c-b4d2-139abe960c70 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] No waiting events found dispatching network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:32:19 user nova-compute[75071]: WARNING nova.compute.manager [req-ce8b0d9f-4c4b-4a1d-b157-0ee10059a019 req-db648d6e-e7f3-496c-b4d2-139abe960c70 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received unexpected event network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 for instance with vm_state active and task_state rescuing.
Dec 05 12:32:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-ce8b0d9f-4c4b-4a1d-b157-0ee10059a019 req-db648d6e-e7f3-496c-b4d2-139abe960c70 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received event network-changed-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-ce8b0d9f-4c4b-4a1d-b157-0ee10059a019 req-db648d6e-e7f3-496c-b4d2-139abe960c70 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Refreshing instance network info cache due to event network-changed-b2236786-98e2-461a-ba60-9ded45e0c725. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:32:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ce8b0d9f-4c4b-4a1d-b157-0ee10059a019 req-db648d6e-e7f3-496c-b4d2-139abe960c70 service nova] Acquiring lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:32:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ce8b0d9f-4c4b-4a1d-b157-0ee10059a019 req-db648d6e-e7f3-496c-b4d2-139abe960c70 service nova] Acquired lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:32:19 user nova-compute[75071]: DEBUG nova.network.neutron [req-ce8b0d9f-4c4b-4a1d-b157-0ee10059a019 req-db648d6e-e7f3-496c-b4d2-139abe960c70 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Refreshing network info cache for port b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:32:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-45498aeb-7e35-44e1-8996-7ef4966e5e1e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:32:19 user nova-compute[75071]: DEBUG nova.network.neutron [req-ce8b0d9f-4c4b-4a1d-b157-0ee10059a019 req-db648d6e-e7f3-496c-b4d2-139abe960c70 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Updated VIF entry in instance network info cache for port b2236786-98e2-461a-ba60-9ded45e0c725. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:32:19 user nova-compute[75071]: DEBUG nova.network.neutron [req-ce8b0d9f-4c4b-4a1d-b157-0ee10059a019 req-db648d6e-e7f3-496c-b4d2-139abe960c70 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Updating instance_info_cache with network_info: [{"id": "b2236786-98e2-461a-ba60-9ded45e0c725", "address": "fa:16:3e:44:f4:af", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2236786-98", "ovs_interfaceid": "b2236786-98e2-461a-ba60-9ded45e0c725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:32:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ce8b0d9f-4c4b-4a1d-b157-0ee10059a019 req-db648d6e-e7f3-496c-b4d2-139abe960c70 service nova] Releasing lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:32:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-9dbf5c12-e845-4d7b-ba24-2ff437b5d536 req-d6eec128-aa9b-4387-a0f6-dd9eb8b77452 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received event network-changed-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-9dbf5c12-e845-4d7b-ba24-2ff437b5d536 req-d6eec128-aa9b-4387-a0f6-dd9eb8b77452 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Refreshing instance network info cache due to event network-changed-b2236786-98e2-461a-ba60-9ded45e0c725. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:32:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9dbf5c12-e845-4d7b-ba24-2ff437b5d536 req-d6eec128-aa9b-4387-a0f6-dd9eb8b77452 service nova] Acquiring lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:32:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9dbf5c12-e845-4d7b-ba24-2ff437b5d536 req-d6eec128-aa9b-4387-a0f6-dd9eb8b77452 service nova] Acquired lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:32:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-9dbf5c12-e845-4d7b-ba24-2ff437b5d536 req-d6eec128-aa9b-4387-a0f6-dd9eb8b77452 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Refreshing network info cache for port b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:32:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-9dbf5c12-e845-4d7b-ba24-2ff437b5d536 req-d6eec128-aa9b-4387-a0f6-dd9eb8b77452 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Updated VIF entry in instance network info cache for port b2236786-98e2-461a-ba60-9ded45e0c725. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:32:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-9dbf5c12-e845-4d7b-ba24-2ff437b5d536 req-d6eec128-aa9b-4387-a0f6-dd9eb8b77452 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Updating instance_info_cache with network_info: [{"id": "b2236786-98e2-461a-ba60-9ded45e0c725", "address": "fa:16:3e:44:f4:af", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2236786-98", "ovs_interfaceid": "b2236786-98e2-461a-ba60-9ded45e0c725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:32:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9dbf5c12-e845-4d7b-ba24-2ff437b5d536 req-d6eec128-aa9b-4387-a0f6-dd9eb8b77452 service nova] Releasing lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:32:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a12d5808-355c-4222-ae48-cc692260d927 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "43653273-2337-43a0-981a-e28d1ba26655" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a12d5808-355c-4222-ae48-cc692260d927 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "43653273-2337-43a0-981a-e28d1ba26655" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:22 user nova-compute[75071]: INFO nova.compute.manager [None req-a12d5808-355c-4222-ae48-cc692260d927 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Rebooting instance
Dec 05 12:32:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a12d5808-355c-4222-ae48-cc692260d927 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:32:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a12d5808-355c-4222-ae48-cc692260d927 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquired lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:32:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a12d5808-355c-4222-ae48-cc692260d927 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:32:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a12d5808-355c-4222-ae48-cc692260d927 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Updating instance_info_cache with network_info: [{"id": "b2236786-98e2-461a-ba60-9ded45e0c725", "address": "fa:16:3e:44:f4:af", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2236786-98", "ovs_interfaceid": "b2236786-98e2-461a-ba60-9ded45e0c725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:32:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a12d5808-355c-4222-ae48-cc692260d927 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Releasing lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:32:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a12d5808-355c-4222-ae48-cc692260d927 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:32:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-ea9564ed-2b14-4a2b-ab89-a69ab60ef718 req-59227043-cbbf-4bc5-b37f-2adb9776bd0d service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received event network-vif-unplugged-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ea9564ed-2b14-4a2b-ab89-a69ab60ef718 req-59227043-cbbf-4bc5-b37f-2adb9776bd0d service nova] Acquiring lock "43653273-2337-43a0-981a-e28d1ba26655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ea9564ed-2b14-4a2b-ab89-a69ab60ef718 req-59227043-cbbf-4bc5-b37f-2adb9776bd0d service nova] Lock "43653273-2337-43a0-981a-e28d1ba26655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ea9564ed-2b14-4a2b-ab89-a69ab60ef718 req-59227043-cbbf-4bc5-b37f-2adb9776bd0d service nova] Lock "43653273-2337-43a0-981a-e28d1ba26655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-ea9564ed-2b14-4a2b-ab89-a69ab60ef718 req-59227043-cbbf-4bc5-b37f-2adb9776bd0d service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] No waiting events found dispatching network-vif-unplugged-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:32:25 user nova-compute[75071]: WARNING nova.compute.manager [req-ea9564ed-2b14-4a2b-ab89-a69ab60ef718 req-59227043-cbbf-4bc5-b37f-2adb9776bd0d service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received unexpected event network-vif-unplugged-b2236786-98e2-461a-ba60-9ded45e0c725 for instance with vm_state active and task_state reboot_started.
Dec 05 12:32:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:25 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a12d5808-355c-4222-ae48-cc692260d927 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Instance shutdown successfully.
Dec 05 12:32:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:26 user nova-compute[75071]: INFO nova.compute.manager [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Terminating instance
Dec 05 12:32:26 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:32:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-867e5833-fb26-4257-a0b3-4095f3ea06d6 req-45a1ad9a-57f2-4c2f-867a-819a2b1596b6 service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Received event network-changed-5c0e15bb-4937-4f6a-8642-65fec78c2156 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-867e5833-fb26-4257-a0b3-4095f3ea06d6 req-45a1ad9a-57f2-4c2f-867a-819a2b1596b6 service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Refreshing instance network info cache due to event network-changed-5c0e15bb-4937-4f6a-8642-65fec78c2156. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:32:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-867e5833-fb26-4257-a0b3-4095f3ea06d6 req-45a1ad9a-57f2-4c2f-867a-819a2b1596b6 service nova] Acquiring lock "refresh_cache-a99a0331-1d77-4b71-9ef7-0794778b3ef1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:32:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-867e5833-fb26-4257-a0b3-4095f3ea06d6 req-45a1ad9a-57f2-4c2f-867a-819a2b1596b6 service nova] Acquired lock "refresh_cache-a99a0331-1d77-4b71-9ef7-0794778b3ef1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:32:26 user nova-compute[75071]: DEBUG nova.network.neutron [req-867e5833-fb26-4257-a0b3-4095f3ea06d6 req-45a1ad9a-57f2-4c2f-867a-819a2b1596b6 service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Refreshing network info cache for port 5c0e15bb-4937-4f6a-8642-65fec78c2156 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:32:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-27fa38d9-7a33-4938-b83e-6699746d0ffa req-8197dae0-4407-4c3f-b0b9-866cce2cd6ca service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Received event network-vif-unplugged-5c0e15bb-4937-4f6a-8642-65fec78c2156 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-27fa38d9-7a33-4938-b83e-6699746d0ffa req-8197dae0-4407-4c3f-b0b9-866cce2cd6ca service nova] Acquiring lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-27fa38d9-7a33-4938-b83e-6699746d0ffa req-8197dae0-4407-4c3f-b0b9-866cce2cd6ca service nova] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-27fa38d9-7a33-4938-b83e-6699746d0ffa req-8197dae0-4407-4c3f-b0b9-866cce2cd6ca service nova] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-27fa38d9-7a33-4938-b83e-6699746d0ffa req-8197dae0-4407-4c3f-b0b9-866cce2cd6ca service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] No waiting events found dispatching network-vif-unplugged-5c0e15bb-4937-4f6a-8642-65fec78c2156 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:32:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-27fa38d9-7a33-4938-b83e-6699746d0ffa req-8197dae0-4407-4c3f-b0b9-866cce2cd6ca service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Received event network-vif-unplugged-5c0e15bb-4937-4f6a-8642-65fec78c2156 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:32:27 user nova-compute[75071]: DEBUG nova.network.neutron [req-867e5833-fb26-4257-a0b3-4095f3ea06d6 req-45a1ad9a-57f2-4c2f-867a-819a2b1596b6 service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Updated VIF entry in instance network info cache for port 5c0e15bb-4937-4f6a-8642-65fec78c2156. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:32:27 user nova-compute[75071]: DEBUG nova.network.neutron [req-867e5833-fb26-4257-a0b3-4095f3ea06d6 req-45a1ad9a-57f2-4c2f-867a-819a2b1596b6 service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Updating instance_info_cache with network_info: [{"id": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "address": "fa:16:3e:8e:c8:78", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0e15bb-49", "ovs_interfaceid": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:32:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-6e6d2815-d607-4185-b9c5-cd1223d22a08 req-2f66a2d7-39c7-44ca-a8a7-01ab55f76fca service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received event network-vif-plugged-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6e6d2815-d607-4185-b9c5-cd1223d22a08 req-2f66a2d7-39c7-44ca-a8a7-01ab55f76fca service nova] Acquiring lock "43653273-2337-43a0-981a-e28d1ba26655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6e6d2815-d607-4185-b9c5-cd1223d22a08 req-2f66a2d7-39c7-44ca-a8a7-01ab55f76fca service nova] Lock "43653273-2337-43a0-981a-e28d1ba26655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6e6d2815-d607-4185-b9c5-cd1223d22a08 req-2f66a2d7-39c7-44ca-a8a7-01ab55f76fca service nova] Lock "43653273-2337-43a0-981a-e28d1ba26655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-6e6d2815-d607-4185-b9c5-cd1223d22a08 req-2f66a2d7-39c7-44ca-a8a7-01ab55f76fca service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] No waiting events found dispatching network-vif-plugged-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:32:27 user nova-compute[75071]: WARNING nova.compute.manager [req-6e6d2815-d607-4185-b9c5-cd1223d22a08 req-2f66a2d7-39c7-44ca-a8a7-01ab55f76fca service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received unexpected event network-vif-plugged-b2236786-98e2-461a-ba60-9ded45e0c725 for instance with vm_state active and task_state reboot_started.
Dec 05 12:32:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-867e5833-fb26-4257-a0b3-4095f3ea06d6 req-45a1ad9a-57f2-4c2f-867a-819a2b1596b6 service nova] Releasing lock "refresh_cache-a99a0331-1d77-4b71-9ef7-0794778b3ef1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:32:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:27 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Instance destroyed successfully.
Dec 05 12:32:27 user nova-compute[75071]: DEBUG nova.objects.instance [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lazy-loading 'resources' on Instance uuid a99a0331-1d77-4b71-9ef7-0794778b3ef1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:25:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-643004812',display_name='tempest-TestStampPattern-server-643004812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-643004812',id=25,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5oir8WHtqBRqryIYkB3I8UlaFk+dqU7IU6/ODmrxiWXhJiAujDIqqNL9Se9MN5Cfk4XMMDLRzpXzZGmiliVEnSL3Carc5WXCaALVz8WrwdnaIjjhGdD2iq63mJ07QOLA==',key_name='tempest-TestStampPattern-141813427',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:25:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b30662558d734f36ac8edbe9532d0d8a',ramdisk_id='',reservation_id='r-tl3l904b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-979532490',owner_user_name='tempest-TestStampPattern-979532490-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:28:24Z,user_data=None,user_id='809ec3faecd845e0ada2fc55ee6a8f39',uuid=a99a0331-1d77-4b71-9ef7-0794778b3ef1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "address": "fa:16:3e:8e:c8:78", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0e15bb-49", "ovs_interfaceid": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Converting VIF {"id": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "address": "fa:16:3e:8e:c8:78", "network": {"id": "cbf3c2f9-f756-4283-b6d9-236fb2d2faed", "bridge": "br-int", "label": "tempest-TestStampPattern-2081090888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b30662558d734f36ac8edbe9532d0d8a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c0e15bb-49", "ovs_interfaceid": "5c0e15bb-4937-4f6a-8642-65fec78c2156", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:c8:78,bridge_name='br-int',has_traffic_filtering=True,id=5c0e15bb-4937-4f6a-8642-65fec78c2156,network=Network(cbf3c2f9-f756-4283-b6d9-236fb2d2faed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c0e15bb-49') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG os_vif [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:c8:78,bridge_name='br-int',has_traffic_filtering=True,id=5c0e15bb-4937-4f6a-8642-65fec78c2156,network=Network(cbf3c2f9-f756-4283-b6d9-236fb2d2faed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c0e15bb-49') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c0e15bb-49, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d27837f-1e2c-41c0-aa8a-698d135edad0) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:28 user nova-compute[75071]: INFO os_vif [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:c8:78,bridge_name='br-int',has_traffic_filtering=True,id=5c0e15bb-4937-4f6a-8642-65fec78c2156,network=Network(cbf3c2f9-f756-4283-b6d9-236fb2d2faed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c0e15bb-49')
Dec 05 12:32:28 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Deleting instance files /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1_del
Dec 05 12:32:28 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Deletion of /opt/stack/data/nova/instances/a99a0331-1d77-4b71-9ef7-0794778b3ef1_del complete
Dec 05 12:32:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:28 user nova-compute[75071]: INFO nova.compute.manager [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Took 1.53 seconds to destroy the instance on the hypervisor.
Dec 05 12:32:28 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:32:28 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Took 0.59 seconds to deallocate network for instance.
Dec 05 12:32:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-30614d95-7eee-4268-8180-ce883a9b9780 req-5b94ccd3-1b16-44fb-9255-95426710156e service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Received event network-vif-deleted-5c0e15bb-4937-4f6a-8642-65fec78c2156 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-58788c33-35d8-42c2-94e9-da43a86c59f9 req-4967318d-5261-4b64-a168-f49eddeca0ce service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Received event network-vif-plugged-5c0e15bb-4937-4f6a-8642-65fec78c2156 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-58788c33-35d8-42c2-94e9-da43a86c59f9 req-4967318d-5261-4b64-a168-f49eddeca0ce service nova] Acquiring lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-58788c33-35d8-42c2-94e9-da43a86c59f9 req-4967318d-5261-4b64-a168-f49eddeca0ce service nova] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-58788c33-35d8-42c2-94e9-da43a86c59f9 req-4967318d-5261-4b64-a168-f49eddeca0ce service nova] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-58788c33-35d8-42c2-94e9-da43a86c59f9 req-4967318d-5261-4b64-a168-f49eddeca0ce service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] No waiting events found dispatching network-vif-plugged-5c0e15bb-4937-4f6a-8642-65fec78c2156 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:32:29 user nova-compute[75071]: WARNING nova.compute.manager [req-58788c33-35d8-42c2-94e9-da43a86c59f9 req-4967318d-5261-4b64-a168-f49eddeca0ce service nova] [instance: a99a0331-1d77-4b71-9ef7-0794778b3ef1] Received unexpected event network-vif-plugged-5c0e15bb-4937-4f6a-8642-65fec78c2156 for instance with vm_state deleted and task_state None.
Dec 05 12:32:29 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:32:29 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:32:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:29 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Deleted allocations for instance a99a0331-1d77-4b71-9ef7-0794778b3ef1
Dec 05 12:32:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8ddd300f-9c23-4d41-b647-ca2ef1851f14 tempest-TestStampPattern-979532490 tempest-TestStampPattern-979532490-project-member] Lock "a99a0331-1d77-4b71-9ef7-0794778b3ef1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.759s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-8f227866-a2e0-433f-9e1b-3ec4a3da7c8b req-8caa3ed7-baf8-4dd1-9fa3-884a9e35b012 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received event network-vif-plugged-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8f227866-a2e0-433f-9e1b-3ec4a3da7c8b req-8caa3ed7-baf8-4dd1-9fa3-884a9e35b012 service nova] Acquiring lock "43653273-2337-43a0-981a-e28d1ba26655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8f227866-a2e0-433f-9e1b-3ec4a3da7c8b req-8caa3ed7-baf8-4dd1-9fa3-884a9e35b012 service nova] Lock "43653273-2337-43a0-981a-e28d1ba26655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8f227866-a2e0-433f-9e1b-3ec4a3da7c8b req-8caa3ed7-baf8-4dd1-9fa3-884a9e35b012 service nova] Lock "43653273-2337-43a0-981a-e28d1ba26655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-8f227866-a2e0-433f-9e1b-3ec4a3da7c8b req-8caa3ed7-baf8-4dd1-9fa3-884a9e35b012 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] No waiting events found dispatching network-vif-plugged-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:32:29 user nova-compute[75071]: WARNING nova.compute.manager [req-8f227866-a2e0-433f-9e1b-3ec4a3da7c8b req-8caa3ed7-baf8-4dd1-9fa3-884a9e35b012 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received unexpected event network-vif-plugged-b2236786-98e2-461a-ba60-9ded45e0c725 for instance with vm_state active and task_state reboot_started.
Dec 05 12:32:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-8f227866-a2e0-433f-9e1b-3ec4a3da7c8b req-8caa3ed7-baf8-4dd1-9fa3-884a9e35b012 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received event network-vif-plugged-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8f227866-a2e0-433f-9e1b-3ec4a3da7c8b req-8caa3ed7-baf8-4dd1-9fa3-884a9e35b012 service nova] Acquiring lock "43653273-2337-43a0-981a-e28d1ba26655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8f227866-a2e0-433f-9e1b-3ec4a3da7c8b req-8caa3ed7-baf8-4dd1-9fa3-884a9e35b012 service nova] Lock "43653273-2337-43a0-981a-e28d1ba26655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8f227866-a2e0-433f-9e1b-3ec4a3da7c8b req-8caa3ed7-baf8-4dd1-9fa3-884a9e35b012 service nova] Lock "43653273-2337-43a0-981a-e28d1ba26655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-8f227866-a2e0-433f-9e1b-3ec4a3da7c8b req-8caa3ed7-baf8-4dd1-9fa3-884a9e35b012 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] No waiting events found dispatching network-vif-plugged-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:32:29 user nova-compute[75071]: WARNING nova.compute.manager [req-8f227866-a2e0-433f-9e1b-3ec4a3da7c8b req-8caa3ed7-baf8-4dd1-9fa3-884a9e35b012 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received unexpected event network-vif-plugged-b2236786-98e2-461a-ba60-9ded45e0c725 for instance with vm_state active and task_state reboot_started.
Dec 05 12:32:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Instance running successfully.
Dec 05 12:32:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a12d5808-355c-4222-ae48-cc692260d927 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Instance soft rebooted successfully.
Dec 05 12:32:29 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a12d5808-355c-4222-ae48-cc692260d927 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:32:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a12d5808-355c-4222-ae48-cc692260d927 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "43653273-2337-43a0-981a-e28d1ba26655" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.014s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-e66bf9d6-4982-4f36-aa28-17067ec71aa4 req-41599e08-e6d2-423d-99e3-c643d3fc3a08 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received event network-changed-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-e66bf9d6-4982-4f36-aa28-17067ec71aa4 req-41599e08-e6d2-423d-99e3-c643d3fc3a08 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Refreshing instance network info cache due to event network-changed-52df8e8e-e80a-4f0a-b496-63771b5e63a7. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:32:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e66bf9d6-4982-4f36-aa28-17067ec71aa4 req-41599e08-e6d2-423d-99e3-c643d3fc3a08 service nova] Acquiring lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:32:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e66bf9d6-4982-4f36-aa28-17067ec71aa4 req-41599e08-e6d2-423d-99e3-c643d3fc3a08 service nova] Acquired lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:32:34 user nova-compute[75071]: DEBUG nova.network.neutron [req-e66bf9d6-4982-4f36-aa28-17067ec71aa4 req-41599e08-e6d2-423d-99e3-c643d3fc3a08 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Refreshing network info cache for port 52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:32:35 user nova-compute[75071]: DEBUG nova.network.neutron [req-e66bf9d6-4982-4f36-aa28-17067ec71aa4 req-41599e08-e6d2-423d-99e3-c643d3fc3a08 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Updated VIF entry in instance network info cache for port 52df8e8e-e80a-4f0a-b496-63771b5e63a7. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:32:35 user nova-compute[75071]: DEBUG nova.network.neutron [req-e66bf9d6-4982-4f36-aa28-17067ec71aa4 req-41599e08-e6d2-423d-99e3-c643d3fc3a08 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Updating instance_info_cache with network_info: [{"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:32:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e66bf9d6-4982-4f36-aa28-17067ec71aa4 req-41599e08-e6d2-423d-99e3-c643d3fc3a08 service nova] Releasing lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:32:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-3dc76fcd-c124-4e00-9c13-426a2380fc4f req-77175219-c6a2-47d6-9200-1c3d5da675bc service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received event network-changed-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-3dc76fcd-c124-4e00-9c13-426a2380fc4f req-77175219-c6a2-47d6-9200-1c3d5da675bc service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Refreshing instance network info cache due to event network-changed-bf98e48b-bb55-447a-88ce-caed2d082b9b. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:32:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3dc76fcd-c124-4e00-9c13-426a2380fc4f req-77175219-c6a2-47d6-9200-1c3d5da675bc service nova] Acquiring lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:32:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3dc76fcd-c124-4e00-9c13-426a2380fc4f req-77175219-c6a2-47d6-9200-1c3d5da675bc service nova] Acquired lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:32:36 user nova-compute[75071]: DEBUG nova.network.neutron [req-3dc76fcd-c124-4e00-9c13-426a2380fc4f req-77175219-c6a2-47d6-9200-1c3d5da675bc service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Refreshing network info cache for port bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "015e89c3-73ad-4bfd-b55c-68323fae2b29" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG nova.objects.instance [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'flavor' on Instance uuid 015e89c3-73ad-4bfd-b55c-68323fae2b29 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "015e89c3-73ad-4bfd-b55c-68323fae2b29" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:37 user nova-compute[75071]: INFO nova.compute.manager [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Attaching volume f4d8820c-9c02-4d00-880a-f5cedafd6c77 to /dev/vdb
Dec 05 12:32:37 user nova-compute[75071]: DEBUG os_brick.utils [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19619ed-7c56-4d2b-b715-fdbb6a48cd4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG nova.network.neutron [req-3dc76fcd-c124-4e00-9c13-426a2380fc4f req-77175219-c6a2-47d6-9200-1c3d5da675bc service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Updated VIF entry in instance network info cache for port bf98e48b-bb55-447a-88ce-caed2d082b9b. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG nova.network.neutron [req-3dc76fcd-c124-4e00-9c13-426a2380fc4f req-77175219-c6a2-47d6-9200-1c3d5da675bc service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Updating instance_info_cache with network_info: [{"id": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "address": "fa:16:3e:40:8d:36", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf98e48b-bb", "ovs_interfaceid": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb1e9fa-21ca-4b04-adf6-4c7c66d4c19a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3dc76fcd-c124-4e00-9c13-426a2380fc4f req-77175219-c6a2-47d6-9200-1c3d5da675bc service nova] Releasing lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[664901f7-d8ba-4752-ad34-c735bba50a22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b777f94-e7b6-4d02-8d18-6d896ca29a55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:32:37 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:32:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f4348a-dc81-4bc2-9679-15e07bd981b3]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG os_brick.utils [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:32:37 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Updating existing volume attachment record: c372b8ff-4226-4f8e-ba64-d3a43d0c18de {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:32:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "77c962a7-587a-41be-b87d-ab416b8b43fd" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:38 user nova-compute[75071]: INFO nova.compute.manager [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Shelving
Dec 05 12:32:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-9c39921e-d34d-4029-b87e-ecda18cd043b req-86afc070-b7be-487c-9972-95460bf21ec4 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received event network-vif-unplugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9c39921e-d34d-4029-b87e-ecda18cd043b req-86afc070-b7be-487c-9972-95460bf21ec4 service nova] Acquiring lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9c39921e-d34d-4029-b87e-ecda18cd043b req-86afc070-b7be-487c-9972-95460bf21ec4 service nova] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9c39921e-d34d-4029-b87e-ecda18cd043b req-86afc070-b7be-487c-9972-95460bf21ec4 service nova] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-9c39921e-d34d-4029-b87e-ecda18cd043b req-86afc070-b7be-487c-9972-95460bf21ec4 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] No waiting events found dispatching network-vif-unplugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:32:39 user nova-compute[75071]: WARNING nova.compute.manager [req-9c39921e-d34d-4029-b87e-ecda18cd043b req-86afc070-b7be-487c-9972-95460bf21ec4 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received unexpected event network-vif-unplugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 for instance with vm_state active and task_state shelving.
Dec 05 12:32:39 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Instance destroyed successfully.
Dec 05 12:32:39 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Beginning cold snapshot process
Dec 05 12:32:39 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 12:32:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk /opt/stack/data/nova/instances/snapshots/tmpwvckh1fv/c0f90c14a9894b548d9155fe43457de1 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk /opt/stack/data/nova/instances/snapshots/tmpwvckh1fv/c0f90c14a9894b548d9155fe43457de1" returned: 0 in 1.036s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:40 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Snapshot extracted, beginning image upload
Dec 05 12:32:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-44e38111-de67-4ac2-92b4-ceb603ec66d1 req-18b82937-9e97-456b-bf50-7512279e3584 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received event network-vif-plugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44e38111-de67-4ac2-92b4-ceb603ec66d1 req-18b82937-9e97-456b-bf50-7512279e3584 service nova] Acquiring lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44e38111-de67-4ac2-92b4-ceb603ec66d1 req-18b82937-9e97-456b-bf50-7512279e3584 service nova] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44e38111-de67-4ac2-92b4-ceb603ec66d1 req-18b82937-9e97-456b-bf50-7512279e3584 service nova] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-44e38111-de67-4ac2-92b4-ceb603ec66d1 req-18b82937-9e97-456b-bf50-7512279e3584 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] No waiting events found dispatching network-vif-plugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:32:41 user nova-compute[75071]: WARNING nova.compute.manager [req-44e38111-de67-4ac2-92b4-ceb603ec66d1 req-18b82937-9e97-456b-bf50-7512279e3584 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received unexpected event network-vif-plugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 for instance with vm_state active and task_state shelving_image_uploading.
Dec 05 12:32:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Snapshot image upload complete
Dec 05 12:32:43 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:32:43 user nova-compute[75071]: INFO nova.compute.manager [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Shelve offloading
Dec 05 12:32:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Instance destroyed successfully.
Dec 05 12:32:43 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:32:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:32:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquired lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:32:43 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:32:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:44 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Updating instance_info_cache with network_info: [{"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:32:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Releasing lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:32:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Instance destroyed successfully.
Dec 05 12:32:45 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'resources' on Instance uuid 77c962a7-587a-41be-b87d-ab416b8b43fd {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1984475382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1984475382',id=33,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtoYRtON/k5tbb0b0mgSufh1T0fJ18q1yNdUUxwZ8FGHqcIPsw8eGqRqkMKmw0v8fjb0z41I1/TPnK4YuntSP9PKw0rISU/kk/utjGYcC3dcCXudabG3EjjbwL3JZGM1g==',key_name='tempest-keypair-1201033063',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:30:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='36cda9a88b434e66ad6d8ac75790d141',ramdisk_id='',reservation_id='r-clu35i2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1822750901',owner_user_name='tempest-AttachVolumeShelveTestJSON-1822750901-project-member',shelved_at='2023-12-05T12:32:43.613366',shelved_host='user',shelved_image_id='783a7c27-04a5-402d-a066-681fbaee348e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:32:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a70218d8181040818ed8290e743bd2db',uuid=77c962a7-587a-41be-b87d-ab416b8b43fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converting VIF {"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:34:f9,bridge_name='br-int',has_traffic_filtering=True,id=52df8e8e-e80a-4f0a-b496-63771b5e63a7,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52df8e8e-e8') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG os_vif [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:34:f9,bridge_name='br-int',has_traffic_filtering=True,id=52df8e8e-e80a-4f0a-b496-63771b5e63a7,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52df8e8e-e8') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52df8e8e-e8, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-7dc5dba7-adef-4c37-adc1-6c87a8a995ec req-65f0e57c-a794-4945-bec4-ac6a816670bf service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received event network-changed-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-7dc5dba7-adef-4c37-adc1-6c87a8a995ec req-65f0e57c-a794-4945-bec4-ac6a816670bf service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Refreshing instance network info cache due to event network-changed-52df8e8e-e80a-4f0a-b496-63771b5e63a7. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7dc5dba7-adef-4c37-adc1-6c87a8a995ec req-65f0e57c-a794-4945-bec4-ac6a816670bf service nova] Acquiring lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7dc5dba7-adef-4c37-adc1-6c87a8a995ec req-65f0e57c-a794-4945-bec4-ac6a816670bf service nova] Acquired lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG nova.network.neutron [req-7dc5dba7-adef-4c37-adc1-6c87a8a995ec req-65f0e57c-a794-4945-bec4-ac6a816670bf service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Refreshing network info cache for port 52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f68f0e4d-e105-44c3-b271-70671bcfbb0b) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:45 user nova-compute[75071]: INFO os_vif [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:34:f9,bridge_name='br-int',has_traffic_filtering=True,id=52df8e8e-e80a-4f0a-b496-63771b5e63a7,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52df8e8e-e8')
Dec 05 12:32:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Deleting instance files /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd_del
Dec 05 12:32:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Deletion of /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd_del complete
Dec 05 12:32:45 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Deleted allocations for instance 77c962a7-587a-41be-b87d-ab416b8b43fd
Dec 05 12:32:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'numa_topology' on Instance uuid 77c962a7-587a-41be-b87d-ab416b8b43fd {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG nova.objects.base [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Object Instance<77c962a7-587a-41be-b87d-ab416b8b43fd> lazy-loaded attributes: resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG nova.network.neutron [req-7dc5dba7-adef-4c37-adc1-6c87a8a995ec req-65f0e57c-a794-4945-bec4-ac6a816670bf service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Updated VIF entry in instance network info cache for port 52df8e8e-e80a-4f0a-b496-63771b5e63a7. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG nova.network.neutron [req-7dc5dba7-adef-4c37-adc1-6c87a8a995ec req-65f0e57c-a794-4945-bec4-ac6a816670bf service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Updating instance_info_cache with network_info: [{"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6f21c709-ba4b-4bc8-92c9-74f6afa3083f tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.204s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7dc5dba7-adef-4c37-adc1-6c87a8a995ec req-65f0e57c-a794-4945-bec4-ac6a816670bf service nova] Releasing lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSpGvzRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:32:47 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:32:47 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:32:47 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50154c8-2707-4728-b19e-fd1102bf8050]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:32:47 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b64f0a-d595-43a7-9bf4-43be79dacc67]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77] added
Dec 05 12:32:47 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee97a74-ef08-430c-9624-aebb595b61e6]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a996ef79-2e65-4221-8616-047697a9e8f5]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dSpGvzRT {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dSpGvzRT" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce91f78c-d55e-4f9a-8178-8ec4a9175c68]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dSpGvzRT'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dd7c73-bc31-4908-9617-1bdcb6b69b98]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bad7632-ac7a-4856-8db9-7261e2ec1c4f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:32:47 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:32:47 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:32:47 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d (non-flash)
Dec 05 12:32:47 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:32:47 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:32:47 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:32:47 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d (non-flash)
Dec 05 12:32:47 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaf16af-a1f1-496d-9275-86a5d69ba775]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77, portal: 172.16.0.220,3260]
Dec 05 12:32:47 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77, portal: 172.16.0.220,3260] successful.
Dec 05 12:32:47 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d179c9-f7ce-4c3a-89ff-b61854b693f6]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[14216ea3-83bb-4587-987b-47c603642c1d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:32:47 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:32:47 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:32:47 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d (non-flash)
Dec 05 12:32:47 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)
Dec 05 12:32:47 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:32:47 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:32:47 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:32:47 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d (non-flash)
Dec 05 12:32:47 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)
Dec 05 12:32:47 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:32:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bc680d-bff3-49cd-bfb0-45a5735744ad]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:32:48 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:32:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSpGvzRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:32:48 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:32:48 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:32:48 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:32:48 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:32:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:48 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:32:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:32:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:32:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26237313939646133', 'path': '/dev/sdd'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:32:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237313939646133', 'path': '/dev/sdd'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:32:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:49 user nova-compute[75071]: DEBUG nova.objects.instance [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'flavor' on Instance uuid 015e89c3-73ad-4bfd-b55c-68323fae2b29 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:32:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:32:49 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:32:49 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Dec 05 12:32:49 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:32:49 user nova-compute[75071]:   <serial>f4d8820c-9c02-4d00-880a-f5cedafd6c77</serial>
Dec 05 12:32:49 user nova-compute[75071]: </disk>
Dec 05 12:32:49 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:32:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:32:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:32:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] No VIF found with MAC fa:16:3e:40:8d:36, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:32:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4cce55e6-e672-41d4-8a9b-d8643ac8e22d tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.507s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:32:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:32:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42776e73-1ef0-4c57-a50a-942f6f4881de/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42776e73-1ef0-4c57-a50a-942f6f4881de/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42776e73-1ef0-4c57-a50a-942f6f4881de/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42776e73-1ef0-4c57-a50a-942f6f4881de/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:50 user nova-compute[75071]: INFO nova.compute.manager [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Rescuing
Dec 05 12:32:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:32:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquired lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:32:50 user nova-compute[75071]: DEBUG nova.network.neutron [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:32:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:32:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:52 user nova-compute[75071]: DEBUG nova.network.neutron [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Updating instance_info_cache with network_info: [{"id": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "address": "fa:16:3e:40:8d:36", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf98e48b-bb", "ovs_interfaceid": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:32:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Releasing lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:32:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:53 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:32:53 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=7649MB free_disk=24.813568115234375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:53 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Instance destroyed successfully.
Dec 05 12:32:53 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Attempting rescue
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75071) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Instance directory exists: not creating {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 05 12:32:53 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Creating image(s)
Dec 05 12:32:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "/opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "/opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "/opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.objects.instance [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'trusted_certs' on Instance uuid 015e89c3-73ad-4bfd-b55c-68323fae2b29 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.190s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk.rescue {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk.rescue" returned: 0 in 0.055s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.objects.instance [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'migration_context' on Instance uuid 015e89c3-73ad-4bfd-b55c-68323fae2b29 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.objects.base [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Object Instance<015e89c3-73ad-4bfd-b55c-68323fae2b29> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Start _get_guest_xml network_info=[{"id": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "address": "fa:16:3e:40:8d:36", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "vif_mac": "fa:16:3e:40:8d:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf98e48b-bb", "ovs_interfaceid": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.objects.instance [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'resources' on Instance uuid 015e89c3-73ad-4bfd-b55c-68323fae2b29 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.objects.base [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Object Instance<015e89c3-73ad-4bfd-b55c-68323fae2b29> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.objects.instance [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'numa_topology' on Instance uuid 015e89c3-73ad-4bfd-b55c-68323fae2b29 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.objects.base [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Object Instance<015e89c3-73ad-4bfd-b55c-68323fae2b29> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:32:53 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:32:53 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.objects.instance [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'vcpu_model' on Instance uuid 015e89c3-73ad-4bfd-b55c-68323fae2b29 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.objects.base [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Object Instance<015e89c3-73ad-4bfd-b55c-68323fae2b29> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:30:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2020941888',display_name='tempest-ServerRescueNegativeTestJSON-server-2020941888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2020941888',id=34,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFth0oBwzOM1o5M+S301WBgFD1bDBox6dwVpPgnPJPuFdVExY6JDCk+kMORijWFHc7di8Z2h3DrLTrM16EW06eFFgSSHFESCZZN6ETdKv+69qC+C5Ro0WG5ROvMgSQkRQ==',key_name='tempest-keypair-955735893',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:30:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b958a2138af24f5a860e7a0c99d9ebb5',ramdisk_id='',reservation_id='r-jbvwgw0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-170727457',owner_user_name='tempest-ServerRescueNegativeTestJSON-170727457-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:30:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3312b55016d34680b6873eedf97e9a8f',uuid=015e89c3-73ad-4bfd-b55c-68323fae2b29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "address": "fa:16:3e:40:8d:36", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "vif_mac": "fa:16:3e:40:8d:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf98e48b-bb", "ovs_interfaceid": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converting VIF {"id": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "address": "fa:16:3e:40:8d:36", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "vif_mac": "fa:16:3e:40:8d:36"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf98e48b-bb", "ovs_interfaceid": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:8d:36,bridge_name='br-int',has_traffic_filtering=True,id=bf98e48b-bb55-447a-88ce-caed2d082b9b,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf98e48b-bb') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.objects.instance [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'pci_devices' on Instance uuid 015e89c3-73ad-4bfd-b55c-68323fae2b29 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e08be776-0fa9-4871-86eb-2093530c00f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c2b46f1c-dce6-4436-8e1e-062ffda80732 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 43653273-2337-43a0-981a-e28d1ba26655 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 42776e73-1ef0-4c57-a50a-942f6f4881de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 015e89c3-73ad-4bfd-b55c-68323fae2b29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.objects.base [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Object Instance<015e89c3-73ad-4bfd-b55c-68323fae2b29> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:32:53 user nova-compute[75071]:   <uuid>015e89c3-73ad-4bfd-b55c-68323fae2b29</uuid>
Dec 05 12:32:53 user nova-compute[75071]:   <name>instance-00000022</name>
Dec 05 12:32:53 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:32:53 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:32:53 user nova-compute[75071]:   <metadata>
Dec 05 12:32:53 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:32:53 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:32:53 user nova-compute[75071]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2020941888</nova:name>
Dec 05 12:32:53 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:32:53</nova:creationTime>
Dec 05 12:32:53 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:32:53 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:32:53 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:32:53 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:32:53 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:32:53 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:32:53 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:32:53 user nova-compute[75071]:       <nova:owner>
Dec 05 12:32:53 user nova-compute[75071]:         <nova:user uuid="3312b55016d34680b6873eedf97e9a8f">tempest-ServerRescueNegativeTestJSON-170727457-project-member</nova:user>
Dec 05 12:32:53 user nova-compute[75071]:         <nova:project uuid="b958a2138af24f5a860e7a0c99d9ebb5">tempest-ServerRescueNegativeTestJSON-170727457</nova:project>
Dec 05 12:32:53 user nova-compute[75071]:       </nova:owner>
Dec 05 12:32:53 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:32:53 user nova-compute[75071]:       <nova:ports>
Dec 05 12:32:53 user nova-compute[75071]:         <nova:port uuid="bf98e48b-bb55-447a-88ce-caed2d082b9b">
Dec 05 12:32:53 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 05 12:32:53 user nova-compute[75071]:         </nova:port>
Dec 05 12:32:53 user nova-compute[75071]:       </nova:ports>
Dec 05 12:32:53 user nova-compute[75071]:     </nova:instance>
Dec 05 12:32:53 user nova-compute[75071]:   </metadata>
Dec 05 12:32:53 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:32:53 user nova-compute[75071]:     <system>
Dec 05 12:32:53 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:32:53 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:32:53 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:32:53 user nova-compute[75071]:       <entry name="serial">015e89c3-73ad-4bfd-b55c-68323fae2b29</entry>
Dec 05 12:32:53 user nova-compute[75071]:       <entry name="uuid">015e89c3-73ad-4bfd-b55c-68323fae2b29</entry>
Dec 05 12:32:53 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:32:53 user nova-compute[75071]:     </system>
Dec 05 12:32:53 user nova-compute[75071]:   </sysinfo>
Dec 05 12:32:53 user nova-compute[75071]:   <os>
Dec 05 12:32:53 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:32:53 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:32:53 user nova-compute[75071]:   </os>
Dec 05 12:32:53 user nova-compute[75071]:   <features>
Dec 05 12:32:53 user nova-compute[75071]:     <acpi/>
Dec 05 12:32:53 user nova-compute[75071]:     <apic/>
Dec 05 12:32:53 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:32:53 user nova-compute[75071]:   </features>
Dec 05 12:32:53 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:32:53 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:32:53 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:32:53 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:32:53 user nova-compute[75071]:   </clock>
Dec 05 12:32:53 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:32:53 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:32:53 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:32:53 user nova-compute[75071]:   </cpu>
Dec 05 12:32:53 user nova-compute[75071]:   <devices>
Dec 05 12:32:53 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:32:53 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:32:53 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk.rescue"/>
Dec 05 12:32:53 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:32:53 user nova-compute[75071]:     </disk>
Dec 05 12:32:53 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:32:53 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:32:53 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk"/>
Dec 05 12:32:53 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Dec 05 12:32:53 user nova-compute[75071]:     </disk>
Dec 05 12:32:53 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:32:53 user nova-compute[75071]:       <mac address="fa:16:3e:40:8d:36"/>
Dec 05 12:32:53 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:32:53 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:32:53 user nova-compute[75071]:       <target dev="tapbf98e48b-bb"/>
Dec 05 12:32:53 user nova-compute[75071]:     </interface>
Dec 05 12:32:53 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:32:53 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/console.log" append="off"/>
Dec 05 12:32:53 user nova-compute[75071]:     </serial>
Dec 05 12:32:53 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:32:53 user nova-compute[75071]:     <video>
Dec 05 12:32:53 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:32:53 user nova-compute[75071]:     </video>
Dec 05 12:32:53 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:32:53 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:32:53 user nova-compute[75071]:     </rng>
Dec 05 12:32:53 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:32:53 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:32:53 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:32:53 user nova-compute[75071]:     </memballoon>
Dec 05 12:32:53 user nova-compute[75071]:   </devices>
Dec 05 12:32:53 user nova-compute[75071]: </domain>
Dec 05 12:32:53 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:32:53 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Instance destroyed successfully.
Dec 05 12:32:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:32:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] No VIF found with MAC fa:16:3e:40:8d:36, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:32:54 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:32:54 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:32:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:32:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.854s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:32:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 12:32:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 12:32:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:32:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:32:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:32:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:32:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:32:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:32:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-cb176802-8ba8-4107-8386-e6afec200c40 req-4e433e57-7d06-4002-8fe8-792a1b9d08cf service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received event network-vif-unplugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cb176802-8ba8-4107-8386-e6afec200c40 req-4e433e57-7d06-4002-8fe8-792a1b9d08cf service nova] Acquiring lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cb176802-8ba8-4107-8386-e6afec200c40 req-4e433e57-7d06-4002-8fe8-792a1b9d08cf service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cb176802-8ba8-4107-8386-e6afec200c40 req-4e433e57-7d06-4002-8fe8-792a1b9d08cf service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-cb176802-8ba8-4107-8386-e6afec200c40 req-4e433e57-7d06-4002-8fe8-792a1b9d08cf service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] No waiting events found dispatching network-vif-unplugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:32:56 user nova-compute[75071]: WARNING nova.compute.manager [req-cb176802-8ba8-4107-8386-e6afec200c40 req-4e433e57-7d06-4002-8fe8-792a1b9d08cf service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received unexpected event network-vif-unplugged-bf98e48b-bb55-447a-88ce-caed2d082b9b for instance with vm_state active and task_state rescuing.
Dec 05 12:32:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-008d2e19-54fe-4ca5-9bab-ebd8f4ac7009 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:32:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Acquiring lock "78cdbf30-96bc-46ab-9bea-994ddb56165e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Lock "78cdbf30-96bc-46ab-9bea-994ddb56165e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:32:58 user nova-compute[75071]: INFO nova.compute.claims [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Claim successful on node user
Dec 05 12:32:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-3960668b-6596-4603-82b9-730bd041c729 req-25fa13fb-70a5-46f3-85a7-856a5d29ddc9 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received event network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3960668b-6596-4603-82b9-730bd041c729 req-25fa13fb-70a5-46f3-85a7-856a5d29ddc9 service nova] Acquiring lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3960668b-6596-4603-82b9-730bd041c729 req-25fa13fb-70a5-46f3-85a7-856a5d29ddc9 service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3960668b-6596-4603-82b9-730bd041c729 req-25fa13fb-70a5-46f3-85a7-856a5d29ddc9 service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-3960668b-6596-4603-82b9-730bd041c729 req-25fa13fb-70a5-46f3-85a7-856a5d29ddc9 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] No waiting events found dispatching network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:32:58 user nova-compute[75071]: WARNING nova.compute.manager [req-3960668b-6596-4603-82b9-730bd041c729 req-25fa13fb-70a5-46f3-85a7-856a5d29ddc9 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received unexpected event network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b for instance with vm_state rescued and task_state None.
Dec 05 12:32:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-3960668b-6596-4603-82b9-730bd041c729 req-25fa13fb-70a5-46f3-85a7-856a5d29ddc9 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received event network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3960668b-6596-4603-82b9-730bd041c729 req-25fa13fb-70a5-46f3-85a7-856a5d29ddc9 service nova] Acquiring lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3960668b-6596-4603-82b9-730bd041c729 req-25fa13fb-70a5-46f3-85a7-856a5d29ddc9 service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3960668b-6596-4603-82b9-730bd041c729 req-25fa13fb-70a5-46f3-85a7-856a5d29ddc9 service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-3960668b-6596-4603-82b9-730bd041c729 req-25fa13fb-70a5-46f3-85a7-856a5d29ddc9 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] No waiting events found dispatching network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:32:58 user nova-compute[75071]: WARNING nova.compute.manager [req-3960668b-6596-4603-82b9-730bd041c729 req-25fa13fb-70a5-46f3-85a7-856a5d29ddc9 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received unexpected event network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b for instance with vm_state rescued and task_state None.
Dec 05 12:32:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-3960668b-6596-4603-82b9-730bd041c729 req-25fa13fb-70a5-46f3-85a7-856a5d29ddc9 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received event network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3960668b-6596-4603-82b9-730bd041c729 req-25fa13fb-70a5-46f3-85a7-856a5d29ddc9 service nova] Acquiring lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3960668b-6596-4603-82b9-730bd041c729 req-25fa13fb-70a5-46f3-85a7-856a5d29ddc9 service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3960668b-6596-4603-82b9-730bd041c729 req-25fa13fb-70a5-46f3-85a7-856a5d29ddc9 service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-3960668b-6596-4603-82b9-730bd041c729 req-25fa13fb-70a5-46f3-85a7-856a5d29ddc9 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] No waiting events found dispatching network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:32:58 user nova-compute[75071]: WARNING nova.compute.manager [req-3960668b-6596-4603-82b9-730bd041c729 req-25fa13fb-70a5-46f3-85a7-856a5d29ddc9 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received unexpected event network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b for instance with vm_state rescued and task_state None.
Dec 05 12:32:58 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:32:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG nova.policy [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e50eb24e2274d81a2692dfcf012fafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb7c6dba495f41e1893bacfc762ae765', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:32:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Creating image(s)
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Acquiring lock "/opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Lock "/opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Lock "/opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.207s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.193s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/disk 1073741824" returned: 0 in 0.050s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Cannot resize image /opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Ensure instance console log exists: /opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Updating instance_info_cache with network_info: [{"id": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "address": "fa:16:3e:59:88:5c", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2c318b-a7", "ovs_interfaceid": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 12:32:59 user nova-compute[75071]: DEBUG nova.network.neutron [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Successfully created port: dacdecc3-2aab-4979-bb6b-5f82c82b00a0 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Successfully updated port: dacdecc3-2aab-4979-bb6b-5f82c82b00a0 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Acquiring lock "refresh_cache-78cdbf30-96bc-46ab-9bea-994ddb56165e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Acquired lock "refresh_cache-78cdbf30-96bc-46ab-9bea-994ddb56165e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-39b2f131-1690-45d2-9cab-82201129228a req-e19146db-d40e-451d-bc6b-30e5ef787585 service nova] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Received event network-changed-dacdecc3-2aab-4979-bb6b-5f82c82b00a0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-39b2f131-1690-45d2-9cab-82201129228a req-e19146db-d40e-451d-bc6b-30e5ef787585 service nova] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Refreshing instance network info cache due to event network-changed-dacdecc3-2aab-4979-bb6b-5f82c82b00a0. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-39b2f131-1690-45d2-9cab-82201129228a req-e19146db-d40e-451d-bc6b-30e5ef787585 service nova] Acquiring lock "refresh_cache-78cdbf30-96bc-46ab-9bea-994ddb56165e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Updating instance_info_cache with network_info: [{"id": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "address": "fa:16:3e:5f:61:37", "network": {"id": "e2824ede-7c75-4502-8751-2674862c3118", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1146622404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7c6dba495f41e1893bacfc762ae765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdacdecc3-2a", "ovs_interfaceid": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Releasing lock "refresh_cache-78cdbf30-96bc-46ab-9bea-994ddb56165e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Instance network_info: |[{"id": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "address": "fa:16:3e:5f:61:37", "network": {"id": "e2824ede-7c75-4502-8751-2674862c3118", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1146622404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7c6dba495f41e1893bacfc762ae765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdacdecc3-2a", "ovs_interfaceid": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-39b2f131-1690-45d2-9cab-82201129228a req-e19146db-d40e-451d-bc6b-30e5ef787585 service nova] Acquired lock "refresh_cache-78cdbf30-96bc-46ab-9bea-994ddb56165e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.network.neutron [req-39b2f131-1690-45d2-9cab-82201129228a req-e19146db-d40e-451d-bc6b-30e5ef787585 service nova] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Refreshing network info cache for port dacdecc3-2aab-4979-bb6b-5f82c82b00a0 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Start _get_guest_xml network_info=[{"id": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "address": "fa:16:3e:5f:61:37", "network": {"id": "e2824ede-7c75-4502-8751-2674862c3118", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1146622404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7c6dba495f41e1893bacfc762ae765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdacdecc3-2a", "ovs_interfaceid": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:33:00 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:33:00 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-402734499',display_name='tempest-VolumesActionsTest-instance-402734499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-402734499',id=35,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb7c6dba495f41e1893bacfc762ae765',ramdisk_id='',reservation_id='r-es0nzsad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-274044295',owner_user_name='tempest-VolumesActionsTest-274044295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:32:59Z,user_data=None,user_id='7e50eb24e2274d81a2692dfcf012fafa',uuid=78cdbf30-96bc-46ab-9bea-994ddb56165e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "address": "fa:16:3e:5f:61:37", "network": {"id": "e2824ede-7c75-4502-8751-2674862c3118", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1146622404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7c6dba495f41e1893bacfc762ae765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdacdecc3-2a", "ovs_interfaceid": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Converting VIF {"id": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "address": "fa:16:3e:5f:61:37", "network": {"id": "e2824ede-7c75-4502-8751-2674862c3118", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1146622404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7c6dba495f41e1893bacfc762ae765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdacdecc3-2a", "ovs_interfaceid": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:61:37,bridge_name='br-int',has_traffic_filtering=True,id=dacdecc3-2aab-4979-bb6b-5f82c82b00a0,network=Network(e2824ede-7c75-4502-8751-2674862c3118),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdacdecc3-2a') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Lazy-loading 'pci_devices' on Instance uuid 78cdbf30-96bc-46ab-9bea-994ddb56165e {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:33:00 user nova-compute[75071]:   <uuid>78cdbf30-96bc-46ab-9bea-994ddb56165e</uuid>
Dec 05 12:33:00 user nova-compute[75071]:   <name>instance-00000023</name>
Dec 05 12:33:00 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:33:00 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:33:00 user nova-compute[75071]:   <metadata>
Dec 05 12:33:00 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:33:00 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:33:00 user nova-compute[75071]:       <nova:name>tempest-VolumesActionsTest-instance-402734499</nova:name>
Dec 05 12:33:00 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:33:00</nova:creationTime>
Dec 05 12:33:00 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:33:00 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:33:00 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:33:00 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:33:00 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:33:00 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:33:00 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:33:00 user nova-compute[75071]:       <nova:owner>
Dec 05 12:33:00 user nova-compute[75071]:         <nova:user uuid="7e50eb24e2274d81a2692dfcf012fafa">tempest-VolumesActionsTest-274044295-project-member</nova:user>
Dec 05 12:33:00 user nova-compute[75071]:         <nova:project uuid="bb7c6dba495f41e1893bacfc762ae765">tempest-VolumesActionsTest-274044295</nova:project>
Dec 05 12:33:00 user nova-compute[75071]:       </nova:owner>
Dec 05 12:33:00 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:33:00 user nova-compute[75071]:       <nova:ports>
Dec 05 12:33:00 user nova-compute[75071]:         <nova:port uuid="dacdecc3-2aab-4979-bb6b-5f82c82b00a0">
Dec 05 12:33:00 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 12:33:00 user nova-compute[75071]:         </nova:port>
Dec 05 12:33:00 user nova-compute[75071]:       </nova:ports>
Dec 05 12:33:00 user nova-compute[75071]:     </nova:instance>
Dec 05 12:33:00 user nova-compute[75071]:   </metadata>
Dec 05 12:33:00 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:33:00 user nova-compute[75071]:     <system>
Dec 05 12:33:00 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:33:00 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:33:00 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:33:00 user nova-compute[75071]:       <entry name="serial">78cdbf30-96bc-46ab-9bea-994ddb56165e</entry>
Dec 05 12:33:00 user nova-compute[75071]:       <entry name="uuid">78cdbf30-96bc-46ab-9bea-994ddb56165e</entry>
Dec 05 12:33:00 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:33:00 user nova-compute[75071]:     </system>
Dec 05 12:33:00 user nova-compute[75071]:   </sysinfo>
Dec 05 12:33:00 user nova-compute[75071]:   <os>
Dec 05 12:33:00 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:33:00 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:33:00 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:33:00 user nova-compute[75071]:   </os>
Dec 05 12:33:00 user nova-compute[75071]:   <features>
Dec 05 12:33:00 user nova-compute[75071]:     <acpi/>
Dec 05 12:33:00 user nova-compute[75071]:     <apic/>
Dec 05 12:33:00 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:33:00 user nova-compute[75071]:   </features>
Dec 05 12:33:00 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:33:00 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:33:00 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:33:00 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:33:00 user nova-compute[75071]:   </clock>
Dec 05 12:33:00 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:33:00 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:33:00 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:33:00 user nova-compute[75071]:   </cpu>
Dec 05 12:33:00 user nova-compute[75071]:   <devices>
Dec 05 12:33:00 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:33:00 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:33:00 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/disk"/>
Dec 05 12:33:00 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:33:00 user nova-compute[75071]:     </disk>
Dec 05 12:33:00 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:33:00 user nova-compute[75071]:       <mac address="fa:16:3e:5f:61:37"/>
Dec 05 12:33:00 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:33:00 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:33:00 user nova-compute[75071]:       <target dev="tapdacdecc3-2a"/>
Dec 05 12:33:00 user nova-compute[75071]:     </interface>
Dec 05 12:33:00 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:33:00 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/console.log" append="off"/>
Dec 05 12:33:00 user nova-compute[75071]:     </serial>
Dec 05 12:33:00 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:33:00 user nova-compute[75071]:     <video>
Dec 05 12:33:00 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:33:00 user nova-compute[75071]:     </video>
Dec 05 12:33:00 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:33:00 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:33:00 user nova-compute[75071]:     </rng>
Dec 05 12:33:00 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:33:00 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:33:00 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:33:00 user nova-compute[75071]:     </memballoon>
Dec 05 12:33:00 user nova-compute[75071]:   </devices>
Dec 05 12:33:00 user nova-compute[75071]: </domain>
Dec 05 12:33:00 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-402734499',display_name='tempest-VolumesActionsTest-instance-402734499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-402734499',id=35,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb7c6dba495f41e1893bacfc762ae765',ramdisk_id='',reservation_id='r-es0nzsad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-274044295',owner_user_name='tempest-VolumesActionsTest-274044295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:32:59Z,user_data=None,user_id='7e50eb24e2274d81a2692dfcf012fafa',uuid=78cdbf30-96bc-46ab-9bea-994ddb56165e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "address": "fa:16:3e:5f:61:37", "network": {"id": "e2824ede-7c75-4502-8751-2674862c3118", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1146622404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7c6dba495f41e1893bacfc762ae765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdacdecc3-2a", "ovs_interfaceid": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Converting VIF {"id": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "address": "fa:16:3e:5f:61:37", "network": {"id": "e2824ede-7c75-4502-8751-2674862c3118", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1146622404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7c6dba495f41e1893bacfc762ae765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdacdecc3-2a", "ovs_interfaceid": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:61:37,bridge_name='br-int',has_traffic_filtering=True,id=dacdecc3-2aab-4979-bb6b-5f82c82b00a0,network=Network(e2824ede-7c75-4502-8751-2674862c3118),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdacdecc3-2a') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG os_vif [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:61:37,bridge_name='br-int',has_traffic_filtering=True,id=dacdecc3-2aab-4979-bb6b-5f82c82b00a0,network=Network(e2824ede-7c75-4502-8751-2674862c3118),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdacdecc3-2a') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d6c6ade-6bc4-5b41-82c5-61b23d5fe273', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:33:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:33:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdacdecc3-2a, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:33:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdacdecc3-2a, col_values=(('qos', UUID('ed3f395f-9042-4094-bd10-030f0911a3b7')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:33:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdacdecc3-2a, col_values=(('external_ids', {'iface-id': 'dacdecc3-2aab-4979-bb6b-5f82c82b00a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:61:37', 'vm-uuid': '78cdbf30-96bc-46ab-9bea-994ddb56165e'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:33:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:33:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:01 user nova-compute[75071]: INFO os_vif [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:61:37,bridge_name='br-int',has_traffic_filtering=True,id=dacdecc3-2aab-4979-bb6b-5f82c82b00a0,network=Network(e2824ede-7c75-4502-8751-2674862c3118),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdacdecc3-2a')
Dec 05 12:33:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:33:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] No VIF found with MAC fa:16:3e:5f:61:37, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:33:01 user nova-compute[75071]: DEBUG nova.network.neutron [req-39b2f131-1690-45d2-9cab-82201129228a req-e19146db-d40e-451d-bc6b-30e5ef787585 service nova] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Updated VIF entry in instance network info cache for port dacdecc3-2aab-4979-bb6b-5f82c82b00a0. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:33:01 user nova-compute[75071]: DEBUG nova.network.neutron [req-39b2f131-1690-45d2-9cab-82201129228a req-e19146db-d40e-451d-bc6b-30e5ef787585 service nova] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Updating instance_info_cache with network_info: [{"id": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "address": "fa:16:3e:5f:61:37", "network": {"id": "e2824ede-7c75-4502-8751-2674862c3118", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1146622404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7c6dba495f41e1893bacfc762ae765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdacdecc3-2a", "ovs_interfaceid": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:33:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-39b2f131-1690-45d2-9cab-82201129228a req-e19146db-d40e-451d-bc6b-30e5ef787585 service nova] Releasing lock "refresh_cache-78cdbf30-96bc-46ab-9bea-994ddb56165e" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:33:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-648d86d6-95a3-4105-83f2-27c64532d9c9 req-6d052353-25e1-416e-a269-fd0493e23868 service nova] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Received event network-vif-plugged-dacdecc3-2aab-4979-bb6b-5f82c82b00a0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:33:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-648d86d6-95a3-4105-83f2-27c64532d9c9 req-6d052353-25e1-416e-a269-fd0493e23868 service nova] Acquiring lock "78cdbf30-96bc-46ab-9bea-994ddb56165e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-648d86d6-95a3-4105-83f2-27c64532d9c9 req-6d052353-25e1-416e-a269-fd0493e23868 service nova] Lock "78cdbf30-96bc-46ab-9bea-994ddb56165e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-648d86d6-95a3-4105-83f2-27c64532d9c9 req-6d052353-25e1-416e-a269-fd0493e23868 service nova] Lock "78cdbf30-96bc-46ab-9bea-994ddb56165e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-648d86d6-95a3-4105-83f2-27c64532d9c9 req-6d052353-25e1-416e-a269-fd0493e23868 service nova] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] No waiting events found dispatching network-vif-plugged-dacdecc3-2aab-4979-bb6b-5f82c82b00a0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:33:03 user nova-compute[75071]: WARNING nova.compute.manager [req-648d86d6-95a3-4105-83f2-27c64532d9c9 req-6d052353-25e1-416e-a269-fd0493e23868 service nova] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Received unexpected event network-vif-plugged-dacdecc3-2aab-4979-bb6b-5f82c82b00a0 for instance with vm_state building and task_state spawning.
Dec 05 12:33:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:33:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:33:04 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Instance spawned successfully.
Dec 05 12:33:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:33:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:33:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:33:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:33:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:33:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:33:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:33:05 user nova-compute[75071]: INFO nova.compute.manager [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Took 6.23 seconds to spawn the instance on the hypervisor.
Dec 05 12:33:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:33:05 user nova-compute[75071]: INFO nova.compute.manager [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Took 6.98 seconds to build instance.
Dec 05 12:33:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-42825fd9-5aa0-40ef-9478-054b62551c0d tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Lock "78cdbf30-96bc-46ab-9bea-994ddb56165e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.096s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-4e1208f7-19e8-4b02-9fec-ad6c8d20ff16 req-4acc3de3-1a0d-4af7-8935-801e299bf6e4 service nova] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Received event network-vif-plugged-dacdecc3-2aab-4979-bb6b-5f82c82b00a0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:33:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e1208f7-19e8-4b02-9fec-ad6c8d20ff16 req-4acc3de3-1a0d-4af7-8935-801e299bf6e4 service nova] Acquiring lock "78cdbf30-96bc-46ab-9bea-994ddb56165e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e1208f7-19e8-4b02-9fec-ad6c8d20ff16 req-4acc3de3-1a0d-4af7-8935-801e299bf6e4 service nova] Lock "78cdbf30-96bc-46ab-9bea-994ddb56165e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4e1208f7-19e8-4b02-9fec-ad6c8d20ff16 req-4acc3de3-1a0d-4af7-8935-801e299bf6e4 service nova] Lock "78cdbf30-96bc-46ab-9bea-994ddb56165e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-4e1208f7-19e8-4b02-9fec-ad6c8d20ff16 req-4acc3de3-1a0d-4af7-8935-801e299bf6e4 service nova] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] No waiting events found dispatching network-vif-plugged-dacdecc3-2aab-4979-bb6b-5f82c82b00a0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:33:05 user nova-compute[75071]: WARNING nova.compute.manager [req-4e1208f7-19e8-4b02-9fec-ad6c8d20ff16 req-4acc3de3-1a0d-4af7-8935-801e299bf6e4 service nova] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Received unexpected event network-vif-plugged-dacdecc3-2aab-4979-bb6b-5f82c82b00a0 for instance with vm_state active and task_state None.
Dec 05 12:33:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:22 user nova-compute[75071]: INFO nova.compute.manager [None req-36845d2b-0ba2-4d97-a9c6-4258e0cccaa3 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Get console output
Dec 05 12:33:22 user nova-compute[75071]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Dec 05 12:33:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_power_states {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid e08be776-0fa9-4871-86eb-2093530c00f3 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid e0c82eba-8448-4780-b92d-62d7c60ec7ef {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid c2b46f1c-dce6-4436-8e1e-062ffda80732 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 43653273-2337-43a0-981a-e28d1ba26655 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 42776e73-1ef0-4c57-a50a-942f6f4881de {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 015e89c3-73ad-4bfd-b55c-68323fae2b29 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 78cdbf30-96bc-46ab-9bea-994ddb56165e {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "e08be776-0fa9-4871-86eb-2093530c00f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "e08be776-0fa9-4871-86eb-2093530c00f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "c2b46f1c-dce6-4436-8e1e-062ffda80732" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "43653273-2337-43a0-981a-e28d1ba26655" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "43653273-2337-43a0-981a-e28d1ba26655" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "42776e73-1ef0-4c57-a50a-942f6f4881de" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "015e89c3-73ad-4bfd-b55c-68323fae2b29" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "78cdbf30-96bc-46ab-9bea-994ddb56165e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "78cdbf30-96bc-46ab-9bea-994ddb56165e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "e08be776-0fa9-4871-86eb-2093530c00f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "78cdbf30-96bc-46ab-9bea-994ddb56165e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "43653273-2337-43a0-981a-e28d1ba26655" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:33:49 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:49 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:33:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:33:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:33:50 user nova-compute[75071]: INFO nova.compute.claims [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Claim successful on node user
Dec 05 12:33:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Refreshing inventories for resource provider 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Updating ProviderTree inventory for provider 25beb694-9dd7-475f-9657-74a5f0368417 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Updating inventory in ProviderTree for provider 25beb694-9dd7-475f-9657-74a5f0368417 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Refreshing aggregate associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Refreshing trait associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.731s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42776e73-1ef0-4c57-a50a-942f6f4881de/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42776e73-1ef0-4c57-a50a-942f6f4881de/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42776e73-1ef0-4c57-a50a-942f6f4881de/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:51 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:33:51 user nova-compute[75071]: DEBUG nova.policy [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dad126ca4fd348ffb12f22ab05acc57f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b44f33bb08a547948df72daba2ec1722', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42776e73-1ef0-4c57-a50a-942f6f4881de/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:33:51 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Creating image(s)
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "/opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "/opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.203s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Successfully created port: 4797cdcb-bed0-4fa7-af67-ab3d02b41977 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk 1073741824" returned: 0 in 0.057s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Cannot resize image /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Ensure instance console log exists: /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Successfully updated port: 4797cdcb-bed0-4fa7-af67-ab3d02b41977 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "refresh_cache-ce0b3e61-f8dd-487a-a81a-a466c45f0814" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquired lock "refresh_cache-ce0b3e61-f8dd-487a-a81a-a466c45f0814" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-51efd62a-e763-478f-bc92-86fcda9a9ae1 req-d4c60ea7-ac38-4ee4-95f2-76682a6c03f8 service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Received event network-changed-4797cdcb-bed0-4fa7-af67-ab3d02b41977 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-51efd62a-e763-478f-bc92-86fcda9a9ae1 req-d4c60ea7-ac38-4ee4-95f2-76682a6c03f8 service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Refreshing instance network info cache due to event network-changed-4797cdcb-bed0-4fa7-af67-ab3d02b41977. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-51efd62a-e763-478f-bc92-86fcda9a9ae1 req-d4c60ea7-ac38-4ee4-95f2-76682a6c03f8 service nova] Acquiring lock "refresh_cache-ce0b3e61-f8dd-487a-a81a-a466c45f0814" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Updating instance_info_cache with network_info: [{"id": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "address": "fa:16:3e:5b:20:cc", "network": {"id": "6e4d54dd-92e2-4e7f-a2d6-a4d46abe125a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478002396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b44f33bb08a547948df72daba2ec1722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4797cdcb-be", "ovs_interfaceid": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Releasing lock "refresh_cache-ce0b3e61-f8dd-487a-a81a-a466c45f0814" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Instance network_info: |[{"id": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "address": "fa:16:3e:5b:20:cc", "network": {"id": "6e4d54dd-92e2-4e7f-a2d6-a4d46abe125a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478002396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b44f33bb08a547948df72daba2ec1722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4797cdcb-be", "ovs_interfaceid": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-51efd62a-e763-478f-bc92-86fcda9a9ae1 req-d4c60ea7-ac38-4ee4-95f2-76682a6c03f8 service nova] Acquired lock "refresh_cache-ce0b3e61-f8dd-487a-a81a-a466c45f0814" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG nova.network.neutron [req-51efd62a-e763-478f-bc92-86fcda9a9ae1 req-d4c60ea7-ac38-4ee4-95f2-76682a6c03f8 service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Refreshing network info cache for port 4797cdcb-bed0-4fa7-af67-ab3d02b41977 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:33:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Start _get_guest_xml network_info=[{"id": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "address": "fa:16:3e:5b:20:cc", "network": {"id": "6e4d54dd-92e2-4e7f-a2d6-a4d46abe125a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478002396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b44f33bb08a547948df72daba2ec1722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4797cdcb-be", "ovs_interfaceid": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:33:53 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:33:53 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:33:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-468178569',display_name='tempest-TestServerVolumeAttachmentScenario-server-468178569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-468178569',id=36,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtDKr0/sFUzI2EpUlkm3puQrjPqbBi2KwD+6NPOtEnHFoQtVR4geRBmrn1lziQwyYgP1f4sHurbJhCKGIlz5QIDqf5KV1dzjL9EQ3ijMw5cNtVpCT6R9SgU8qfjE7MGnw==',key_name='tempest-keypair-1189558054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b44f33bb08a547948df72daba2ec1722',ramdisk_id='',reservation_id='r-8ydo45zr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-111905915',owner_user_name='tempest-TestServerVolumeAttachmentScenario-111905915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:33:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dad126ca4fd348ffb12f22ab05acc57f',uuid=ce0b3e61-f8dd-487a-a81a-a466c45f0814,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "address": "fa:16:3e:5b:20:cc", "network": {"id": "6e4d54dd-92e2-4e7f-a2d6-a4d46abe125a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478002396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b44f33bb08a547948df72daba2ec1722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4797cdcb-be", "ovs_interfaceid": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Converting VIF {"id": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "address": "fa:16:3e:5b:20:cc", "network": {"id": "6e4d54dd-92e2-4e7f-a2d6-a4d46abe125a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478002396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b44f33bb08a547948df72daba2ec1722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4797cdcb-be", "ovs_interfaceid": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:20:cc,bridge_name='br-int',has_traffic_filtering=True,id=4797cdcb-bed0-4fa7-af67-ab3d02b41977,network=Network(6e4d54dd-92e2-4e7f-a2d6-a4d46abe125a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4797cdcb-be') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lazy-loading 'pci_devices' on Instance uuid ce0b3e61-f8dd-487a-a81a-a466c45f0814 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:33:53 user nova-compute[75071]:   <uuid>ce0b3e61-f8dd-487a-a81a-a466c45f0814</uuid>
Dec 05 12:33:53 user nova-compute[75071]:   <name>instance-00000024</name>
Dec 05 12:33:53 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:33:53 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:33:53 user nova-compute[75071]:   <metadata>
Dec 05 12:33:53 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:33:53 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:33:53 user nova-compute[75071]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-468178569</nova:name>
Dec 05 12:33:53 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:33:53</nova:creationTime>
Dec 05 12:33:53 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:33:53 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:33:53 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:33:53 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:33:53 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:33:53 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:33:53 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:33:53 user nova-compute[75071]:       <nova:owner>
Dec 05 12:33:53 user nova-compute[75071]:         <nova:user uuid="dad126ca4fd348ffb12f22ab05acc57f">tempest-TestServerVolumeAttachmentScenario-111905915-project-member</nova:user>
Dec 05 12:33:53 user nova-compute[75071]:         <nova:project uuid="b44f33bb08a547948df72daba2ec1722">tempest-TestServerVolumeAttachmentScenario-111905915</nova:project>
Dec 05 12:33:53 user nova-compute[75071]:       </nova:owner>
Dec 05 12:33:53 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:33:53 user nova-compute[75071]:       <nova:ports>
Dec 05 12:33:53 user nova-compute[75071]:         <nova:port uuid="4797cdcb-bed0-4fa7-af67-ab3d02b41977">
Dec 05 12:33:53 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 05 12:33:53 user nova-compute[75071]:         </nova:port>
Dec 05 12:33:53 user nova-compute[75071]:       </nova:ports>
Dec 05 12:33:53 user nova-compute[75071]:     </nova:instance>
Dec 05 12:33:53 user nova-compute[75071]:   </metadata>
Dec 05 12:33:53 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:33:53 user nova-compute[75071]:     <system>
Dec 05 12:33:53 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:33:53 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:33:53 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:33:53 user nova-compute[75071]:       <entry name="serial">ce0b3e61-f8dd-487a-a81a-a466c45f0814</entry>
Dec 05 12:33:53 user nova-compute[75071]:       <entry name="uuid">ce0b3e61-f8dd-487a-a81a-a466c45f0814</entry>
Dec 05 12:33:53 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:33:53 user nova-compute[75071]:     </system>
Dec 05 12:33:53 user nova-compute[75071]:   </sysinfo>
Dec 05 12:33:53 user nova-compute[75071]:   <os>
Dec 05 12:33:53 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:33:53 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:33:53 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:33:53 user nova-compute[75071]:   </os>
Dec 05 12:33:53 user nova-compute[75071]:   <features>
Dec 05 12:33:53 user nova-compute[75071]:     <acpi/>
Dec 05 12:33:53 user nova-compute[75071]:     <apic/>
Dec 05 12:33:53 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:33:53 user nova-compute[75071]:   </features>
Dec 05 12:33:53 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:33:53 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:33:53 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:33:53 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:33:53 user nova-compute[75071]:   </clock>
Dec 05 12:33:53 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:33:53 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:33:53 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:33:53 user nova-compute[75071]:   </cpu>
Dec 05 12:33:53 user nova-compute[75071]:   <devices>
Dec 05 12:33:53 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:33:53 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:33:53 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk"/>
Dec 05 12:33:53 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:33:53 user nova-compute[75071]:     </disk>
Dec 05 12:33:53 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:33:53 user nova-compute[75071]:       <mac address="fa:16:3e:5b:20:cc"/>
Dec 05 12:33:53 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:33:53 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:33:53 user nova-compute[75071]:       <target dev="tap4797cdcb-be"/>
Dec 05 12:33:53 user nova-compute[75071]:     </interface>
Dec 05 12:33:53 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:33:53 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/console.log" append="off"/>
Dec 05 12:33:53 user nova-compute[75071]:     </serial>
Dec 05 12:33:53 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:33:53 user nova-compute[75071]:     <video>
Dec 05 12:33:53 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:33:53 user nova-compute[75071]:     </video>
Dec 05 12:33:53 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:33:53 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:33:53 user nova-compute[75071]:     </rng>
Dec 05 12:33:53 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:33:53 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:33:53 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:33:53 user nova-compute[75071]:     </memballoon>
Dec 05 12:33:53 user nova-compute[75071]:   </devices>
Dec 05 12:33:53 user nova-compute[75071]: </domain>
Dec 05 12:33:53 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:33:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-468178569',display_name='tempest-TestServerVolumeAttachmentScenario-server-468178569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-468178569',id=36,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtDKr0/sFUzI2EpUlkm3puQrjPqbBi2KwD+6NPOtEnHFoQtVR4geRBmrn1lziQwyYgP1f4sHurbJhCKGIlz5QIDqf5KV1dzjL9EQ3ijMw5cNtVpCT6R9SgU8qfjE7MGnw==',key_name='tempest-keypair-1189558054',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b44f33bb08a547948df72daba2ec1722',ramdisk_id='',reservation_id='r-8ydo45zr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-111905915',owner_user_name='tempest-TestServerVolumeAttachmentScenario-111905915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:33:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dad126ca4fd348ffb12f22ab05acc57f',uuid=ce0b3e61-f8dd-487a-a81a-a466c45f0814,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "address": "fa:16:3e:5b:20:cc", "network": {"id": "6e4d54dd-92e2-4e7f-a2d6-a4d46abe125a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478002396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b44f33bb08a547948df72daba2ec1722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4797cdcb-be", "ovs_interfaceid": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Converting VIF {"id": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "address": "fa:16:3e:5b:20:cc", "network": {"id": "6e4d54dd-92e2-4e7f-a2d6-a4d46abe125a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478002396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b44f33bb08a547948df72daba2ec1722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4797cdcb-be", "ovs_interfaceid": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:20:cc,bridge_name='br-int',has_traffic_filtering=True,id=4797cdcb-bed0-4fa7-af67-ab3d02b41977,network=Network(6e4d54dd-92e2-4e7f-a2d6-a4d46abe125a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4797cdcb-be') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG os_vif [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:20:cc,bridge_name='br-int',has_traffic_filtering=True,id=4797cdcb-bed0-4fa7-af67-ab3d02b41977,network=Network(6e4d54dd-92e2-4e7f-a2d6-a4d46abe125a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4797cdcb-be') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '077acf7b-257d-5de4-94ba-5c84684e1970', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4797cdcb-be, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4797cdcb-be, col_values=(('qos', UUID('ae7330f6-302b-4074-9bea-1f7452a7d441')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4797cdcb-be, col_values=(('external_ids', {'iface-id': '4797cdcb-bed0-4fa7-af67-ab3d02b41977', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:20:cc', 'vm-uuid': 'ce0b3e61-f8dd-487a-a81a-a466c45f0814'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:53 user nova-compute[75071]: INFO os_vif [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:20:cc,bridge_name='br-int',has_traffic_filtering=True,id=4797cdcb-bed0-4fa7-af67-ab3d02b41977,network=Network(6e4d54dd-92e2-4e7f-a2d6-a4d46abe125a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4797cdcb-be')
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] No VIF found with MAC fa:16:3e:5b:20:cc, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk.rescue --force-share --output=json" returned: 0 in 0.289s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.network.neutron [req-51efd62a-e763-478f-bc92-86fcda9a9ae1 req-d4c60ea7-ac38-4ee4-95f2-76682a6c03f8 service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Updated VIF entry in instance network info cache for port 4797cdcb-bed0-4fa7-af67-ab3d02b41977. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.network.neutron [req-51efd62a-e763-478f-bc92-86fcda9a9ae1 req-d4c60ea7-ac38-4ee4-95f2-76682a6c03f8 service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Updating instance_info_cache with network_info: [{"id": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "address": "fa:16:3e:5b:20:cc", "network": {"id": "6e4d54dd-92e2-4e7f-a2d6-a4d46abe125a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478002396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b44f33bb08a547948df72daba2ec1722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4797cdcb-be", "ovs_interfaceid": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-51efd62a-e763-478f-bc92-86fcda9a9ae1 req-d4c60ea7-ac38-4ee4-95f2-76682a6c03f8 service nova] Releasing lock "refresh_cache-ce0b3e61-f8dd-487a-a81a-a466c45f0814" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:33:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:33:54 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:33:54 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:33:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=7545MB free_disk=24.770336151123047GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:33:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e08be776-0fa9-4871-86eb-2093530c00f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:33:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:33:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:33:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:33:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:33:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance c2b46f1c-dce6-4436-8e1e-062ffda80732 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:33:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 43653273-2337-43a0-981a-e28d1ba26655 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:33:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 42776e73-1ef0-4c57-a50a-942f6f4881de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:33:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 015e89c3-73ad-4bfd-b55c-68323fae2b29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:33:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 78cdbf30-96bc-46ab-9bea-994ddb56165e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:33:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance ce0b3e61-f8dd-487a-a81a-a466c45f0814 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:33:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:33:54 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:33:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-5ed54db1-ce4c-44d2-88f9-3e6cb292dd0e req-56228aec-b37e-4a58-8dcc-0e7f6c05efb3 service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Received event network-vif-plugged-4797cdcb-bed0-4fa7-af67-ab3d02b41977 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:33:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5ed54db1-ce4c-44d2-88f9-3e6cb292dd0e req-56228aec-b37e-4a58-8dcc-0e7f6c05efb3 service nova] Acquiring lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5ed54db1-ce4c-44d2-88f9-3e6cb292dd0e req-56228aec-b37e-4a58-8dcc-0e7f6c05efb3 service nova] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5ed54db1-ce4c-44d2-88f9-3e6cb292dd0e req-56228aec-b37e-4a58-8dcc-0e7f6c05efb3 service nova] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-5ed54db1-ce4c-44d2-88f9-3e6cb292dd0e req-56228aec-b37e-4a58-8dcc-0e7f6c05efb3 service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] No waiting events found dispatching network-vif-plugged-4797cdcb-bed0-4fa7-af67-ab3d02b41977 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:33:55 user nova-compute[75071]: WARNING nova.compute.manager [req-5ed54db1-ce4c-44d2-88f9-3e6cb292dd0e req-56228aec-b37e-4a58-8dcc-0e7f6c05efb3 service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Received unexpected event network-vif-plugged-4797cdcb-bed0-4fa7-af67-ab3d02b41977 for instance with vm_state building and task_state spawning.
Dec 05 12:33:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:55 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:33:55 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:33:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:33:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.981s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:33:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:33:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:33:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:33:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:33:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:33:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:33:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:33:56 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Instance spawned successfully.
Dec 05 12:33:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:33:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:33:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:33:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:33:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:33:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:33:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:33:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-5a9569a3-9370-4bdf-8dae-bd00a96774a1 req-9e7103db-b319-40e8-ac54-4bdb37d54afc service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Received event network-vif-plugged-4797cdcb-bed0-4fa7-af67-ab3d02b41977 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:33:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5a9569a3-9370-4bdf-8dae-bd00a96774a1 req-9e7103db-b319-40e8-ac54-4bdb37d54afc service nova] Acquiring lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:33:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5a9569a3-9370-4bdf-8dae-bd00a96774a1 req-9e7103db-b319-40e8-ac54-4bdb37d54afc service nova] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:33:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5a9569a3-9370-4bdf-8dae-bd00a96774a1 req-9e7103db-b319-40e8-ac54-4bdb37d54afc service nova] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-5a9569a3-9370-4bdf-8dae-bd00a96774a1 req-9e7103db-b319-40e8-ac54-4bdb37d54afc service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] No waiting events found dispatching network-vif-plugged-4797cdcb-bed0-4fa7-af67-ab3d02b41977 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:33:56 user nova-compute[75071]: WARNING nova.compute.manager [req-5a9569a3-9370-4bdf-8dae-bd00a96774a1 req-9e7103db-b319-40e8-ac54-4bdb37d54afc service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Received unexpected event network-vif-plugged-4797cdcb-bed0-4fa7-af67-ab3d02b41977 for instance with vm_state building and task_state spawning.
Dec 05 12:33:56 user nova-compute[75071]: INFO nova.compute.manager [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Took 5.45 seconds to spawn the instance on the hypervisor.
Dec 05 12:33:56 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:33:57 user nova-compute[75071]: INFO nova.compute.manager [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Took 6.90 seconds to build instance.
Dec 05 12:33:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c53efd00-5bf3-4760-95f9-aff856761370 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.044s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:33:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:33:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:33:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:00 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:34:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:34:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:34:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:34:00 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:34:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Updating instance_info_cache with network_info: [{"id": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "address": "fa:16:3e:ee:3d:ba", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfb6b0b-8b", "ovs_interfaceid": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:34:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:34:01 user nova-compute[75071]: INFO nova.compute.manager [None req-0f9ae8ad-a777-4823-93d6-fc5d8ea01345 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Unrescuing
Dec 05 12:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0f9ae8ad-a777-4823-93d6-fc5d8ea01345 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "refresh_cache-42776e73-1ef0-4c57-a50a-942f6f4881de" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:34:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0f9ae8ad-a777-4823-93d6-fc5d8ea01345 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquired lock "refresh_cache-42776e73-1ef0-4c57-a50a-942f6f4881de" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:34:01 user nova-compute[75071]: DEBUG nova.network.neutron [None req-0f9ae8ad-a777-4823-93d6-fc5d8ea01345 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:34:02 user nova-compute[75071]: DEBUG nova.network.neutron [None req-0f9ae8ad-a777-4823-93d6-fc5d8ea01345 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Updating instance_info_cache with network_info: [{"id": "3774446d-0014-4060-b722-f3480e92a274", "address": "fa:16:3e:c9:ac:48", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3774446d-00", "ovs_interfaceid": "3774446d-0014-4060-b722-f3480e92a274", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:34:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0f9ae8ad-a777-4823-93d6-fc5d8ea01345 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Releasing lock "refresh_cache-42776e73-1ef0-4c57-a50a-942f6f4881de" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:34:02 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0f9ae8ad-a777-4823-93d6-fc5d8ea01345 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'flavor' on Instance uuid 42776e73-1ef0-4c57-a50a-942f6f4881de {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:34:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-1bb5c0cd-d42c-4ecf-b293-9a1e3361e9ec req-999d4213-503f-4043-a4bf-eafd32d35bde service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received event network-vif-unplugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:34:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1bb5c0cd-d42c-4ecf-b293-9a1e3361e9ec req-999d4213-503f-4043-a4bf-eafd32d35bde service nova] Acquiring lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1bb5c0cd-d42c-4ecf-b293-9a1e3361e9ec req-999d4213-503f-4043-a4bf-eafd32d35bde service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1bb5c0cd-d42c-4ecf-b293-9a1e3361e9ec req-999d4213-503f-4043-a4bf-eafd32d35bde service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-1bb5c0cd-d42c-4ecf-b293-9a1e3361e9ec req-999d4213-503f-4043-a4bf-eafd32d35bde service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] No waiting events found dispatching network-vif-unplugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:34:02 user nova-compute[75071]: WARNING nova.compute.manager [req-1bb5c0cd-d42c-4ecf-b293-9a1e3361e9ec req-999d4213-503f-4043-a4bf-eafd32d35bde service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received unexpected event network-vif-unplugged-3774446d-0014-4060-b722-f3480e92a274 for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:34:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:03 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Instance destroyed successfully.
Dec 05 12:34:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-e8905348-26be-4081-9f6c-752a23078143 req-e2808c06-a1bb-4f5e-bd69-2d1e90bc5903 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received event network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:34:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e8905348-26be-4081-9f6c-752a23078143 req-e2808c06-a1bb-4f5e-bd69-2d1e90bc5903 service nova] Acquiring lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e8905348-26be-4081-9f6c-752a23078143 req-e2808c06-a1bb-4f5e-bd69-2d1e90bc5903 service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e8905348-26be-4081-9f6c-752a23078143 req-e2808c06-a1bb-4f5e-bd69-2d1e90bc5903 service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-e8905348-26be-4081-9f6c-752a23078143 req-e2808c06-a1bb-4f5e-bd69-2d1e90bc5903 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] No waiting events found dispatching network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:34:05 user nova-compute[75071]: WARNING nova.compute.manager [req-e8905348-26be-4081-9f6c-752a23078143 req-e2808c06-a1bb-4f5e-bd69-2d1e90bc5903 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received unexpected event network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:34:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0f9ae8ad-a777-4823-93d6-fc5d8ea01345 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:34:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-84adf050-e428-4e48-ad5c-9f643bb5fae6 req-10e093be-607b-4b84-9275-ec998d0fba6a service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received event network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:34:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-84adf050-e428-4e48-ad5c-9f643bb5fae6 req-10e093be-607b-4b84-9275-ec998d0fba6a service nova] Acquiring lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-84adf050-e428-4e48-ad5c-9f643bb5fae6 req-10e093be-607b-4b84-9275-ec998d0fba6a service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-84adf050-e428-4e48-ad5c-9f643bb5fae6 req-10e093be-607b-4b84-9275-ec998d0fba6a service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-84adf050-e428-4e48-ad5c-9f643bb5fae6 req-10e093be-607b-4b84-9275-ec998d0fba6a service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] No waiting events found dispatching network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:34:07 user nova-compute[75071]: WARNING nova.compute.manager [req-84adf050-e428-4e48-ad5c-9f643bb5fae6 req-10e093be-607b-4b84-9275-ec998d0fba6a service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received unexpected event network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:34:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-84adf050-e428-4e48-ad5c-9f643bb5fae6 req-10e093be-607b-4b84-9275-ec998d0fba6a service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received event network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:34:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-84adf050-e428-4e48-ad5c-9f643bb5fae6 req-10e093be-607b-4b84-9275-ec998d0fba6a service nova] Acquiring lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-84adf050-e428-4e48-ad5c-9f643bb5fae6 req-10e093be-607b-4b84-9275-ec998d0fba6a service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-84adf050-e428-4e48-ad5c-9f643bb5fae6 req-10e093be-607b-4b84-9275-ec998d0fba6a service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-84adf050-e428-4e48-ad5c-9f643bb5fae6 req-10e093be-607b-4b84-9275-ec998d0fba6a service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] No waiting events found dispatching network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:34:07 user nova-compute[75071]: WARNING nova.compute.manager [req-84adf050-e428-4e48-ad5c-9f643bb5fae6 req-10e093be-607b-4b84-9275-ec998d0fba6a service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received unexpected event network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:34:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-0bd282cb-5649-4266-937e-31f91e0dee09 req-74802880-0f53-48e4-8d03-c751bc6e7640 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received event network-changed-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:34:14 user nova-compute[75071]: DEBUG nova.compute.manager [req-0bd282cb-5649-4266-937e-31f91e0dee09 req-74802880-0f53-48e4-8d03-c751bc6e7640 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Refreshing instance network info cache due to event network-changed-b2236786-98e2-461a-ba60-9ded45e0c725. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:34:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0bd282cb-5649-4266-937e-31f91e0dee09 req-74802880-0f53-48e4-8d03-c751bc6e7640 service nova] Acquiring lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:34:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0bd282cb-5649-4266-937e-31f91e0dee09 req-74802880-0f53-48e4-8d03-c751bc6e7640 service nova] Acquired lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:34:14 user nova-compute[75071]: DEBUG nova.network.neutron [req-0bd282cb-5649-4266-937e-31f91e0dee09 req-74802880-0f53-48e4-8d03-c751bc6e7640 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Refreshing network info cache for port b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:34:14 user nova-compute[75071]: DEBUG nova.network.neutron [req-0bd282cb-5649-4266-937e-31f91e0dee09 req-74802880-0f53-48e4-8d03-c751bc6e7640 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Updated VIF entry in instance network info cache for port b2236786-98e2-461a-ba60-9ded45e0c725. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:34:14 user nova-compute[75071]: DEBUG nova.network.neutron [req-0bd282cb-5649-4266-937e-31f91e0dee09 req-74802880-0f53-48e4-8d03-c751bc6e7640 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Updating instance_info_cache with network_info: [{"id": "b2236786-98e2-461a-ba60-9ded45e0c725", "address": "fa:16:3e:44:f4:af", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2236786-98", "ovs_interfaceid": "b2236786-98e2-461a-ba60-9ded45e0c725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:34:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0bd282cb-5649-4266-937e-31f91e0dee09 req-74802880-0f53-48e4-8d03-c751bc6e7640 service nova] Releasing lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:34:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "43653273-2337-43a0-981a-e28d1ba26655" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "43653273-2337-43a0-981a-e28d1ba26655" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:15 user nova-compute[75071]: INFO nova.compute.manager [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Detaching volume 6a6ed9b5-cb7f-4ab9-a405-f2532719657d
Dec 05 12:34:15 user nova-compute[75071]: INFO nova.virt.block_device [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Attempting to driver detach volume 6a6ed9b5-cb7f-4ab9-a405-f2532719657d from mountpoint /dev/vdb
Dec 05 12:34:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Attempting to detach device vdb from instance 43653273-2337-43a0-981a-e28d1ba26655 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:34:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:34:15 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:34:15 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:34:15 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:34:15 user nova-compute[75071]:   <serial>6a6ed9b5-cb7f-4ab9-a405-f2532719657d</serial>
Dec 05 12:34:15 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:34:15 user nova-compute[75071]: </disk>
Dec 05 12:34:15 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:34:15 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Successfully detached device vdb from instance 43653273-2337-43a0-981a-e28d1ba26655 from the persistent domain config.
Dec 05 12:34:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 43653273-2337-43a0-981a-e28d1ba26655 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:34:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:34:15 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:34:15 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:34:15 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:34:15 user nova-compute[75071]:   <serial>6a6ed9b5-cb7f-4ab9-a405-f2532719657d</serial>
Dec 05 12:34:15 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:34:15 user nova-compute[75071]: </disk>
Dec 05 12:34:15 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:34:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 43653273-2337-43a0-981a-e28d1ba26655 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:34:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-981c464f-a944-4a35-9d97-2a0d2f9bf29b req-a571531b-b89f-422a-afc5-8e63bc1da56a service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received event network-changed-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:34:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-981c464f-a944-4a35-9d97-2a0d2f9bf29b req-a571531b-b89f-422a-afc5-8e63bc1da56a service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Refreshing instance network info cache due to event network-changed-b2236786-98e2-461a-ba60-9ded45e0c725. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:34:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-981c464f-a944-4a35-9d97-2a0d2f9bf29b req-a571531b-b89f-422a-afc5-8e63bc1da56a service nova] Acquiring lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:34:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-981c464f-a944-4a35-9d97-2a0d2f9bf29b req-a571531b-b89f-422a-afc5-8e63bc1da56a service nova] Acquired lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:34:16 user nova-compute[75071]: DEBUG nova.network.neutron [req-981c464f-a944-4a35-9d97-2a0d2f9bf29b req-a571531b-b89f-422a-afc5-8e63bc1da56a service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Refreshing network info cache for port b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:34:16 user nova-compute[75071]: DEBUG nova.network.neutron [req-981c464f-a944-4a35-9d97-2a0d2f9bf29b req-a571531b-b89f-422a-afc5-8e63bc1da56a service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Updated VIF entry in instance network info cache for port b2236786-98e2-461a-ba60-9ded45e0c725. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:34:16 user nova-compute[75071]: DEBUG nova.network.neutron [req-981c464f-a944-4a35-9d97-2a0d2f9bf29b req-a571531b-b89f-422a-afc5-8e63bc1da56a service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Updating instance_info_cache with network_info: [{"id": "b2236786-98e2-461a-ba60-9ded45e0c725", "address": "fa:16:3e:44:f4:af", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2236786-98", "ovs_interfaceid": "b2236786-98e2-461a-ba60-9ded45e0c725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:34:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-981c464f-a944-4a35-9d97-2a0d2f9bf29b req-a571531b-b89f-422a-afc5-8e63bc1da56a service nova] Releasing lock "refresh_cache-43653273-2337-43a0-981a-e28d1ba26655" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:34:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "c2b46f1c-dce6-4436-8e1e-062ffda80732" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:22 user nova-compute[75071]: INFO nova.compute.manager [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Terminating instance
Dec 05 12:34:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-f00fe1c5-b066-4600-9000-f7e70df08563 req-1a3bc236-cca5-4cd9-b34a-9bf0c040337e service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Received event network-vif-unplugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f00fe1c5-b066-4600-9000-f7e70df08563 req-1a3bc236-cca5-4cd9-b34a-9bf0c040337e service nova] Acquiring lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f00fe1c5-b066-4600-9000-f7e70df08563 req-1a3bc236-cca5-4cd9-b34a-9bf0c040337e service nova] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f00fe1c5-b066-4600-9000-f7e70df08563 req-1a3bc236-cca5-4cd9-b34a-9bf0c040337e service nova] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-f00fe1c5-b066-4600-9000-f7e70df08563 req-1a3bc236-cca5-4cd9-b34a-9bf0c040337e service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] No waiting events found dispatching network-vif-unplugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-f00fe1c5-b066-4600-9000-f7e70df08563 req-1a3bc236-cca5-4cd9-b34a-9bf0c040337e service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Received event network-vif-unplugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:23 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Instance destroyed successfully.
Dec 05 12:34:23 user nova-compute[75071]: DEBUG nova.objects.instance [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lazy-loading 'resources' on Instance uuid c2b46f1c-dce6-4436-8e1e-062ffda80732 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:27:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-838854064',display_name='tempest-ServerActionsTestOtherA-server-838854064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-838854064',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr4CxHIGILJKylwCAW1k5g9hHm3DpT3NJj15aFaT5zmT7LmQxPRChXNHnUJDBNGMOIF2KjOMuY9sG7Diwqrmevv8WAXt0F+z6Y+uzBIRaBoBEcSXjeLaXdD3Dv6NXOVGQ==',key_name='tempest-keypair-237629817',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:29:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59b6bfae34944fcfbd49d2f18b232ec8',ramdisk_id='',reservation_id='r-34l73x5j',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1523780015',owner_user_name='tempest-ServerActionsTestOtherA-1523780015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:31:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e73e24d5b1489c813f06690b12eef4',uuid=c2b46f1c-dce6-4436-8e1e-062ffda80732,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converting VIF {"id": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "address": "fa:16:3e:39:95:8a", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a7fb9d1-89", "ovs_interfaceid": "0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7fb9d1-89') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG os_vif [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7fb9d1-89') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a7fb9d1-89, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a36ff4d9-b891-47b0-9061-a8be6da27f36) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:23 user nova-compute[75071]: INFO os_vif [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:95:8a,bridge_name='br-int',has_traffic_filtering=True,id=0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a7fb9d1-89')
Dec 05 12:34:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMDuqjzy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:34:23 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:34:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[299482d3-47c1-4c89-bad1-132ad3b3f51d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:34:23 user nova-compute[75071]: No targets found.
Dec 05 12:34:23 user nova-compute[75071]: iSNS:
Dec 05 12:34:23 user nova-compute[75071]: No targets found.
Dec 05 12:34:23 user nova-compute[75071]: STATIC:
Dec 05 12:34:23 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c
Dec 05 12:34:23 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:34:23 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:34:23 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:34:23 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:34:23 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:34:23 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0
Dec 05 12:34:23 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:34:23 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:34:23 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d
Dec 05 12:34:23 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:34:23 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:34:23 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77
Dec 05 12:34:23 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:34:23 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:34:23 user nova-compute[75071]: FIRMWARE:
Dec 05 12:34:23 user nova-compute[75071]: No targets found.
Dec 05 12:34:23 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:34:23 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:34:23 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ec3275-55e2-407c-9291-51d070016a1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95780fb-534d-4778-b0e6-14ad76d2399c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:34:23 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:34:23 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:34:23 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d (non-flash)
Dec 05 12:34:23 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)
Dec 05 12:34:23 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:34:23 user nova-compute[75071]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 (non-flash)
Dec 05 12:34:23 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:34:23 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d (non-flash)
Dec 05 12:34:23 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)
Dec 05 12:34:23 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f826412cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0'): ({'sde'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Removing single pathed devices sde {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[745dabeb-66a9-40ab-8553-9d80065d2900]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f362d31-9672-443b-8531-2a11a09f9a77]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Flushing IO for device /dev/sde {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[694f2000-9c21-4970-8b1e-c2b98a659bbb]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.076s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1280d18-fa90-470b-8a82-a84b1f0f096a]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[02572516-a32d-4f4d-9105-d4a80c675bd6]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[338c09fb-7d77-4543-9594-d5549bbd1f17]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0, portal: 172.16.0.220,3260]
Dec 05 12:34:24 user nova-compute[75071]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0, portal: 172.16.0.220,3260] successful.
Dec 05 12:34:24 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ec07bbd-2382-4b77-9612-c773344113f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[270d90c5-2099-4cd7-88bf-e4bbd78d84df]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] <== disconnect_volume: return (357ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:34:24 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Deleting instance files /opt/stack/data/nova/instances/c2b46f1c-dce6-4436-8e1e-062ffda80732_del
Dec 05 12:34:24 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Deletion of /opt/stack/data/nova/instances/c2b46f1c-dce6-4436-8e1e-062ffda80732_del complete
Dec 05 12:34:24 user nova-compute[75071]: INFO nova.compute.manager [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Took 1.22 seconds to destroy the instance on the hypervisor.
Dec 05 12:34:24 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:34:24 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:34:25 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:34:25 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Took 0.84 seconds to deallocate network for instance.
Dec 05 12:34:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-db911a29-0e66-4a92-abb8-78a3fff07fa9 req-60473006-8971-43da-8afe-b6be18237964 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Received event network-vif-plugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:34:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-db911a29-0e66-4a92-abb8-78a3fff07fa9 req-60473006-8971-43da-8afe-b6be18237964 service nova] Acquiring lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-db911a29-0e66-4a92-abb8-78a3fff07fa9 req-60473006-8971-43da-8afe-b6be18237964 service nova] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-db911a29-0e66-4a92-abb8-78a3fff07fa9 req-60473006-8971-43da-8afe-b6be18237964 service nova] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-db911a29-0e66-4a92-abb8-78a3fff07fa9 req-60473006-8971-43da-8afe-b6be18237964 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] No waiting events found dispatching network-vif-plugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:34:25 user nova-compute[75071]: WARNING nova.compute.manager [req-db911a29-0e66-4a92-abb8-78a3fff07fa9 req-60473006-8971-43da-8afe-b6be18237964 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Received unexpected event network-vif-plugged-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 for instance with vm_state active and task_state deleting.
Dec 05 12:34:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-db911a29-0e66-4a92-abb8-78a3fff07fa9 req-60473006-8971-43da-8afe-b6be18237964 service nova] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Received event network-vif-deleted-0a7fb9d1-89fb-45ce-a6a8-7b32d1e90258 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:34:25 user nova-compute[75071]: INFO nova.compute.manager [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Took 0.81 seconds to detach 1 volumes for instance.
Dec 05 12:34:25 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: c2b46f1c-dce6-4436-8e1e-062ffda80732] Deleting volume: 8ec07bbd-2382-4b77-9612-c773344113f0 {{(pid=75071) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 05 12:34:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:26 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:34:26 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:34:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:26 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Deleted allocations for instance c2b46f1c-dce6-4436-8e1e-062ffda80732
Dec 05 12:34:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8427c041-7c65-48f6-a2da-64575c37116a tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "c2b46f1c-dce6-4436-8e1e-062ffda80732" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.525s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "77c962a7-587a-41be-b87d-ab416b8b43fd" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:31 user nova-compute[75071]: INFO nova.compute.manager [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Unshelving
Dec 05 12:34:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:31 user nova-compute[75071]: DEBUG nova.objects.instance [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'pci_requests' on Instance uuid 77c962a7-587a-41be-b87d-ab416b8b43fd {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:34:31 user nova-compute[75071]: DEBUG nova.objects.instance [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'numa_topology' on Instance uuid 77c962a7-587a-41be-b87d-ab416b8b43fd {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:34:31 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:34:31 user nova-compute[75071]: INFO nova.compute.claims [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Claim successful on node user
Dec 05 12:34:31 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:34:31 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:34:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:32 user nova-compute[75071]: INFO nova.network.neutron [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Updating port 52df8e8e-e80a-4f0a-b496-63771b5e63a7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 05 12:34:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:34:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquired lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:34:32 user nova-compute[75071]: DEBUG nova.network.neutron [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:34:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-fdaccbfd-f0c4-425c-93d4-102a7686f333 req-6dae3c64-192a-4965-8849-5ebfc6035cd8 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received event network-changed-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:34:32 user nova-compute[75071]: DEBUG nova.compute.manager [req-fdaccbfd-f0c4-425c-93d4-102a7686f333 req-6dae3c64-192a-4965-8849-5ebfc6035cd8 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Refreshing instance network info cache due to event network-changed-52df8e8e-e80a-4f0a-b496-63771b5e63a7. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:34:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fdaccbfd-f0c4-425c-93d4-102a7686f333 req-6dae3c64-192a-4965-8849-5ebfc6035cd8 service nova] Acquiring lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:34:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Updating instance_info_cache with network_info: [{"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:34:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Releasing lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:34:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:34:33 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Creating image(s)
Dec 05 12:34:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "/opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "/opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "/opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:33 user nova-compute[75071]: DEBUG nova.objects.instance [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'trusted_certs' on Instance uuid 77c962a7-587a-41be-b87d-ab416b8b43fd {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:34:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fdaccbfd-f0c4-425c-93d4-102a7686f333 req-6dae3c64-192a-4965-8849-5ebfc6035cd8 service nova] Acquired lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:34:33 user nova-compute[75071]: DEBUG nova.network.neutron [req-fdaccbfd-f0c4-425c-93d4-102a7686f333 req-6dae3c64-192a-4965-8849-5ebfc6035cd8 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Refreshing network info cache for port 52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:34:33 user nova-compute[75071]: DEBUG nova.objects.base [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Object Instance<77c962a7-587a-41be-b87d-ab416b8b43fd> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:34:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "992007aef39172abdffec43719adec38c8ee42d6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "992007aef39172abdffec43719adec38c8ee42d6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/992007aef39172abdffec43719adec38c8ee42d6.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/992007aef39172abdffec43719adec38c8ee42d6.part --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:34 user nova-compute[75071]: DEBUG nova.virt.images [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] 783a7c27-04a5-402d-a066-681fbaee348e was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 12:34:34 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 12:34:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/992007aef39172abdffec43719adec38c8ee42d6.part /opt/stack/data/nova/instances/_base/992007aef39172abdffec43719adec38c8ee42d6.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:34 user nova-compute[75071]: DEBUG nova.network.neutron [req-fdaccbfd-f0c4-425c-93d4-102a7686f333 req-6dae3c64-192a-4965-8849-5ebfc6035cd8 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Updated VIF entry in instance network info cache for port 52df8e8e-e80a-4f0a-b496-63771b5e63a7. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:34:34 user nova-compute[75071]: DEBUG nova.network.neutron [req-fdaccbfd-f0c4-425c-93d4-102a7686f333 req-6dae3c64-192a-4965-8849-5ebfc6035cd8 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Updating instance_info_cache with network_info: [{"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:34:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fdaccbfd-f0c4-425c-93d4-102a7686f333 req-6dae3c64-192a-4965-8849-5ebfc6035cd8 service nova] Releasing lock "refresh_cache-77c962a7-587a-41be-b87d-ab416b8b43fd" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:34:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/992007aef39172abdffec43719adec38c8ee42d6.part /opt/stack/data/nova/instances/_base/992007aef39172abdffec43719adec38c8ee42d6.converted" returned: 0 in 0.344s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/992007aef39172abdffec43719adec38c8ee42d6.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/992007aef39172abdffec43719adec38c8ee42d6.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "992007aef39172abdffec43719adec38c8ee42d6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.679s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/992007aef39172abdffec43719adec38c8ee42d6 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/992007aef39172abdffec43719adec38c8ee42d6 --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "992007aef39172abdffec43719adec38c8ee42d6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "992007aef39172abdffec43719adec38c8ee42d6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/992007aef39172abdffec43719adec38c8ee42d6 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/992007aef39172abdffec43719adec38c8ee42d6 --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/992007aef39172abdffec43719adec38c8ee42d6,backing_fmt=raw /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/992007aef39172abdffec43719adec38c8ee42d6,backing_fmt=raw /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk 1073741824" returned: 0 in 0.058s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "992007aef39172abdffec43719adec38c8ee42d6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/992007aef39172abdffec43719adec38c8ee42d6 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:35 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 43653273-2337-43a0-981a-e28d1ba26655 is timed out.
Dec 05 12:34:35 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Successfully detached device vdb from instance 43653273-2337-43a0-981a-e28d1ba26655 from the live domain config.
Dec 05 12:34:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iPmAURvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:34:35 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:34:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/992007aef39172abdffec43719adec38c8ee42d6 --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG nova.objects.instance [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'migration_context' on Instance uuid 77c962a7-587a-41be-b87d-ab416b8b43fd {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG nova.objects.base [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Object Instance<77c962a7-587a-41be-b87d-ab416b8b43fd> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:34:35 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Rebasing disk image.
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[41361292-df62-403c-9312-b0de9440c04c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:34:35 user nova-compute[75071]: No targets found.
Dec 05 12:34:35 user nova-compute[75071]: iSNS:
Dec 05 12:34:35 user nova-compute[75071]: No targets found.
Dec 05 12:34:35 user nova-compute[75071]: STATIC:
Dec 05 12:34:35 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c
Dec 05 12:34:35 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:34:35 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:34:35 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:34:35 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:34:35 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:34:35 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d
Dec 05 12:34:35 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:34:35 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:34:35 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77
Dec 05 12:34:35 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:34:35 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:34:35 user nova-compute[75071]: FIRMWARE:
Dec 05 12:34:35 user nova-compute[75071]: No targets found.
Dec 05 12:34:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:34:35 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:34:35 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d814b7cc-aac2-406e-a671-bb085d975632]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec30ec62-18c9-4b24-9a07-13227d8e6796]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:34:35 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:34:35 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d (non-flash)
Dec 05 12:34:35 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)
Dec 05 12:34:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:34:35 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:34:35 user nova-compute[75071]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d (non-flash)
Dec 05 12:34:35 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)
Dec 05 12:34:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f826412eef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[125a6cf2-11f1-4bc1-b0d0-1bbf406e1b7a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7d5f5a-30cf-469e-8851-859064a38394]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[26035668-f6d9-4227-8c0c-8731390e608d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 -F raw /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d7651b-a1c1-4889-829d-0aefcd212b16]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[262cc45f-6af4-466d-994d-f2e9596964c2]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a58683-0cd5-496f-8155-5743bf26a690]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d, portal: 172.16.0.220,3260]
Dec 05 12:34:36 user nova-compute[75071]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d, portal: 172.16.0.220,3260] successful.
Dec 05 12:34:36 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a6ed9b5-cb7f-4ab9-a405-f2532719657d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[90184446-9efc-4bde-9540-ed1ed59388c4]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] <== disconnect_volume: return (370ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:34:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.objects.instance [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lazy-loading 'flavor' on Instance uuid 43653273-2337-43a0-981a-e28d1ba26655 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5bbd7b9e-a29b-4c2d-8c4e-153f94bea040 tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "43653273-2337-43a0-981a-e28d1ba26655" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.014s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 -F raw /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk" returned: 0 in 1.945s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Ensure instance console log exists: /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Start _get_guest_xml network_info=[{"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='4d2b8a7d476706f476e38caf5e65eac9',container_format='bare',created_at=2023-12-05T12:32:39Z,direct_url=<?>,disk_format='qcow2',id=783a7c27-04a5-402d-a066-681fbaee348e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1984475382-shelved',owner='36cda9a88b434e66ad6d8ac75790d141',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-05T12:32:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:34:37 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:34:37 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4d2b8a7d476706f476e38caf5e65eac9',container_format='bare',created_at=2023-12-05T12:32:39Z,direct_url=<?>,disk_format='qcow2',id=783a7c27-04a5-402d-a066-681fbaee348e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1984475382-shelved',owner='36cda9a88b434e66ad6d8ac75790d141',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-05T12:32:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.objects.instance [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'vcpu_model' on Instance uuid 77c962a7-587a-41be-b87d-ab416b8b43fd {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:34:37 user nova-compute[75071]: DEBUG nova.objects.base [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Object Instance<77c962a7-587a-41be-b87d-ab416b8b43fd> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T12:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1984475382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1984475382',id=33,image_ref='783a7c27-04a5-402d-a066-681fbaee348e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1201033063',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:30:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='36cda9a88b434e66ad6d8ac75790d141',ramdisk_id='',reservation_id='r-clu35i2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1822750901',owner_user_name='tempest-AttachVolumeShelveTestJSON-1822750901-project-member',shelved_at='2023-12-05T12:32:43.613366',shelved_host='user',shelved_image_id='783a7c27-04a5-402d-a066-681fbaee348e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:34:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a70218d8181040818ed8290e743bd2db',uuid=77c962a7-587a-41be-b87d-ab416b8b43fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converting VIF {"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:34:f9,bridge_name='br-int',has_traffic_filtering=True,id=52df8e8e-e80a-4f0a-b496-63771b5e63a7,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52df8e8e-e8') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG nova.objects.instance [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'pci_devices' on Instance uuid 77c962a7-587a-41be-b87d-ab416b8b43fd {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG nova.objects.base [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Object Instance<77c962a7-587a-41be-b87d-ab416b8b43fd> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:34:38 user nova-compute[75071]:   <uuid>77c962a7-587a-41be-b87d-ab416b8b43fd</uuid>
Dec 05 12:34:38 user nova-compute[75071]:   <name>instance-00000021</name>
Dec 05 12:34:38 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:34:38 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:34:38 user nova-compute[75071]:   <metadata>
Dec 05 12:34:38 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:34:38 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:34:38 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1984475382</nova:name>
Dec 05 12:34:38 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:34:37</nova:creationTime>
Dec 05 12:34:38 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:34:38 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:34:38 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:34:38 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:34:38 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:34:38 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:34:38 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:34:38 user nova-compute[75071]:       <nova:owner>
Dec 05 12:34:38 user nova-compute[75071]:         <nova:user uuid="a70218d8181040818ed8290e743bd2db">tempest-AttachVolumeShelveTestJSON-1822750901-project-member</nova:user>
Dec 05 12:34:38 user nova-compute[75071]:         <nova:project uuid="36cda9a88b434e66ad6d8ac75790d141">tempest-AttachVolumeShelveTestJSON-1822750901</nova:project>
Dec 05 12:34:38 user nova-compute[75071]:       </nova:owner>
Dec 05 12:34:38 user nova-compute[75071]:       <nova:root type="image" uuid="783a7c27-04a5-402d-a066-681fbaee348e"/>
Dec 05 12:34:38 user nova-compute[75071]:       <nova:ports>
Dec 05 12:34:38 user nova-compute[75071]:         <nova:port uuid="52df8e8e-e80a-4f0a-b496-63771b5e63a7">
Dec 05 12:34:38 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 12:34:38 user nova-compute[75071]:         </nova:port>
Dec 05 12:34:38 user nova-compute[75071]:       </nova:ports>
Dec 05 12:34:38 user nova-compute[75071]:     </nova:instance>
Dec 05 12:34:38 user nova-compute[75071]:   </metadata>
Dec 05 12:34:38 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:34:38 user nova-compute[75071]:     <system>
Dec 05 12:34:38 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:34:38 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:34:38 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:34:38 user nova-compute[75071]:       <entry name="serial">77c962a7-587a-41be-b87d-ab416b8b43fd</entry>
Dec 05 12:34:38 user nova-compute[75071]:       <entry name="uuid">77c962a7-587a-41be-b87d-ab416b8b43fd</entry>
Dec 05 12:34:38 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:34:38 user nova-compute[75071]:     </system>
Dec 05 12:34:38 user nova-compute[75071]:   </sysinfo>
Dec 05 12:34:38 user nova-compute[75071]:   <os>
Dec 05 12:34:38 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:34:38 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:34:38 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:34:38 user nova-compute[75071]:   </os>
Dec 05 12:34:38 user nova-compute[75071]:   <features>
Dec 05 12:34:38 user nova-compute[75071]:     <acpi/>
Dec 05 12:34:38 user nova-compute[75071]:     <apic/>
Dec 05 12:34:38 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:34:38 user nova-compute[75071]:   </features>
Dec 05 12:34:38 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:34:38 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:34:38 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:34:38 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:34:38 user nova-compute[75071]:   </clock>
Dec 05 12:34:38 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:34:38 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:34:38 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:34:38 user nova-compute[75071]:   </cpu>
Dec 05 12:34:38 user nova-compute[75071]:   <devices>
Dec 05 12:34:38 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:34:38 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:34:38 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk"/>
Dec 05 12:34:38 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:34:38 user nova-compute[75071]:     </disk>
Dec 05 12:34:38 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:34:38 user nova-compute[75071]:       <mac address="fa:16:3e:c6:34:f9"/>
Dec 05 12:34:38 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:34:38 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:34:38 user nova-compute[75071]:       <target dev="tap52df8e8e-e8"/>
Dec 05 12:34:38 user nova-compute[75071]:     </interface>
Dec 05 12:34:38 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:34:38 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/console.log" append="off"/>
Dec 05 12:34:38 user nova-compute[75071]:     </serial>
Dec 05 12:34:38 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:34:38 user nova-compute[75071]:     <video>
Dec 05 12:34:38 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:34:38 user nova-compute[75071]:     </video>
Dec 05 12:34:38 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:34:38 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:34:38 user nova-compute[75071]:     </rng>
Dec 05 12:34:38 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:34:38 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:34:38 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:34:38 user nova-compute[75071]:     </memballoon>
Dec 05 12:34:38 user nova-compute[75071]:   </devices>
Dec 05 12:34:38 user nova-compute[75071]: </domain>
Dec 05 12:34:38 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T12:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1984475382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1984475382',id=33,image_ref='783a7c27-04a5-402d-a066-681fbaee348e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1201033063',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:30:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='36cda9a88b434e66ad6d8ac75790d141',ramdisk_id='',reservation_id='r-clu35i2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1822750901',owner_user_name='tempest-AttachVolumeShelveTestJSON-1822750901-project-member',shelved_at='2023-12-05T12:32:43.613366',shelved_host='user',shelved_image_id='783a7c27-04a5-402d-a066-681fbaee348e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:34:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a70218d8181040818ed8290e743bd2db',uuid=77c962a7-587a-41be-b87d-ab416b8b43fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converting VIF {"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:34:f9,bridge_name='br-int',has_traffic_filtering=True,id=52df8e8e-e80a-4f0a-b496-63771b5e63a7,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52df8e8e-e8') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG os_vif [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:34:f9,bridge_name='br-int',has_traffic_filtering=True,id=52df8e8e-e80a-4f0a-b496-63771b5e63a7,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52df8e8e-e8') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '980f257b-62ef-53ab-bc94-46e99d55cb79', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap52df8e8e-e8, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap52df8e8e-e8, col_values=(('qos', UUID('ac4cfe28-2666-40d5-bcc1-2d9bac28b7f2')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap52df8e8e-e8, col_values=(('external_ids', {'iface-id': '52df8e8e-e80a-4f0a-b496-63771b5e63a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:34:f9', 'vm-uuid': '77c962a7-587a-41be-b87d-ab416b8b43fd'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:38 user nova-compute[75071]: INFO os_vif [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:34:f9,bridge_name='br-int',has_traffic_filtering=True,id=52df8e8e-e80a-4f0a-b496-63771b5e63a7,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52df8e8e-e8')
Dec 05 12:34:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:34:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] No VIF found with MAC fa:16:3e:c6:34:f9, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:34:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-18501381-ad7a-4e8d-96b3-06985deb1aa6 req-b926a7b0-77e9-456c-b5a9-32a9c35142bf service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received event network-vif-plugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:34:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-18501381-ad7a-4e8d-96b3-06985deb1aa6 req-b926a7b0-77e9-456c-b5a9-32a9c35142bf service nova] Acquiring lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-18501381-ad7a-4e8d-96b3-06985deb1aa6 req-b926a7b0-77e9-456c-b5a9-32a9c35142bf service nova] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-18501381-ad7a-4e8d-96b3-06985deb1aa6 req-b926a7b0-77e9-456c-b5a9-32a9c35142bf service nova] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-18501381-ad7a-4e8d-96b3-06985deb1aa6 req-b926a7b0-77e9-456c-b5a9-32a9c35142bf service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] No waiting events found dispatching network-vif-plugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:34:39 user nova-compute[75071]: WARNING nova.compute.manager [req-18501381-ad7a-4e8d-96b3-06985deb1aa6 req-b926a7b0-77e9-456c-b5a9-32a9c35142bf service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received unexpected event network-vif-plugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 05 12:34:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:34:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:34:41 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Instance spawned successfully.
Dec 05 12:34:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-9a9acb9e-c1fc-45f4-9b58-740ceca5ba51 req-caaa3b5c-3b33-446d-b8fa-3a37afcd388f service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received event network-vif-plugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:34:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9a9acb9e-c1fc-45f4-9b58-740ceca5ba51 req-caaa3b5c-3b33-446d-b8fa-3a37afcd388f service nova] Acquiring lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9a9acb9e-c1fc-45f4-9b58-740ceca5ba51 req-caaa3b5c-3b33-446d-b8fa-3a37afcd388f service nova] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9a9acb9e-c1fc-45f4-9b58-740ceca5ba51 req-caaa3b5c-3b33-446d-b8fa-3a37afcd388f service nova] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:41 user nova-compute[75071]: DEBUG nova.compute.manager [req-9a9acb9e-c1fc-45f4-9b58-740ceca5ba51 req-caaa3b5c-3b33-446d-b8fa-3a37afcd388f service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] No waiting events found dispatching network-vif-plugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:34:41 user nova-compute[75071]: WARNING nova.compute.manager [req-9a9acb9e-c1fc-45f4-9b58-740ceca5ba51 req-caaa3b5c-3b33-446d-b8fa-3a37afcd388f service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received unexpected event network-vif-plugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 05 12:34:42 user nova-compute[75071]: INFO nova.compute.manager [None req-5a5a68be-5e5b-4fc3-bfc1-f2d20996a688 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Unrescuing
Dec 05 12:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5a5a68be-5e5b-4fc3-bfc1-f2d20996a688 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5a5a68be-5e5b-4fc3-bfc1-f2d20996a688 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquired lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:34:42 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5a5a68be-5e5b-4fc3-bfc1-f2d20996a688 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:34:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-05fecf8f-01eb-4825-acf3-fe535f7850d8 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.864s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:42 user nova-compute[75071]: DEBUG nova.network.neutron [None req-5a5a68be-5e5b-4fc3-bfc1-f2d20996a688 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Updating instance_info_cache with network_info: [{"id": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "address": "fa:16:3e:40:8d:36", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf98e48b-bb", "ovs_interfaceid": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-5a5a68be-5e5b-4fc3-bfc1-f2d20996a688 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Releasing lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:34:42 user nova-compute[75071]: DEBUG nova.objects.instance [None req-5a5a68be-5e5b-4fc3-bfc1-f2d20996a688 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'flavor' on Instance uuid 015e89c3-73ad-4bfd-b55c-68323fae2b29 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:34:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-dc702318-9767-45e3-b175-c5cdd4cfa0c3 req-d5119a22-d403-40b2-b05c-3b95baa346bd service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received event network-vif-unplugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dc702318-9767-45e3-b175-c5cdd4cfa0c3 req-d5119a22-d403-40b2-b05c-3b95baa346bd service nova] Acquiring lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dc702318-9767-45e3-b175-c5cdd4cfa0c3 req-d5119a22-d403-40b2-b05c-3b95baa346bd service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dc702318-9767-45e3-b175-c5cdd4cfa0c3 req-d5119a22-d403-40b2-b05c-3b95baa346bd service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-dc702318-9767-45e3-b175-c5cdd4cfa0c3 req-d5119a22-d403-40b2-b05c-3b95baa346bd service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] No waiting events found dispatching network-vif-unplugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:34:42 user nova-compute[75071]: WARNING nova.compute.manager [req-dc702318-9767-45e3-b175-c5cdd4cfa0c3 req-d5119a22-d403-40b2-b05c-3b95baa346bd service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received unexpected event network-vif-unplugged-bf98e48b-bb55-447a-88ce-caed2d082b9b for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:34:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Instance destroyed successfully.
Dec 05 12:34:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-c08ae54c-1799-4c1c-9c9c-1417273ccb5e req-a6df0bb4-43d4-40d5-8fbb-fa4df6810ea5 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received event network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:34:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c08ae54c-1799-4c1c-9c9c-1417273ccb5e req-a6df0bb4-43d4-40d5-8fbb-fa4df6810ea5 service nova] Acquiring lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c08ae54c-1799-4c1c-9c9c-1417273ccb5e req-a6df0bb4-43d4-40d5-8fbb-fa4df6810ea5 service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c08ae54c-1799-4c1c-9c9c-1417273ccb5e req-a6df0bb4-43d4-40d5-8fbb-fa4df6810ea5 service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-c08ae54c-1799-4c1c-9c9c-1417273ccb5e req-a6df0bb4-43d4-40d5-8fbb-fa4df6810ea5 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] No waiting events found dispatching network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:34:45 user nova-compute[75071]: WARNING nova.compute.manager [req-c08ae54c-1799-4c1c-9c9c-1417273ccb5e req-a6df0bb4-43d4-40d5-8fbb-fa4df6810ea5 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received unexpected event network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:34:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-c08ae54c-1799-4c1c-9c9c-1417273ccb5e req-a6df0bb4-43d4-40d5-8fbb-fa4df6810ea5 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received event network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:34:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c08ae54c-1799-4c1c-9c9c-1417273ccb5e req-a6df0bb4-43d4-40d5-8fbb-fa4df6810ea5 service nova] Acquiring lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c08ae54c-1799-4c1c-9c9c-1417273ccb5e req-a6df0bb4-43d4-40d5-8fbb-fa4df6810ea5 service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c08ae54c-1799-4c1c-9c9c-1417273ccb5e req-a6df0bb4-43d4-40d5-8fbb-fa4df6810ea5 service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-c08ae54c-1799-4c1c-9c9c-1417273ccb5e req-a6df0bb4-43d4-40d5-8fbb-fa4df6810ea5 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] No waiting events found dispatching network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:34:45 user nova-compute[75071]: WARNING nova.compute.manager [req-c08ae54c-1799-4c1c-9c9c-1417273ccb5e req-a6df0bb4-43d4-40d5-8fbb-fa4df6810ea5 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received unexpected event network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:34:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-5a5a68be-5e5b-4fc3-bfc1-f2d20996a688 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:34:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-859607ec-0df4-4b55-a288-3c4a60c17a50 req-5480a480-48d0-4d38-8a1b-a2cd5b685de7 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received event network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:34:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-859607ec-0df4-4b55-a288-3c4a60c17a50 req-5480a480-48d0-4d38-8a1b-a2cd5b685de7 service nova] Acquiring lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-859607ec-0df4-4b55-a288-3c4a60c17a50 req-5480a480-48d0-4d38-8a1b-a2cd5b685de7 service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-859607ec-0df4-4b55-a288-3c4a60c17a50 req-5480a480-48d0-4d38-8a1b-a2cd5b685de7 service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-859607ec-0df4-4b55-a288-3c4a60c17a50 req-5480a480-48d0-4d38-8a1b-a2cd5b685de7 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] No waiting events found dispatching network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:34:47 user nova-compute[75071]: WARNING nova.compute.manager [req-859607ec-0df4-4b55-a288-3c4a60c17a50 req-5480a480-48d0-4d38-8a1b-a2cd5b685de7 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received unexpected event network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b for instance with vm_state active and task_state None.
Dec 05 12:34:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:51 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:34:51 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:34:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:51 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:34:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:52 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:34:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:34:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:34:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:34:56 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:34:56 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:34:56 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=7799MB free_disk=24.706924438476562GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:34:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:56 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e08be776-0fa9-4871-86eb-2093530c00f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:34:56 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:34:56 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:34:56 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:34:56 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:34:56 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 43653273-2337-43a0-981a-e28d1ba26655 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:34:56 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 42776e73-1ef0-4c57-a50a-942f6f4881de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:34:56 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 015e89c3-73ad-4bfd-b55c-68323fae2b29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:34:56 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 78cdbf30-96bc-46ab-9bea-994ddb56165e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:34:56 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance ce0b3e61-f8dd-487a-a81a-a466c45f0814 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:34:56 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 77c962a7-587a-41be-b87d-ab416b8b43fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:34:56 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:34:56 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Acquiring lock "78cdbf30-96bc-46ab-9bea-994ddb56165e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Lock "78cdbf30-96bc-46ab-9bea-994ddb56165e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Acquiring lock "78cdbf30-96bc-46ab-9bea-994ddb56165e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Lock "78cdbf30-96bc-46ab-9bea-994ddb56165e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Lock "78cdbf30-96bc-46ab-9bea-994ddb56165e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:57 user nova-compute[75071]: INFO nova.compute.manager [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Terminating instance
Dec 05 12:34:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.527s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-282e95b2-4610-45e2-b487-e424398ad94a req-40408c9c-80c2-4935-97da-9fdf83b19b45 service nova] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Received event network-vif-unplugged-dacdecc3-2aab-4979-bb6b-5f82c82b00a0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-282e95b2-4610-45e2-b487-e424398ad94a req-40408c9c-80c2-4935-97da-9fdf83b19b45 service nova] Acquiring lock "78cdbf30-96bc-46ab-9bea-994ddb56165e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-282e95b2-4610-45e2-b487-e424398ad94a req-40408c9c-80c2-4935-97da-9fdf83b19b45 service nova] Lock "78cdbf30-96bc-46ab-9bea-994ddb56165e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-282e95b2-4610-45e2-b487-e424398ad94a req-40408c9c-80c2-4935-97da-9fdf83b19b45 service nova] Lock "78cdbf30-96bc-46ab-9bea-994ddb56165e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-282e95b2-4610-45e2-b487-e424398ad94a req-40408c9c-80c2-4935-97da-9fdf83b19b45 service nova] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] No waiting events found dispatching network-vif-unplugged-dacdecc3-2aab-4979-bb6b-5f82c82b00a0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG nova.compute.manager [req-282e95b2-4610-45e2-b487-e424398ad94a req-40408c9c-80c2-4935-97da-9fdf83b19b45 service nova] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Received event network-vif-unplugged-dacdecc3-2aab-4979-bb6b-5f82c82b00a0 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:34:57 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Instance destroyed successfully.
Dec 05 12:34:57 user nova-compute[75071]: DEBUG nova.objects.instance [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Lazy-loading 'resources' on Instance uuid 78cdbf30-96bc-46ab-9bea-994ddb56165e {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:32:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-402734499',display_name='tempest-VolumesActionsTest-instance-402734499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-402734499',id=35,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:33:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb7c6dba495f41e1893bacfc762ae765',ramdisk_id='',reservation_id='r-es0nzsad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-274044295',owner_user_name='tempest-VolumesActionsTest-274044295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:33:05Z,user_data=None,user_id='7e50eb24e2274d81a2692dfcf012fafa',uuid=78cdbf30-96bc-46ab-9bea-994ddb56165e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "address": "fa:16:3e:5f:61:37", "network": {"id": "e2824ede-7c75-4502-8751-2674862c3118", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1146622404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7c6dba495f41e1893bacfc762ae765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdacdecc3-2a", "ovs_interfaceid": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Converting VIF {"id": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "address": "fa:16:3e:5f:61:37", "network": {"id": "e2824ede-7c75-4502-8751-2674862c3118", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1146622404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb7c6dba495f41e1893bacfc762ae765", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdacdecc3-2a", "ovs_interfaceid": "dacdecc3-2aab-4979-bb6b-5f82c82b00a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:61:37,bridge_name='br-int',has_traffic_filtering=True,id=dacdecc3-2aab-4979-bb6b-5f82c82b00a0,network=Network(e2824ede-7c75-4502-8751-2674862c3118),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdacdecc3-2a') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG os_vif [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:61:37,bridge_name='br-int',has_traffic_filtering=True,id=dacdecc3-2aab-4979-bb6b-5f82c82b00a0,network=Network(e2824ede-7c75-4502-8751-2674862c3118),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdacdecc3-2a') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdacdecc3-2a, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed3f395f-9042-4094-bd10-030f0911a3b7) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:34:57 user nova-compute[75071]: INFO os_vif [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:61:37,bridge_name='br-int',has_traffic_filtering=True,id=dacdecc3-2aab-4979-bb6b-5f82c82b00a0,network=Network(e2824ede-7c75-4502-8751-2674862c3118),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdacdecc3-2a')
Dec 05 12:34:57 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Deleting instance files /opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e_del
Dec 05 12:34:57 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Deletion of /opt/stack/data/nova/instances/78cdbf30-96bc-46ab-9bea-994ddb56165e_del complete
Dec 05 12:34:58 user nova-compute[75071]: INFO nova.compute.manager [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Took 0.90 seconds to destroy the instance on the hypervisor.
Dec 05 12:34:58 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:34:58 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:34:58 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:34:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:34:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:34:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:34:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:34:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:34:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:34:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:34:58 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:34:58 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:34:58 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Took 0.41 seconds to deallocate network for instance.
Dec 05 12:34:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-467bad02-ecb4-4563-aff8-79bba7a0453e req-a86c01a5-1eee-4ad4-adad-231cc905553c service nova] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Received event network-vif-deleted-dacdecc3-2aab-4979-bb6b-5f82c82b00a0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:58 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:34:58 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:34:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:58 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Deleted allocations for instance 78cdbf30-96bc-46ab-9bea-994ddb56165e
Dec 05 12:34:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:34:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-dcad6167-6980-44cf-bb91-8ad708110b1f tempest-VolumesActionsTest-274044295 tempest-VolumesActionsTest-274044295-project-member] Lock "78cdbf30-96bc-46ab-9bea-994ddb56165e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.899s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-47282aa7-eeb6-4607-85b3-b1906529dc11 req-132c0f54-b956-40dd-b641-b98cef838eb4 service nova] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Received event network-vif-plugged-dacdecc3-2aab-4979-bb6b-5f82c82b00a0 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:34:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-47282aa7-eeb6-4607-85b3-b1906529dc11 req-132c0f54-b956-40dd-b641-b98cef838eb4 service nova] Acquiring lock "78cdbf30-96bc-46ab-9bea-994ddb56165e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:34:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-47282aa7-eeb6-4607-85b3-b1906529dc11 req-132c0f54-b956-40dd-b641-b98cef838eb4 service nova] Lock "78cdbf30-96bc-46ab-9bea-994ddb56165e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:34:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-47282aa7-eeb6-4607-85b3-b1906529dc11 req-132c0f54-b956-40dd-b641-b98cef838eb4 service nova] Lock "78cdbf30-96bc-46ab-9bea-994ddb56165e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:34:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-47282aa7-eeb6-4607-85b3-b1906529dc11 req-132c0f54-b956-40dd-b641-b98cef838eb4 service nova] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] No waiting events found dispatching network-vif-plugged-dacdecc3-2aab-4979-bb6b-5f82c82b00a0 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:34:59 user nova-compute[75071]: WARNING nova.compute.manager [req-47282aa7-eeb6-4607-85b3-b1906529dc11 req-132c0f54-b956-40dd-b641-b98cef838eb4 service nova] [instance: 78cdbf30-96bc-46ab-9bea-994ddb56165e] Received unexpected event network-vif-plugged-dacdecc3-2aab-4979-bb6b-5f82c82b00a0 for instance with vm_state deleted and task_state None.
Dec 05 12:35:02 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:35:02 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:35:02 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 12:35:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "43653273-2337-43a0-981a-e28d1ba26655" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "43653273-2337-43a0-981a-e28d1ba26655" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "43653273-2337-43a0-981a-e28d1ba26655-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "43653273-2337-43a0-981a-e28d1ba26655-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "43653273-2337-43a0-981a-e28d1ba26655-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:09 user nova-compute[75071]: INFO nova.compute.manager [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Terminating instance
Dec 05 12:35:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:35:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-8710322e-5e75-4fd8-a4cc-cbeae2ef4a1f req-4c5313e5-da29-4b8f-a31b-7b2bacd1ff6f service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received event network-vif-unplugged-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8710322e-5e75-4fd8-a4cc-cbeae2ef4a1f req-4c5313e5-da29-4b8f-a31b-7b2bacd1ff6f service nova] Acquiring lock "43653273-2337-43a0-981a-e28d1ba26655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8710322e-5e75-4fd8-a4cc-cbeae2ef4a1f req-4c5313e5-da29-4b8f-a31b-7b2bacd1ff6f service nova] Lock "43653273-2337-43a0-981a-e28d1ba26655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8710322e-5e75-4fd8-a4cc-cbeae2ef4a1f req-4c5313e5-da29-4b8f-a31b-7b2bacd1ff6f service nova] Lock "43653273-2337-43a0-981a-e28d1ba26655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-8710322e-5e75-4fd8-a4cc-cbeae2ef4a1f req-4c5313e5-da29-4b8f-a31b-7b2bacd1ff6f service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] No waiting events found dispatching network-vif-unplugged-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-8710322e-5e75-4fd8-a4cc-cbeae2ef4a1f req-4c5313e5-da29-4b8f-a31b-7b2bacd1ff6f service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received event network-vif-unplugged-b2236786-98e2-461a-ba60-9ded45e0c725 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:35:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Instance destroyed successfully.
Dec 05 12:35:10 user nova-compute[75071]: DEBUG nova.objects.instance [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lazy-loading 'resources' on Instance uuid 43653273-2337-43a0-981a-e28d1ba26655 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-84344102',display_name='tempest-TestMinimumBasicScenario-server-84344102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-84344102',id=31,image_ref='77ee73b9-3d1b-4a47-a0f8-b6c438a32b85',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKONl1OXL6Thqly9LaJZ5HI5p17NwwllIEnCSxrlABCfEo+myFZ46DggDl6BKwcFw1tWq9AcQ/2hy6ELVE0uQaiDqgJ2pqGpUFANw0r8VDYtKxkXFrzo0gzHfRiJ4B42Tg==',key_name='tempest-TestMinimumBasicScenario-272122578',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:30:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b9ac01e22eb428885981285a18f34fc',ramdisk_id='',reservation_id='r-y59w45ur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='77ee73b9-3d1b-4a47-a0f8-b6c438a32b85',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-901409176',owner_user_name='tempest-TestMinimumBasicScenario-901409176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:32:30Z,user_data=None,user_id='1feef67013ea4c4db4be3a352eeaec7f',uuid=43653273-2337-43a0-981a-e28d1ba26655,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2236786-98e2-461a-ba60-9ded45e0c725", "address": "fa:16:3e:44:f4:af", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2236786-98", "ovs_interfaceid": "b2236786-98e2-461a-ba60-9ded45e0c725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Converting VIF {"id": "b2236786-98e2-461a-ba60-9ded45e0c725", "address": "fa:16:3e:44:f4:af", "network": {"id": "bdbba6a8-d258-460f-afc6-5f3294472921", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-338552114-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b9ac01e22eb428885981285a18f34fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2236786-98", "ovs_interfaceid": "b2236786-98e2-461a-ba60-9ded45e0c725", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:f4:af,bridge_name='br-int',has_traffic_filtering=True,id=b2236786-98e2-461a-ba60-9ded45e0c725,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2236786-98') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG os_vif [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:f4:af,bridge_name='br-int',has_traffic_filtering=True,id=b2236786-98e2-461a-ba60-9ded45e0c725,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2236786-98') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2236786-98, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0000e522-f98b-44a9-a631-c6983d2613a2) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:10 user nova-compute[75071]: INFO os_vif [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:f4:af,bridge_name='br-int',has_traffic_filtering=True,id=b2236786-98e2-461a-ba60-9ded45e0c725,network=Network(bdbba6a8-d258-460f-afc6-5f3294472921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2236786-98')
Dec 05 12:35:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Deleting instance files /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655_del
Dec 05 12:35:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Deletion of /opt/stack/data/nova/instances/43653273-2337-43a0-981a-e28d1ba26655_del complete
Dec 05 12:35:10 user nova-compute[75071]: INFO nova.compute.manager [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Took 0.92 seconds to destroy the instance on the hypervisor.
Dec 05 12:35:10 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:35:10 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 43653273-2337-43a0-981a-e28d1ba26655] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:35:11 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:35:11 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Took 0.43 seconds to deallocate network for instance.
Dec 05 12:35:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-8a151b00-2fa7-4449-bc44-bb36582b1bf6 req-ff8583b2-799b-4196-96eb-91522eac5482 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received event network-vif-deleted-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:35:11 user nova-compute[75071]: INFO nova.compute.manager [req-8a151b00-2fa7-4449-bc44-bb36582b1bf6 req-ff8583b2-799b-4196-96eb-91522eac5482 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Neutron deleted interface b2236786-98e2-461a-ba60-9ded45e0c725; detaching it from the instance and deleting it from the info cache
Dec 05 12:35:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-8a151b00-2fa7-4449-bc44-bb36582b1bf6 req-ff8583b2-799b-4196-96eb-91522eac5482 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:35:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-8a151b00-2fa7-4449-bc44-bb36582b1bf6 req-ff8583b2-799b-4196-96eb-91522eac5482 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Detach interface failed, port_id=b2236786-98e2-461a-ba60-9ded45e0c725, reason: Instance 43653273-2337-43a0-981a-e28d1ba26655 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:35:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:11 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:35:11 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:35:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:11 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Deleted allocations for instance 43653273-2337-43a0-981a-e28d1ba26655
Dec 05 12:35:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fbc46c2c-c6f2-439b-9415-778adae6909d tempest-TestMinimumBasicScenario-901409176 tempest-TestMinimumBasicScenario-901409176-project-member] Lock "43653273-2337-43a0-981a-e28d1ba26655" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.889s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-c62f7dba-6757-4e4a-9b06-25658a7b541e req-4e21cb64-8d3d-4de4-8d5f-67b12b59fcc6 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received event network-vif-plugged-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:35:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c62f7dba-6757-4e4a-9b06-25658a7b541e req-4e21cb64-8d3d-4de4-8d5f-67b12b59fcc6 service nova] Acquiring lock "43653273-2337-43a0-981a-e28d1ba26655-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c62f7dba-6757-4e4a-9b06-25658a7b541e req-4e21cb64-8d3d-4de4-8d5f-67b12b59fcc6 service nova] Lock "43653273-2337-43a0-981a-e28d1ba26655-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c62f7dba-6757-4e4a-9b06-25658a7b541e req-4e21cb64-8d3d-4de4-8d5f-67b12b59fcc6 service nova] Lock "43653273-2337-43a0-981a-e28d1ba26655-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-c62f7dba-6757-4e4a-9b06-25658a7b541e req-4e21cb64-8d3d-4de4-8d5f-67b12b59fcc6 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] No waiting events found dispatching network-vif-plugged-b2236786-98e2-461a-ba60-9ded45e0c725 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:35:12 user nova-compute[75071]: WARNING nova.compute.manager [req-c62f7dba-6757-4e4a-9b06-25658a7b541e req-4e21cb64-8d3d-4de4-8d5f-67b12b59fcc6 service nova] [instance: 43653273-2337-43a0-981a-e28d1ba26655] Received unexpected event network-vif-plugged-b2236786-98e2-461a-ba60-9ded45e0c725 for instance with vm_state deleted and task_state None.
Dec 05 12:35:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "e08be776-0fa9-4871-86eb-2093530c00f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "e08be776-0fa9-4871-86eb-2093530c00f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "e08be776-0fa9-4871-86eb-2093530c00f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "e08be776-0fa9-4871-86eb-2093530c00f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "e08be776-0fa9-4871-86eb-2093530c00f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:17 user nova-compute[75071]: INFO nova.compute.manager [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Terminating instance
Dec 05 12:35:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:35:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-f71436f2-7293-4f1f-9be0-2d1394251e9c req-07d61c25-655b-4b1d-94ba-68d8dd11dccb service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Received event network-vif-unplugged-8f59600f-fe54-49ac-b95c-fc44bad6b5d7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f71436f2-7293-4f1f-9be0-2d1394251e9c req-07d61c25-655b-4b1d-94ba-68d8dd11dccb service nova] Acquiring lock "e08be776-0fa9-4871-86eb-2093530c00f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f71436f2-7293-4f1f-9be0-2d1394251e9c req-07d61c25-655b-4b1d-94ba-68d8dd11dccb service nova] Lock "e08be776-0fa9-4871-86eb-2093530c00f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f71436f2-7293-4f1f-9be0-2d1394251e9c req-07d61c25-655b-4b1d-94ba-68d8dd11dccb service nova] Lock "e08be776-0fa9-4871-86eb-2093530c00f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-f71436f2-7293-4f1f-9be0-2d1394251e9c req-07d61c25-655b-4b1d-94ba-68d8dd11dccb service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] No waiting events found dispatching network-vif-unplugged-8f59600f-fe54-49ac-b95c-fc44bad6b5d7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-f71436f2-7293-4f1f-9be0-2d1394251e9c req-07d61c25-655b-4b1d-94ba-68d8dd11dccb service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Received event network-vif-unplugged-8f59600f-fe54-49ac-b95c-fc44bad6b5d7 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:18 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Instance destroyed successfully.
Dec 05 12:35:18 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lazy-loading 'resources' on Instance uuid e08be776-0fa9-4871-86eb-2093530c00f3 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:16:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-906544306',display_name='tempest-ServerActionsTestOtherA-server-906544306',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-906544306',id=2,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPr4CxHIGILJKylwCAW1k5g9hHm3DpT3NJj15aFaT5zmT7LmQxPRChXNHnUJDBNGMOIF2KjOMuY9sG7Diwqrmevv8WAXt0F+z6Y+uzBIRaBoBEcSXjeLaXdD3Dv6NXOVGQ==',key_name='tempest-keypair-237629817',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:17:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59b6bfae34944fcfbd49d2f18b232ec8',ramdisk_id='',reservation_id='r-wh3v0ipn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1523780015',owner_user_name='tempest-ServerActionsTestOtherA-1523780015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:17:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d7e73e24d5b1489c813f06690b12eef4',uuid=e08be776-0fa9-4871-86eb-2093530c00f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "address": "fa:16:3e:32:a2:62", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f59600f-fe", "ovs_interfaceid": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converting VIF {"id": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "address": "fa:16:3e:32:a2:62", "network": {"id": "72dfba54-947e-43a2-b7f9-0ef683f1f5e3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-447918098-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59b6bfae34944fcfbd49d2f18b232ec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f59600f-fe", "ovs_interfaceid": "8f59600f-fe54-49ac-b95c-fc44bad6b5d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:a2:62,bridge_name='br-int',has_traffic_filtering=True,id=8f59600f-fe54-49ac-b95c-fc44bad6b5d7,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f59600f-fe') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG os_vif [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:a2:62,bridge_name='br-int',has_traffic_filtering=True,id=8f59600f-fe54-49ac-b95c-fc44bad6b5d7,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f59600f-fe') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f59600f-fe, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23fa6f90-f2ad-48dc-82f1-2af5d379b9c4) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:35:18 user nova-compute[75071]: INFO os_vif [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:a2:62,bridge_name='br-int',has_traffic_filtering=True,id=8f59600f-fe54-49ac-b95c-fc44bad6b5d7,network=Network(72dfba54-947e-43a2-b7f9-0ef683f1f5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f59600f-fe')
Dec 05 12:35:18 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Deleting instance files /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3_del
Dec 05 12:35:18 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Deletion of /opt/stack/data/nova/instances/e08be776-0fa9-4871-86eb-2093530c00f3_del complete
Dec 05 12:35:18 user nova-compute[75071]: INFO nova.compute.manager [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 05 12:35:18 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:35:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:19 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:35:19 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Took 0.41 seconds to deallocate network for instance.
Dec 05 12:35:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-569daecf-d09a-4feb-8d0d-345c851d74ae req-6ea2ce82-9d70-4e45-a6a3-b54f03f5a9f3 service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Received event network-vif-deleted-8f59600f-fe54-49ac-b95c-fc44bad6b5d7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:35:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:19 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:35:19 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:35:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:19 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Deleted allocations for instance e08be776-0fa9-4871-86eb-2093530c00f3
Dec 05 12:35:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ea05e36-02a6-4e1e-af0d-113e6a23e761 tempest-ServerActionsTestOtherA-1523780015 tempest-ServerActionsTestOtherA-1523780015-project-member] Lock "e08be776-0fa9-4871-86eb-2093530c00f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.761s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-e6b436b5-1c6c-41d2-8453-02bd8800f10f req-d96cbf20-4533-4f00-b7af-dfe74cb6c493 service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Received event network-vif-plugged-8f59600f-fe54-49ac-b95c-fc44bad6b5d7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:35:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e6b436b5-1c6c-41d2-8453-02bd8800f10f req-d96cbf20-4533-4f00-b7af-dfe74cb6c493 service nova] Acquiring lock "e08be776-0fa9-4871-86eb-2093530c00f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e6b436b5-1c6c-41d2-8453-02bd8800f10f req-d96cbf20-4533-4f00-b7af-dfe74cb6c493 service nova] Lock "e08be776-0fa9-4871-86eb-2093530c00f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e6b436b5-1c6c-41d2-8453-02bd8800f10f req-d96cbf20-4533-4f00-b7af-dfe74cb6c493 service nova] Lock "e08be776-0fa9-4871-86eb-2093530c00f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-e6b436b5-1c6c-41d2-8453-02bd8800f10f req-d96cbf20-4533-4f00-b7af-dfe74cb6c493 service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] No waiting events found dispatching network-vif-plugged-8f59600f-fe54-49ac-b95c-fc44bad6b5d7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:35:20 user nova-compute[75071]: WARNING nova.compute.manager [req-e6b436b5-1c6c-41d2-8453-02bd8800f10f req-d96cbf20-4533-4f00-b7af-dfe74cb6c493 service nova] [instance: e08be776-0fa9-4871-86eb-2093530c00f3] Received unexpected event network-vif-plugged-8f59600f-fe54-49ac-b95c-fc44bad6b5d7 for instance with vm_state deleted and task_state None.
Dec 05 12:35:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:35:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:35:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:35:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:35:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:35:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:35:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-eddf98c3-1490-4003-b144-49eab735ada7 req-ff63844e-0d30-429f-a792-d15136bb978d service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Received event network-changed-4797cdcb-bed0-4fa7-af67-ab3d02b41977 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:35:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-eddf98c3-1490-4003-b144-49eab735ada7 req-ff63844e-0d30-429f-a792-d15136bb978d service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Refreshing instance network info cache due to event network-changed-4797cdcb-bed0-4fa7-af67-ab3d02b41977. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:35:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eddf98c3-1490-4003-b144-49eab735ada7 req-ff63844e-0d30-429f-a792-d15136bb978d service nova] Acquiring lock "refresh_cache-ce0b3e61-f8dd-487a-a81a-a466c45f0814" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:35:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eddf98c3-1490-4003-b144-49eab735ada7 req-ff63844e-0d30-429f-a792-d15136bb978d service nova] Acquired lock "refresh_cache-ce0b3e61-f8dd-487a-a81a-a466c45f0814" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:35:40 user nova-compute[75071]: DEBUG nova.network.neutron [req-eddf98c3-1490-4003-b144-49eab735ada7 req-ff63844e-0d30-429f-a792-d15136bb978d service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Refreshing network info cache for port 4797cdcb-bed0-4fa7-af67-ab3d02b41977 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG nova.network.neutron [req-eddf98c3-1490-4003-b144-49eab735ada7 req-ff63844e-0d30-429f-a792-d15136bb978d service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Updated VIF entry in instance network info cache for port 4797cdcb-bed0-4fa7-af67-ab3d02b41977. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG nova.network.neutron [req-eddf98c3-1490-4003-b144-49eab735ada7 req-ff63844e-0d30-429f-a792-d15136bb978d service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Updating instance_info_cache with network_info: [{"id": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "address": "fa:16:3e:5b:20:cc", "network": {"id": "6e4d54dd-92e2-4e7f-a2d6-a4d46abe125a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478002396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b44f33bb08a547948df72daba2ec1722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4797cdcb-be", "ovs_interfaceid": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-eddf98c3-1490-4003-b144-49eab735ada7 req-ff63844e-0d30-429f-a792-d15136bb978d service nova] Releasing lock "refresh_cache-ce0b3e61-f8dd-487a-a81a-a466c45f0814" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lazy-loading 'flavor' on Instance uuid ce0b3e61-f8dd-487a-a81a-a466c45f0814 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:41 user nova-compute[75071]: INFO nova.compute.manager [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Attaching volume 41722047-7961-4ab1-9df9-7362702aad5e to /dev/vdb
Dec 05 12:35:41 user nova-compute[75071]: DEBUG os_brick.utils [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7a15ba-19eb-4cdc-b996-d094d2096c4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e847688-db16-4f9e-b751-333d0378c44e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[01311829-3b7b-4b75-882f-07ad46b60219]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b6502c-f2ea-48b9-9b7f-c9db9479c554]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:35:41 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:35:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ef969b-8933-417f-809c-e6ae9ceec7d7]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG os_brick.utils [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:35:41 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Updating existing volume attachment record: bf854267-8805-4bcd-b6c0-593b0d9b52e0 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:35:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:35:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBDpTryl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:35:51 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:35:51 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:35:51 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d73668-aa4e-486e-8806-fb6e4bc9cfbb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:35:51 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbb334f-cb43-47fb-b361-163cc67dd0ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e] added
Dec 05 12:35:51 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2b1678-3246-45e5-8850-e4008ee1afba]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5681ec-e8f5-48b4-9ea9-5547b9fe9ed7]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UBDpTryl {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UBDpTryl" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[00773056-736e-4fd2-ac59-aa124752602a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UBDpTryl'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b99afcb-4e9a-4cf4-80f4-a071b8acdfad]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be443e6-1029-45e4-af13-9d99efc45ccb]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:35:51 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:35:51 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)
Dec 05 12:35:51 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:35:51 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:35:51 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)
Dec 05 12:35:51 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2578d727-9c8a-4c4a-8d72-8e532c02a365]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e, portal: 172.16.0.220,3260]
Dec 05 12:35:51 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e, portal: 172.16.0.220,3260] successful.
Dec 05 12:35:51 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6cf199-88b8-4218-96a4-d8b474d46d08]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4b75e5-0534-4c60-958b-fe5852031e7a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:35:51 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:35:51 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)
Dec 05 12:35:51 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e (non-flash)
Dec 05 12:35:51 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:35:51 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:35:51 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)
Dec 05 12:35:51 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e (non-flash)
Dec 05 12:35:51 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4f71e1-985c-43bf-aa87-b35e3b8147b4]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:35:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBDpTryl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:35:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:35:52 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26431616134326133', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:35:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431616134326133', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:35:52 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lazy-loading 'flavor' on Instance uuid ce0b3e61-f8dd-487a-a81a-a466c45f0814 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:35:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:35:52 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:35:52 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:35:52 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:35:52 user nova-compute[75071]:   <serial>41722047-7961-4ab1-9df9-7362702aad5e</serial>
Dec 05 12:35:52 user nova-compute[75071]: </disk>
Dec 05 12:35:52 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:35:52 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:35:52 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:35:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:52 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:35:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:35:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:35:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] No VIF found with MAC fa:16:3e:5b:20:cc, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:35:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f0dc699d-308d-45bd-a5ff-c4c58f9afa7e tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.518s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:35:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "9f492779-584e-4a21-9991-78de01f6670c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "9f492779-584e-4a21-9991-78de01f6670c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:35:54 user nova-compute[75071]: INFO nova.compute.claims [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Claim successful on node user
Dec 05 12:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG nova.network.neutron [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:35:54 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:35:54 user nova-compute[75071]: DEBUG nova.compute.manager [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG nova.policy [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '201cbbb8b3dc4a3aa8164d69c1257489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77a4b1baadd43e1be69eecb1f5370bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:35:55 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Creating image(s)
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "/opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "/opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.225s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG nova.network.neutron [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Successfully created port: 5c69855c-e879-4e6a-800c-d78be52ba433 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.218s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk 1073741824" returned: 0 in 0.049s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.206s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:35:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Cannot resize image /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Ensure instance console log exists: /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Successfully updated port: 5c69855c-e879-4e6a-800c-d78be52ba433 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "refresh_cache-9f492779-584e-4a21-9991-78de01f6670c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquired lock "refresh_cache-9f492779-584e-4a21-9991-78de01f6670c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-b30235b0-4fff-4310-aa31-a4e50cfa7af3 req-0f957d6d-a11c-4678-b516-30f7b442d4e8 service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Received event network-changed-5c69855c-e879-4e6a-800c-d78be52ba433 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG nova.compute.manager [req-b30235b0-4fff-4310-aa31-a4e50cfa7af3 req-0f957d6d-a11c-4678-b516-30f7b442d4e8 service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Refreshing instance network info cache due to event network-changed-5c69855c-e879-4e6a-800c-d78be52ba433. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b30235b0-4fff-4310-aa31-a4e50cfa7af3 req-0f957d6d-a11c-4678-b516-30f7b442d4e8 service nova] Acquiring lock "refresh_cache-9f492779-584e-4a21-9991-78de01f6670c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG nova.network.neutron [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:35:56 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:35:56 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:35:56 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8002MB free_disk=24.788665771484375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lazy-loading 'flavor' on Instance uuid ce0b3e61-f8dd-487a-a81a-a466c45f0814 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:35:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 42776e73-1ef0-4c57-a50a-942f6f4881de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 015e89c3-73ad-4bfd-b55c-68323fae2b29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance ce0b3e61-f8dd-487a-a81a-a466c45f0814 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 77c962a7-587a-41be-b87d-ab416b8b43fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9f492779-584e-4a21-9991-78de01f6670c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.network.neutron [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Updating instance_info_cache with network_info: [{"id": "5c69855c-e879-4e6a-800c-d78be52ba433", "address": "fa:16:3e:6a:3f:fe", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c69855c-e8", "ovs_interfaceid": "5c69855c-e879-4e6a-800c-d78be52ba433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Releasing lock "refresh_cache-9f492779-584e-4a21-9991-78de01f6670c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Instance network_info: |[{"id": "5c69855c-e879-4e6a-800c-d78be52ba433", "address": "fa:16:3e:6a:3f:fe", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c69855c-e8", "ovs_interfaceid": "5c69855c-e879-4e6a-800c-d78be52ba433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b30235b0-4fff-4310-aa31-a4e50cfa7af3 req-0f957d6d-a11c-4678-b516-30f7b442d4e8 service nova] Acquired lock "refresh_cache-9f492779-584e-4a21-9991-78de01f6670c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.network.neutron [req-b30235b0-4fff-4310-aa31-a4e50cfa7af3 req-0f957d6d-a11c-4678-b516-30f7b442d4e8 service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Refreshing network info cache for port 5c69855c-e879-4e6a-800c-d78be52ba433 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Start _get_guest_xml network_info=[{"id": "5c69855c-e879-4e6a-800c-d78be52ba433", "address": "fa:16:3e:6a:3f:fe", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c69855c-e8", "ovs_interfaceid": "5c69855c-e879-4e6a-800c-d78be52ba433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:35:57 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:35:57 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:57 user nova-compute[75071]: INFO nova.compute.manager [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Attaching volume 6a9ed711-1548-4a3a-b410-c639e00703f6 to /dev/vdc
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-868553320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-868553320',id=37,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b77a4b1baadd43e1be69eecb1f5370bd',ramdisk_id='',reservation_id='r-fgggtcfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86909184',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:35:55Z,user_data=None,user_id='201cbbb8b3dc4a3aa8164d69c1257489',uuid=9f492779-584e-4a21-9991-78de01f6670c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c69855c-e879-4e6a-800c-d78be52ba433", "address": "fa:16:3e:6a:3f:fe", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c69855c-e8", "ovs_interfaceid": "5c69855c-e879-4e6a-800c-d78be52ba433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converting VIF {"id": "5c69855c-e879-4e6a-800c-d78be52ba433", "address": "fa:16:3e:6a:3f:fe", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c69855c-e8", "ovs_interfaceid": "5c69855c-e879-4e6a-800c-d78be52ba433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:3f:fe,bridge_name='br-int',has_traffic_filtering=True,id=5c69855c-e879-4e6a-800c-d78be52ba433,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c69855c-e8') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.objects.instance [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f492779-584e-4a21-9991-78de01f6670c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:35:57 user nova-compute[75071]:   <uuid>9f492779-584e-4a21-9991-78de01f6670c</uuid>
Dec 05 12:35:57 user nova-compute[75071]:   <name>instance-00000025</name>
Dec 05 12:35:57 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:35:57 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:35:57 user nova-compute[75071]:   <metadata>
Dec 05 12:35:57 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:35:57 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:35:57 user nova-compute[75071]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-868553320</nova:name>
Dec 05 12:35:57 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:35:57</nova:creationTime>
Dec 05 12:35:57 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:35:57 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:35:57 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:35:57 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:35:57 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:35:57 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:35:57 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:35:57 user nova-compute[75071]:       <nova:owner>
Dec 05 12:35:57 user nova-compute[75071]:         <nova:user uuid="201cbbb8b3dc4a3aa8164d69c1257489">tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member</nova:user>
Dec 05 12:35:57 user nova-compute[75071]:         <nova:project uuid="b77a4b1baadd43e1be69eecb1f5370bd">tempest-ServerBootFromVolumeStableRescueTest-86909184</nova:project>
Dec 05 12:35:57 user nova-compute[75071]:       </nova:owner>
Dec 05 12:35:57 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:35:57 user nova-compute[75071]:       <nova:ports>
Dec 05 12:35:57 user nova-compute[75071]:         <nova:port uuid="5c69855c-e879-4e6a-800c-d78be52ba433">
Dec 05 12:35:57 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 05 12:35:57 user nova-compute[75071]:         </nova:port>
Dec 05 12:35:57 user nova-compute[75071]:       </nova:ports>
Dec 05 12:35:57 user nova-compute[75071]:     </nova:instance>
Dec 05 12:35:57 user nova-compute[75071]:   </metadata>
Dec 05 12:35:57 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:35:57 user nova-compute[75071]:     <system>
Dec 05 12:35:57 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:35:57 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:35:57 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:35:57 user nova-compute[75071]:       <entry name="serial">9f492779-584e-4a21-9991-78de01f6670c</entry>
Dec 05 12:35:57 user nova-compute[75071]:       <entry name="uuid">9f492779-584e-4a21-9991-78de01f6670c</entry>
Dec 05 12:35:57 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:35:57 user nova-compute[75071]:     </system>
Dec 05 12:35:57 user nova-compute[75071]:   </sysinfo>
Dec 05 12:35:57 user nova-compute[75071]:   <os>
Dec 05 12:35:57 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:35:57 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:35:57 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:35:57 user nova-compute[75071]:   </os>
Dec 05 12:35:57 user nova-compute[75071]:   <features>
Dec 05 12:35:57 user nova-compute[75071]:     <acpi/>
Dec 05 12:35:57 user nova-compute[75071]:     <apic/>
Dec 05 12:35:57 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:35:57 user nova-compute[75071]:   </features>
Dec 05 12:35:57 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:35:57 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:35:57 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:35:57 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:35:57 user nova-compute[75071]:   </clock>
Dec 05 12:35:57 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:35:57 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:35:57 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:35:57 user nova-compute[75071]:   </cpu>
Dec 05 12:35:57 user nova-compute[75071]:   <devices>
Dec 05 12:35:57 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:35:57 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:35:57 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk"/>
Dec 05 12:35:57 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:35:57 user nova-compute[75071]:     </disk>
Dec 05 12:35:57 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:35:57 user nova-compute[75071]:       <mac address="fa:16:3e:6a:3f:fe"/>
Dec 05 12:35:57 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:35:57 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:35:57 user nova-compute[75071]:       <target dev="tap5c69855c-e8"/>
Dec 05 12:35:57 user nova-compute[75071]:     </interface>
Dec 05 12:35:57 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:35:57 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/console.log" append="off"/>
Dec 05 12:35:57 user nova-compute[75071]:     </serial>
Dec 05 12:35:57 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:35:57 user nova-compute[75071]:     <video>
Dec 05 12:35:57 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:35:57 user nova-compute[75071]:     </video>
Dec 05 12:35:57 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:35:57 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:35:57 user nova-compute[75071]:     </rng>
Dec 05 12:35:57 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:35:57 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:35:57 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:35:57 user nova-compute[75071]:     </memballoon>
Dec 05 12:35:57 user nova-compute[75071]:   </devices>
Dec 05 12:35:57 user nova-compute[75071]: </domain>
Dec 05 12:35:57 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-868553320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-868553320',id=37,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b77a4b1baadd43e1be69eecb1f5370bd',ramdisk_id='',reservation_id='r-fgggtcfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86909184',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:35:55Z,user_data=None,user_id='201cbbb8b3dc4a3aa8164d69c1257489',uuid=9f492779-584e-4a21-9991-78de01f6670c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c69855c-e879-4e6a-800c-d78be52ba433", "address": "fa:16:3e:6a:3f:fe", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c69855c-e8", "ovs_interfaceid": "5c69855c-e879-4e6a-800c-d78be52ba433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converting VIF {"id": "5c69855c-e879-4e6a-800c-d78be52ba433", "address": "fa:16:3e:6a:3f:fe", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c69855c-e8", "ovs_interfaceid": "5c69855c-e879-4e6a-800c-d78be52ba433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:3f:fe,bridge_name='br-int',has_traffic_filtering=True,id=5c69855c-e879-4e6a-800c-d78be52ba433,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c69855c-e8') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG os_vif [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:3f:fe,bridge_name='br-int',has_traffic_filtering=True,id=5c69855c-e879-4e6a-800c-d78be52ba433,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c69855c-e8') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58a430d7-6db6-57da-873e-02a328383ae0', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c69855c-e8, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c69855c-e8, col_values=(('qos', UUID('54f09095-be8a-4fad-b5de-fbd4b1197325')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c69855c-e8, col_values=(('external_ids', {'iface-id': '5c69855c-e879-4e6a-800c-d78be52ba433', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:3f:fe', 'vm-uuid': '9f492779-584e-4a21-9991-78de01f6670c'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG os_brick.utils [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:57 user nova-compute[75071]: INFO os_vif [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:3f:fe,bridge_name='br-int',has_traffic_filtering=True,id=5c69855c-e879-4e6a-800c-d78be52ba433,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c69855c-e8')
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a77eeb-d614-45ab-bfe4-5ff99d28902a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[41823a02-9290-4c16-ae82-c8bb4ec12669]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] No VIF found with MAC fa:16:3e:6a:3f:fe, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[126d6269-ce33-4f73-8a2c-507d8ea7e096]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[051cd600-5b3a-4aca-b7bd-dd6e77be3894]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:35:57 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0218cce6-6b2b-4c16-91c1-8aaf63eec81f]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG os_brick.utils [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Updating existing volume attachment record: d327abb0-e227-4034-97f2-4c9ba1b2adde {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.network.neutron [req-b30235b0-4fff-4310-aa31-a4e50cfa7af3 req-0f957d6d-a11c-4678-b516-30f7b442d4e8 service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Updated VIF entry in instance network info cache for port 5c69855c-e879-4e6a-800c-d78be52ba433. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG nova.network.neutron [req-b30235b0-4fff-4310-aa31-a4e50cfa7af3 req-0f957d6d-a11c-4678-b516-30f7b442d4e8 service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Updating instance_info_cache with network_info: [{"id": "5c69855c-e879-4e6a-800c-d78be52ba433", "address": "fa:16:3e:6a:3f:fe", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c69855c-e8", "ovs_interfaceid": "5c69855c-e879-4e6a-800c-d78be52ba433", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:35:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b30235b0-4fff-4310-aa31-a4e50cfa7af3 req-0f957d6d-a11c-4678-b516-30f7b442d4e8 service nova] Releasing lock "refresh_cache-9f492779-584e-4a21-9991-78de01f6670c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:35:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-481d88e3-bcd0-4962-aa48-7bd97869cd32 req-33553983-8867-47d8-9e32-bb49dad0a866 service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Received event network-vif-plugged-5c69855c-e879-4e6a-800c-d78be52ba433 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:35:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-481d88e3-bcd0-4962-aa48-7bd97869cd32 req-33553983-8867-47d8-9e32-bb49dad0a866 service nova] Acquiring lock "9f492779-584e-4a21-9991-78de01f6670c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:35:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-481d88e3-bcd0-4962-aa48-7bd97869cd32 req-33553983-8867-47d8-9e32-bb49dad0a866 service nova] Lock "9f492779-584e-4a21-9991-78de01f6670c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:35:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-481d88e3-bcd0-4962-aa48-7bd97869cd32 req-33553983-8867-47d8-9e32-bb49dad0a866 service nova] Lock "9f492779-584e-4a21-9991-78de01f6670c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:35:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-481d88e3-bcd0-4962-aa48-7bd97869cd32 req-33553983-8867-47d8-9e32-bb49dad0a866 service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] No waiting events found dispatching network-vif-plugged-5c69855c-e879-4e6a-800c-d78be52ba433 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:35:58 user nova-compute[75071]: WARNING nova.compute.manager [req-481d88e3-bcd0-4962-aa48-7bd97869cd32 req-33553983-8867-47d8-9e32-bb49dad0a866 service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Received unexpected event network-vif-plugged-5c69855c-e879-4e6a-800c-d78be52ba433 for instance with vm_state building and task_state spawning.
Dec 05 12:35:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:35:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:35:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:35:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:35:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:35:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:35:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:35:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:36:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:36:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:36:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Instance spawned successfully.
Dec 05 12:36:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:36:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:36:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:36:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:36:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:36:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:36:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:36:00 user nova-compute[75071]: INFO nova.compute.manager [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Took 5.69 seconds to spawn the instance on the hypervisor.
Dec 05 12:36:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:36:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-c648731b-3a4e-4be4-9387-52decf409d42 req-974fee50-4a63-40f4-bed0-90f99abca4d0 service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Received event network-vif-plugged-5c69855c-e879-4e6a-800c-d78be52ba433 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c648731b-3a4e-4be4-9387-52decf409d42 req-974fee50-4a63-40f4-bed0-90f99abca4d0 service nova] Acquiring lock "9f492779-584e-4a21-9991-78de01f6670c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c648731b-3a4e-4be4-9387-52decf409d42 req-974fee50-4a63-40f4-bed0-90f99abca4d0 service nova] Lock "9f492779-584e-4a21-9991-78de01f6670c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:36:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c648731b-3a4e-4be4-9387-52decf409d42 req-974fee50-4a63-40f4-bed0-90f99abca4d0 service nova] Lock "9f492779-584e-4a21-9991-78de01f6670c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:36:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-c648731b-3a4e-4be4-9387-52decf409d42 req-974fee50-4a63-40f4-bed0-90f99abca4d0 service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] No waiting events found dispatching network-vif-plugged-5c69855c-e879-4e6a-800c-d78be52ba433 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:36:00 user nova-compute[75071]: WARNING nova.compute.manager [req-c648731b-3a4e-4be4-9387-52decf409d42 req-974fee50-4a63-40f4-bed0-90f99abca4d0 service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Received unexpected event network-vif-plugged-5c69855c-e879-4e6a-800c-d78be52ba433 for instance with vm_state building and task_state spawning.
Dec 05 12:36:01 user nova-compute[75071]: INFO nova.compute.manager [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Took 6.88 seconds to build instance.
Dec 05 12:36:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-175aa371-d423-4991-9432-69fa539c1a6a tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "9f492779-584e-4a21-9991-78de01f6670c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.991s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:36:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:36:03 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:36:03 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 12:36:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:36:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:36:03 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:36:03 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lazy-loading 'info_cache' on Instance uuid e0c82eba-8448-4780-b92d-62d7c60ec7ef {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:36:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:04 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updating instance_info_cache with network_info: [{"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:36:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-e0c82eba-8448-4780-b92d-62d7c60ec7ef" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:36:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:36:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:36:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkYuMBHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:36:07 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:36:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:36:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:36:07 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:36:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:36:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:36:07 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:36:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0742b14-7e77-468e-bae0-08c2f5b0bc90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:36:07 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:36:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef967a5-6bbc-433d-acfa-f6bef329d9d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6] added
Dec 05 12:36:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cf2417-a901-48d9-8642-e3c5b865d5dd]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c50374-cc38-43c0-8c2a-2474f40e6c60]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XkYuMBHP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XkYuMBHP" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[84131fa6-fc35-4cb0-bce1-14dab760a46a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XkYuMBHP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efaaf5d-960d-45c8-bae8-44189463bf2b]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f71193d-89eb-46a9-aeaf-6174d06e81cf]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:36:08 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:36:08 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)
Dec 05 12:36:08 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e (non-flash)
Dec 05 12:36:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:36:08 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:36:08 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)
Dec 05 12:36:08 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e (non-flash)
Dec 05 12:36:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b390883c-f10c-4ecb-a8ae-3d0e49c14f02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6, portal: 172.16.0.220,3260]
Dec 05 12:36:08 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6, portal: 172.16.0.220,3260] successful.
Dec 05 12:36:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f514ebc5-8e6a-4fff-a1f9-b1239cfd9a87]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc2d8d6-9479-479f-b477-c1299ac4b205]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:36:08 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:36:08 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)
Dec 05 12:36:08 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e (non-flash)
Dec 05 12:36:08 user nova-compute[75071]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 (non-flash)
Dec 05 12:36:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:36:08 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:36:08 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)
Dec 05 12:36:08 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e (non-flash)
Dec 05 12:36:08 user nova-compute[75071]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 (non-flash)
Dec 05 12:36:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fed133-2a01-478f-b244-cedce4cd2f65]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:36:09 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:36:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkYuMBHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:36:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:36:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23838666662653263', 'path': '/dev/sde'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:36:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838666662653263', 'path': '/dev/sde'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:36:09 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lazy-loading 'flavor' on Instance uuid ce0b3e61-f8dd-487a-a81a-a466c45f0814 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:36:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:36:09 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:36:09 user nova-compute[75071]:   <source dev="/dev/sde"/>
Dec 05 12:36:09 user nova-compute[75071]:   <target dev="vdc" bus="virtio"/>
Dec 05 12:36:09 user nova-compute[75071]:   <serial>6a9ed711-1548-4a3a-b410-c639e00703f6</serial>
Dec 05 12:36:09 user nova-compute[75071]: </disk>
Dec 05 12:36:09 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:36:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:36:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:36:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:36:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] No VIF found with MAC fa:16:3e:5b:20:cc, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:36:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0041bfb7-44b3-44c2-b0ff-dd5735f7be8d tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.746s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:36:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:36:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:36:11 user nova-compute[75071]: INFO nova.compute.manager [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Detaching volume 6a9ed711-1548-4a3a-b410-c639e00703f6
Dec 05 12:36:11 user nova-compute[75071]: INFO nova.virt.block_device [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Attempting to driver detach volume 6a9ed711-1548-4a3a-b410-c639e00703f6 from mountpoint /dev/vdc
Dec 05 12:36:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Attempting to detach device vdc from instance ce0b3e61-f8dd-487a-a81a-a466c45f0814 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:36:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:36:11 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:36:11 user nova-compute[75071]:   <source dev="/dev/sde"/>
Dec 05 12:36:11 user nova-compute[75071]:   <target dev="vdc" bus="virtio"/>
Dec 05 12:36:11 user nova-compute[75071]:   <serial>6a9ed711-1548-4a3a-b410-c639e00703f6</serial>
Dec 05 12:36:11 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 05 12:36:11 user nova-compute[75071]: </disk>
Dec 05 12:36:11 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:36:11 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Successfully detached device vdc from instance ce0b3e61-f8dd-487a-a81a-a466c45f0814 from the persistent domain config.
Dec 05 12:36:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ce0b3e61-f8dd-487a-a81a-a466c45f0814 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:36:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:36:11 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:36:11 user nova-compute[75071]:   <source dev="/dev/sde"/>
Dec 05 12:36:11 user nova-compute[75071]:   <target dev="vdc" bus="virtio"/>
Dec 05 12:36:11 user nova-compute[75071]:   <serial>6a9ed711-1548-4a3a-b410-c639e00703f6</serial>
Dec 05 12:36:11 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 05 12:36:11 user nova-compute[75071]: </disk>
Dec 05 12:36:11 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:36:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ce0b3e61-f8dd-487a-a81a-a466c45f0814 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:36:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquiring lock "f6b3497d-2998-48ba-9604-4332afa95c29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:36:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "f6b3497d-2998-48ba-9604-4332afa95c29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:36:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:36:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:36:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:36:20 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:36:20 user nova-compute[75071]: INFO nova.compute.claims [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Claim successful on node user
Dec 05 12:36:20 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:36:20 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:36:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:36:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:36:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:36:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:36:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:36:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG nova.policy [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f07cde1f0ad4139ade7efe260ad7545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9933b6650941d58025487be8dedc17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:36:21 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Creating image(s)
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "/opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "/opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.208s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "77c962a7-587a-41be-b87d-ab416b8b43fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:36:21 user nova-compute[75071]: INFO nova.compute.manager [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Terminating instance
Dec 05 12:36:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.203s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk 1073741824" returned: 0 in 0.063s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-5be66e38-a3f7-470f-8e41-7d52111f55fb req-04c35cba-5f09-42c0-87ed-1f299aa6987c service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received event network-vif-unplugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5be66e38-a3f7-470f-8e41-7d52111f55fb req-04c35cba-5f09-42c0-87ed-1f299aa6987c service nova] Acquiring lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5be66e38-a3f7-470f-8e41-7d52111f55fb req-04c35cba-5f09-42c0-87ed-1f299aa6987c service nova] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5be66e38-a3f7-470f-8e41-7d52111f55fb req-04c35cba-5f09-42c0-87ed-1f299aa6987c service nova] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-5be66e38-a3f7-470f-8e41-7d52111f55fb req-04c35cba-5f09-42c0-87ed-1f299aa6987c service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] No waiting events found dispatching network-vif-unplugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-5be66e38-a3f7-470f-8e41-7d52111f55fb req-04c35cba-5f09-42c0-87ed-1f299aa6987c service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received event network-vif-unplugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Successfully created port: 91e29c88-544e-4637-b12a-3fd62802f1cf {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.249s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:36:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Cannot resize image /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Ensure instance console log exists: /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Instance destroyed successfully.
Dec 05 12:36:22 user nova-compute[75071]: DEBUG nova.objects.instance [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lazy-loading 'resources' on Instance uuid 77c962a7-587a-41be-b87d-ab416b8b43fd {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-05T12:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1984475382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1984475382',id=33,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtoYRtON/k5tbb0b0mgSufh1T0fJ18q1yNdUUxwZ8FGHqcIPsw8eGqRqkMKmw0v8fjb0z41I1/TPnK4YuntSP9PKw0rISU/kk/utjGYcC3dcCXudabG3EjjbwL3JZGM1g==',key_name='tempest-keypair-1201033063',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:34:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36cda9a88b434e66ad6d8ac75790d141',ramdisk_id='',reservation_id='r-clu35i2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1822750901',owner_user_name='tempest-AttachVolumeShelveTestJSON-1822750901-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:34:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a70218d8181040818ed8290e743bd2db',uuid=77c962a7-587a-41be-b87d-ab416b8b43fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converting VIF {"id": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "address": "fa:16:3e:c6:34:f9", "network": {"id": "dad5a1bb-1929-4773-b58a-9257d464c523", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1716096307-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36cda9a88b434e66ad6d8ac75790d141", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap52df8e8e-e8", "ovs_interfaceid": "52df8e8e-e80a-4f0a-b496-63771b5e63a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:34:f9,bridge_name='br-int',has_traffic_filtering=True,id=52df8e8e-e80a-4f0a-b496-63771b5e63a7,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52df8e8e-e8') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG os_vif [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:34:f9,bridge_name='br-int',has_traffic_filtering=True,id=52df8e8e-e80a-4f0a-b496-63771b5e63a7,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52df8e8e-e8') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap52df8e8e-e8, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac4cfe28-2666-40d5-bcc1-2d9bac28b7f2) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:22 user nova-compute[75071]: INFO os_vif [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:34:f9,bridge_name='br-int',has_traffic_filtering=True,id=52df8e8e-e80a-4f0a-b496-63771b5e63a7,network=Network(dad5a1bb-1929-4773-b58a-9257d464c523),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap52df8e8e-e8')
Dec 05 12:36:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Deleting instance files /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd_del
Dec 05 12:36:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Deletion of /opt/stack/data/nova/instances/77c962a7-587a-41be-b87d-ab416b8b43fd_del complete
Dec 05 12:36:22 user nova-compute[75071]: INFO nova.compute.manager [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Took 0.92 seconds to destroy the instance on the hypervisor.
Dec 05 12:36:22 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Successfully updated port: 91e29c88-544e-4637-b12a-3fd62802f1cf {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquiring lock "refresh_cache-f6b3497d-2998-48ba-9604-4332afa95c29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquired lock "refresh_cache-f6b3497d-2998-48ba-9604-4332afa95c29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:36:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-463b86ab-5321-4fe4-b6dc-2cfed5685ead req-a3d0900a-8bdf-4297-b425-0cf5b8f929df service nova] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Received event network-changed-91e29c88-544e-4637-b12a-3fd62802f1cf {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-463b86ab-5321-4fe4-b6dc-2cfed5685ead req-a3d0900a-8bdf-4297-b425-0cf5b8f929df service nova] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Refreshing instance network info cache due to event network-changed-91e29c88-544e-4637-b12a-3fd62802f1cf. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-463b86ab-5321-4fe4-b6dc-2cfed5685ead req-a3d0900a-8bdf-4297-b425-0cf5b8f929df service nova] Acquiring lock "refresh_cache-f6b3497d-2998-48ba-9604-4332afa95c29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Updating instance_info_cache with network_info: [{"id": "91e29c88-544e-4637-b12a-3fd62802f1cf", "address": "fa:16:3e:92:b9:46", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e29c88-54", "ovs_interfaceid": "91e29c88-544e-4637-b12a-3fd62802f1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Releasing lock "refresh_cache-f6b3497d-2998-48ba-9604-4332afa95c29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Instance network_info: |[{"id": "91e29c88-544e-4637-b12a-3fd62802f1cf", "address": "fa:16:3e:92:b9:46", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e29c88-54", "ovs_interfaceid": "91e29c88-544e-4637-b12a-3fd62802f1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-463b86ab-5321-4fe4-b6dc-2cfed5685ead req-a3d0900a-8bdf-4297-b425-0cf5b8f929df service nova] Acquired lock "refresh_cache-f6b3497d-2998-48ba-9604-4332afa95c29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.network.neutron [req-463b86ab-5321-4fe4-b6dc-2cfed5685ead req-a3d0900a-8bdf-4297-b425-0cf5b8f929df service nova] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Refreshing network info cache for port 91e29c88-544e-4637-b12a-3fd62802f1cf {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Start _get_guest_xml network_info=[{"id": "91e29c88-544e-4637-b12a-3fd62802f1cf", "address": "fa:16:3e:92:b9:46", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e29c88-54", "ovs_interfaceid": "91e29c88-544e-4637-b12a-3fd62802f1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:36:23 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:36:23 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:36:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1959430990',display_name='tempest-ServersNegativeTestJSON-server-1959430990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1959430990',id=38,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c9933b6650941d58025487be8dedc17',ramdisk_id='',reservation_id='r-sf4icequ',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-508219572',owner_user_name='tempest-ServersNegativeTestJSON-508219572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:36:21Z,user_data=None,user_id='3f07cde1f0ad4139ade7efe260ad7545',uuid=f6b3497d-2998-48ba-9604-4332afa95c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91e29c88-544e-4637-b12a-3fd62802f1cf", "address": "fa:16:3e:92:b9:46", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e29c88-54", "ovs_interfaceid": "91e29c88-544e-4637-b12a-3fd62802f1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Converting VIF {"id": "91e29c88-544e-4637-b12a-3fd62802f1cf", "address": "fa:16:3e:92:b9:46", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e29c88-54", "ovs_interfaceid": "91e29c88-544e-4637-b12a-3fd62802f1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:b9:46,bridge_name='br-int',has_traffic_filtering=True,id=91e29c88-544e-4637-b12a-3fd62802f1cf,network=Network(7558883d-4135-4f8d-ac25-dccea82839e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e29c88-54') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lazy-loading 'pci_devices' on Instance uuid f6b3497d-2998-48ba-9604-4332afa95c29 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:36:23 user nova-compute[75071]:   <uuid>f6b3497d-2998-48ba-9604-4332afa95c29</uuid>
Dec 05 12:36:23 user nova-compute[75071]:   <name>instance-00000026</name>
Dec 05 12:36:23 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:36:23 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:36:23 user nova-compute[75071]:   <metadata>
Dec 05 12:36:23 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:36:23 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:36:23 user nova-compute[75071]:       <nova:name>tempest-ServersNegativeTestJSON-server-1959430990</nova:name>
Dec 05 12:36:23 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:36:23</nova:creationTime>
Dec 05 12:36:23 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:36:23 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:36:23 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:36:23 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:36:23 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:36:23 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:36:23 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:36:23 user nova-compute[75071]:       <nova:owner>
Dec 05 12:36:23 user nova-compute[75071]:         <nova:user uuid="3f07cde1f0ad4139ade7efe260ad7545">tempest-ServersNegativeTestJSON-508219572-project-member</nova:user>
Dec 05 12:36:23 user nova-compute[75071]:         <nova:project uuid="1c9933b6650941d58025487be8dedc17">tempest-ServersNegativeTestJSON-508219572</nova:project>
Dec 05 12:36:23 user nova-compute[75071]:       </nova:owner>
Dec 05 12:36:23 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:36:23 user nova-compute[75071]:       <nova:ports>
Dec 05 12:36:23 user nova-compute[75071]:         <nova:port uuid="91e29c88-544e-4637-b12a-3fd62802f1cf">
Dec 05 12:36:23 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 05 12:36:23 user nova-compute[75071]:         </nova:port>
Dec 05 12:36:23 user nova-compute[75071]:       </nova:ports>
Dec 05 12:36:23 user nova-compute[75071]:     </nova:instance>
Dec 05 12:36:23 user nova-compute[75071]:   </metadata>
Dec 05 12:36:23 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:36:23 user nova-compute[75071]:     <system>
Dec 05 12:36:23 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:36:23 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:36:23 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:36:23 user nova-compute[75071]:       <entry name="serial">f6b3497d-2998-48ba-9604-4332afa95c29</entry>
Dec 05 12:36:23 user nova-compute[75071]:       <entry name="uuid">f6b3497d-2998-48ba-9604-4332afa95c29</entry>
Dec 05 12:36:23 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:36:23 user nova-compute[75071]:     </system>
Dec 05 12:36:23 user nova-compute[75071]:   </sysinfo>
Dec 05 12:36:23 user nova-compute[75071]:   <os>
Dec 05 12:36:23 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:36:23 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:36:23 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:36:23 user nova-compute[75071]:   </os>
Dec 05 12:36:23 user nova-compute[75071]:   <features>
Dec 05 12:36:23 user nova-compute[75071]:     <acpi/>
Dec 05 12:36:23 user nova-compute[75071]:     <apic/>
Dec 05 12:36:23 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:36:23 user nova-compute[75071]:   </features>
Dec 05 12:36:23 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:36:23 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:36:23 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:36:23 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:36:23 user nova-compute[75071]:   </clock>
Dec 05 12:36:23 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:36:23 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:36:23 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:36:23 user nova-compute[75071]:   </cpu>
Dec 05 12:36:23 user nova-compute[75071]:   <devices>
Dec 05 12:36:23 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:36:23 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:36:23 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk"/>
Dec 05 12:36:23 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:36:23 user nova-compute[75071]:     </disk>
Dec 05 12:36:23 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:36:23 user nova-compute[75071]:       <mac address="fa:16:3e:92:b9:46"/>
Dec 05 12:36:23 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:36:23 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:36:23 user nova-compute[75071]:       <target dev="tap91e29c88-54"/>
Dec 05 12:36:23 user nova-compute[75071]:     </interface>
Dec 05 12:36:23 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:36:23 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/console.log" append="off"/>
Dec 05 12:36:23 user nova-compute[75071]:     </serial>
Dec 05 12:36:23 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:36:23 user nova-compute[75071]:     <video>
Dec 05 12:36:23 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:36:23 user nova-compute[75071]:     </video>
Dec 05 12:36:23 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:36:23 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:36:23 user nova-compute[75071]:     </rng>
Dec 05 12:36:23 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:36:23 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:36:23 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:36:23 user nova-compute[75071]:     </memballoon>
Dec 05 12:36:23 user nova-compute[75071]:   </devices>
Dec 05 12:36:23 user nova-compute[75071]: </domain>
Dec 05 12:36:23 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:36:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1959430990',display_name='tempest-ServersNegativeTestJSON-server-1959430990',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1959430990',id=38,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c9933b6650941d58025487be8dedc17',ramdisk_id='',reservation_id='r-sf4icequ',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-508219572',owner_user_name='tempest-ServersNegativeTestJSON-508219572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:36:21Z,user_data=None,user_id='3f07cde1f0ad4139ade7efe260ad7545',uuid=f6b3497d-2998-48ba-9604-4332afa95c29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91e29c88-544e-4637-b12a-3fd62802f1cf", "address": "fa:16:3e:92:b9:46", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e29c88-54", "ovs_interfaceid": "91e29c88-544e-4637-b12a-3fd62802f1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Converting VIF {"id": "91e29c88-544e-4637-b12a-3fd62802f1cf", "address": "fa:16:3e:92:b9:46", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e29c88-54", "ovs_interfaceid": "91e29c88-544e-4637-b12a-3fd62802f1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:b9:46,bridge_name='br-int',has_traffic_filtering=True,id=91e29c88-544e-4637-b12a-3fd62802f1cf,network=Network(7558883d-4135-4f8d-ac25-dccea82839e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e29c88-54') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG os_vif [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:b9:46,bridge_name='br-int',has_traffic_filtering=True,id=91e29c88-544e-4637-b12a-3fd62802f1cf,network=Network(7558883d-4135-4f8d-ac25-dccea82839e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e29c88-54') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6099176b-fc2f-58c8-b847-96dca243cfbc', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91e29c88-54, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91e29c88-54, col_values=(('qos', UUID('ed6b97c5-7cff-444a-b095-293ed0364166')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91e29c88-54, col_values=(('external_ids', {'iface-id': '91e29c88-544e-4637-b12a-3fd62802f1cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:b9:46', 'vm-uuid': 'f6b3497d-2998-48ba-9604-4332afa95c29'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:23 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Took 1.38 seconds to deallocate network for instance.
Dec 05 12:36:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:23 user nova-compute[75071]: INFO os_vif [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:b9:46,bridge_name='br-int',has_traffic_filtering=True,id=91e29c88-544e-4637-b12a-3fd62802f1cf,network=Network(7558883d-4135-4f8d-ac25-dccea82839e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e29c88-54')
Dec 05 12:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] No VIF found with MAC fa:16:3e:92:b9:46, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-0b5f7407-85c1-41ef-ad51-8f3e986ca3b2 req-0889673f-c96d-437d-8d48-0f3d58b45684 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received event network-vif-plugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b5f7407-85c1-41ef-ad51-8f3e986ca3b2 req-0889673f-c96d-437d-8d48-0f3d58b45684 service nova] Acquiring lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b5f7407-85c1-41ef-ad51-8f3e986ca3b2 req-0889673f-c96d-437d-8d48-0f3d58b45684 service nova] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b5f7407-85c1-41ef-ad51-8f3e986ca3b2 req-0889673f-c96d-437d-8d48-0f3d58b45684 service nova] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:36:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-0b5f7407-85c1-41ef-ad51-8f3e986ca3b2 req-0889673f-c96d-437d-8d48-0f3d58b45684 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] No waiting events found dispatching network-vif-plugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:36:23 user nova-compute[75071]: WARNING nova.compute.manager [req-0b5f7407-85c1-41ef-ad51-8f3e986ca3b2 req-0889673f-c96d-437d-8d48-0f3d58b45684 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received unexpected event network-vif-plugged-52df8e8e-e80a-4f0a-b496-63771b5e63a7 for instance with vm_state deleted and task_state None.
Dec 05 12:36:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:24 user nova-compute[75071]: DEBUG nova.network.neutron [req-463b86ab-5321-4fe4-b6dc-2cfed5685ead req-a3d0900a-8bdf-4297-b425-0cf5b8f929df service nova] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Updated VIF entry in instance network info cache for port 91e29c88-544e-4637-b12a-3fd62802f1cf. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:36:24 user nova-compute[75071]: DEBUG nova.network.neutron [req-463b86ab-5321-4fe4-b6dc-2cfed5685ead req-a3d0900a-8bdf-4297-b425-0cf5b8f929df service nova] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Updating instance_info_cache with network_info: [{"id": "91e29c88-544e-4637-b12a-3fd62802f1cf", "address": "fa:16:3e:92:b9:46", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e29c88-54", "ovs_interfaceid": "91e29c88-544e-4637-b12a-3fd62802f1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:36:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-463b86ab-5321-4fe4-b6dc-2cfed5685ead req-a3d0900a-8bdf-4297-b425-0cf5b8f929df service nova] Releasing lock "refresh_cache-f6b3497d-2998-48ba-9604-4332afa95c29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:36:24 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:36:24 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:36:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:36:24 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Deleted allocations for instance 77c962a7-587a-41be-b87d-ab416b8b43fd
Dec 05 12:36:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ca3e8fbe-e7b9-477c-80cb-6d1c0c7c51f6 tempest-AttachVolumeShelveTestJSON-1822750901 tempest-AttachVolumeShelveTestJSON-1822750901-project-member] Lock "77c962a7-587a-41be-b87d-ab416b8b43fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.920s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:36:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-486e4417-1634-4e67-a5c4-fcd2d7455647 req-2468182d-67bf-47f7-af9e-f0aaf98818e9 service nova] [instance: 77c962a7-587a-41be-b87d-ab416b8b43fd] Received event network-vif-deleted-52df8e8e-e80a-4f0a-b496-63771b5e63a7 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:36:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-2d8986fc-4d63-4bfa-bc8e-161c1f6181dc req-cb5e763d-4042-4ec2-97fc-3387821ce0bc service nova] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Received event network-vif-plugged-91e29c88-544e-4637-b12a-3fd62802f1cf {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:36:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2d8986fc-4d63-4bfa-bc8e-161c1f6181dc req-cb5e763d-4042-4ec2-97fc-3387821ce0bc service nova] Acquiring lock "f6b3497d-2998-48ba-9604-4332afa95c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:36:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2d8986fc-4d63-4bfa-bc8e-161c1f6181dc req-cb5e763d-4042-4ec2-97fc-3387821ce0bc service nova] Lock "f6b3497d-2998-48ba-9604-4332afa95c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:36:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2d8986fc-4d63-4bfa-bc8e-161c1f6181dc req-cb5e763d-4042-4ec2-97fc-3387821ce0bc service nova] Lock "f6b3497d-2998-48ba-9604-4332afa95c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:36:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-2d8986fc-4d63-4bfa-bc8e-161c1f6181dc req-cb5e763d-4042-4ec2-97fc-3387821ce0bc service nova] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] No waiting events found dispatching network-vif-plugged-91e29c88-544e-4637-b12a-3fd62802f1cf {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:36:25 user nova-compute[75071]: WARNING nova.compute.manager [req-2d8986fc-4d63-4bfa-bc8e-161c1f6181dc req-cb5e763d-4042-4ec2-97fc-3387821ce0bc service nova] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Received unexpected event network-vif-plugged-91e29c88-544e-4637-b12a-3fd62802f1cf for instance with vm_state building and task_state spawning.
Dec 05 12:36:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-2d8986fc-4d63-4bfa-bc8e-161c1f6181dc req-cb5e763d-4042-4ec2-97fc-3387821ce0bc service nova] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Received event network-vif-plugged-91e29c88-544e-4637-b12a-3fd62802f1cf {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:36:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2d8986fc-4d63-4bfa-bc8e-161c1f6181dc req-cb5e763d-4042-4ec2-97fc-3387821ce0bc service nova] Acquiring lock "f6b3497d-2998-48ba-9604-4332afa95c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:36:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2d8986fc-4d63-4bfa-bc8e-161c1f6181dc req-cb5e763d-4042-4ec2-97fc-3387821ce0bc service nova] Lock "f6b3497d-2998-48ba-9604-4332afa95c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:36:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2d8986fc-4d63-4bfa-bc8e-161c1f6181dc req-cb5e763d-4042-4ec2-97fc-3387821ce0bc service nova] Lock "f6b3497d-2998-48ba-9604-4332afa95c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:36:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-2d8986fc-4d63-4bfa-bc8e-161c1f6181dc req-cb5e763d-4042-4ec2-97fc-3387821ce0bc service nova] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] No waiting events found dispatching network-vif-plugged-91e29c88-544e-4637-b12a-3fd62802f1cf {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:36:25 user nova-compute[75071]: WARNING nova.compute.manager [req-2d8986fc-4d63-4bfa-bc8e-161c1f6181dc req-cb5e763d-4042-4ec2-97fc-3387821ce0bc service nova] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Received unexpected event network-vif-plugged-91e29c88-544e-4637-b12a-3fd62802f1cf for instance with vm_state building and task_state spawning.
Dec 05 12:36:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:36:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:36:27 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Instance spawned successfully.
Dec 05 12:36:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:36:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:36:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:36:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:36:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:36:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:36:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:36:27 user nova-compute[75071]: INFO nova.compute.manager [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Took 6.42 seconds to spawn the instance on the hypervisor.
Dec 05 12:36:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:36:27 user nova-compute[75071]: INFO nova.compute.manager [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Took 7.16 seconds to build instance.
Dec 05 12:36:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2ad54e3f-faf5-4ccf-b107-47034344fcc9 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "f6b3497d-2998-48ba-9604-4332afa95c29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.261s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:36:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:31 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance ce0b3e61-f8dd-487a-a81a-a466c45f0814 is timed out.
Dec 05 12:36:31 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Successfully detached device vdc from instance ce0b3e61-f8dd-487a-a81a-a466c45f0814 from the live domain config.
Dec 05 12:36:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkYuMBHP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:36:31 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f70698d-d615-4989-b0c1-e1019dde8238]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:36:31 user nova-compute[75071]: No targets found.
Dec 05 12:36:31 user nova-compute[75071]: iSNS:
Dec 05 12:36:31 user nova-compute[75071]: No targets found.
Dec 05 12:36:31 user nova-compute[75071]: STATIC:
Dec 05 12:36:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c
Dec 05 12:36:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:36:31 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:36:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e
Dec 05 12:36:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:36:31 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:36:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:36:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:36:31 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:36:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77
Dec 05 12:36:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:36:31 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:36:31 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6
Dec 05 12:36:31 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:36:31 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:36:31 user nova-compute[75071]: FIRMWARE:
Dec 05 12:36:31 user nova-compute[75071]: No targets found.
Dec 05 12:36:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:36:31 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:36:31 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc83ac8a-f91a-44cd-9e23-ad6e614e0cd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[660a4b8c-99ea-4f9c-9c6a-4b70bb66eb42]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:36:31 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:36:31 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)
Dec 05 12:36:31 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e (non-flash)
Dec 05 12:36:31 user nova-compute[75071]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 (non-flash)
Dec 05 12:36:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:36:31 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:36:31 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)
Dec 05 12:36:31 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e (non-flash)
Dec 05 12:36:31 user nova-compute[75071]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 (non-flash)
Dec 05 12:36:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82643b6680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6'): ({'sde'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Removing single pathed devices sde {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cda262a-343a-4858-9d12-0cf9185baf23]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01d69a9-1834-4d34-8e20-6f9938f789fc]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Flushing IO for device /dev/sde {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c90ce2a-5c0e-4dad-bf6d-cfbeb8111f1a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed485a3-1248-4e16-90bc-cf8be2378037]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] SCSI volumes sde have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30a77e8-463c-4c1d-8a48-1f39ce1cc725]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bf7beb-5e7d-4ceb-bc7a-f85b0500b7f0]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6, portal: 172.16.0.220,3260]
Dec 05 12:36:31 user nova-compute[75071]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6, portal: 172.16.0.220,3260] successful.
Dec 05 12:36:31 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ed711-1548-4a3a-b410-c639e00703f6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8115e95a-dcfc-481e-bf5a-d829d1560a71]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] <== disconnect_volume: return (330ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:36:31 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:36:32 user nova-compute[75071]: DEBUG nova.objects.instance [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lazy-loading 'flavor' on Instance uuid ce0b3e61-f8dd-487a-a81a-a466c45f0814 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:36:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-41bfbf14-88e5-4df4-b57c-6d63d61dbd20 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.860s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:36:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-c45f5ced-3678-4ea5-bea8-f9c82f08e76d req-ddd7b366-9204-4a05-98ea-7b78d26a9163 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received event network-changed-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:36:34 user nova-compute[75071]: DEBUG nova.compute.manager [req-c45f5ced-3678-4ea5-bea8-f9c82f08e76d req-ddd7b366-9204-4a05-98ea-7b78d26a9163 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Refreshing instance network info cache due to event network-changed-bf98e48b-bb55-447a-88ce-caed2d082b9b. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:36:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c45f5ced-3678-4ea5-bea8-f9c82f08e76d req-ddd7b366-9204-4a05-98ea-7b78d26a9163 service nova] Acquiring lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:36:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c45f5ced-3678-4ea5-bea8-f9c82f08e76d req-ddd7b366-9204-4a05-98ea-7b78d26a9163 service nova] Acquired lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:36:34 user nova-compute[75071]: DEBUG nova.network.neutron [req-c45f5ced-3678-4ea5-bea8-f9c82f08e76d req-ddd7b366-9204-4a05-98ea-7b78d26a9163 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Refreshing network info cache for port bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:36:34 user nova-compute[75071]: DEBUG nova.network.neutron [req-c45f5ced-3678-4ea5-bea8-f9c82f08e76d req-ddd7b366-9204-4a05-98ea-7b78d26a9163 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Updated VIF entry in instance network info cache for port bf98e48b-bb55-447a-88ce-caed2d082b9b. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:36:34 user nova-compute[75071]: DEBUG nova.network.neutron [req-c45f5ced-3678-4ea5-bea8-f9c82f08e76d req-ddd7b366-9204-4a05-98ea-7b78d26a9163 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Updating instance_info_cache with network_info: [{"id": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "address": "fa:16:3e:40:8d:36", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf98e48b-bb", "ovs_interfaceid": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:36:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-c45f5ced-3678-4ea5-bea8-f9c82f08e76d req-ddd7b366-9204-4a05-98ea-7b78d26a9163 service nova] Releasing lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:36:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "015e89c3-73ad-4bfd-b55c-68323fae2b29" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:36:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:36:34 user nova-compute[75071]: INFO nova.compute.manager [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Detaching volume f4d8820c-9c02-4d00-880a-f5cedafd6c77
Dec 05 12:36:34 user nova-compute[75071]: INFO nova.virt.block_device [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Attempting to driver detach volume f4d8820c-9c02-4d00-880a-f5cedafd6c77 from mountpoint /dev/vdb
Dec 05 12:36:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Attempting to detach device vdb from instance 015e89c3-73ad-4bfd-b55c-68323fae2b29 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:36:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:36:34 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:36:34 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Dec 05 12:36:34 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:36:34 user nova-compute[75071]:   <serial>f4d8820c-9c02-4d00-880a-f5cedafd6c77</serial>
Dec 05 12:36:34 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:36:34 user nova-compute[75071]: </disk>
Dec 05 12:36:34 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:36:34 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Successfully detached device vdb from instance 015e89c3-73ad-4bfd-b55c-68323fae2b29 from the persistent domain config.
Dec 05 12:36:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 015e89c3-73ad-4bfd-b55c-68323fae2b29 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:36:34 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:36:34 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:36:34 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Dec 05 12:36:34 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:36:34 user nova-compute[75071]:   <serial>f4d8820c-9c02-4d00-880a-f5cedafd6c77</serial>
Dec 05 12:36:34 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:36:34 user nova-compute[75071]: </disk>
Dec 05 12:36:34 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:36:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 015e89c3-73ad-4bfd-b55c-68323fae2b29 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:36:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-89b0946d-2c15-4a1b-9fad-bd95501ed6dd req-6bbcfdb9-f2f4-44fc-af45-46f2c50f3fe2 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received event network-changed-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:36:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-89b0946d-2c15-4a1b-9fad-bd95501ed6dd req-6bbcfdb9-f2f4-44fc-af45-46f2c50f3fe2 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Refreshing instance network info cache due to event network-changed-bf98e48b-bb55-447a-88ce-caed2d082b9b. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:36:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-89b0946d-2c15-4a1b-9fad-bd95501ed6dd req-6bbcfdb9-f2f4-44fc-af45-46f2c50f3fe2 service nova] Acquiring lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:36:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-89b0946d-2c15-4a1b-9fad-bd95501ed6dd req-6bbcfdb9-f2f4-44fc-af45-46f2c50f3fe2 service nova] Acquired lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:36:36 user nova-compute[75071]: DEBUG nova.network.neutron [req-89b0946d-2c15-4a1b-9fad-bd95501ed6dd req-6bbcfdb9-f2f4-44fc-af45-46f2c50f3fe2 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Refreshing network info cache for port bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:36:36 user nova-compute[75071]: DEBUG nova.network.neutron [req-89b0946d-2c15-4a1b-9fad-bd95501ed6dd req-6bbcfdb9-f2f4-44fc-af45-46f2c50f3fe2 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Updated VIF entry in instance network info cache for port bf98e48b-bb55-447a-88ce-caed2d082b9b. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:36:36 user nova-compute[75071]: DEBUG nova.network.neutron [req-89b0946d-2c15-4a1b-9fad-bd95501ed6dd req-6bbcfdb9-f2f4-44fc-af45-46f2c50f3fe2 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Updating instance_info_cache with network_info: [{"id": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "address": "fa:16:3e:40:8d:36", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf98e48b-bb", "ovs_interfaceid": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:36:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-89b0946d-2c15-4a1b-9fad-bd95501ed6dd req-6bbcfdb9-f2f4-44fc-af45-46f2c50f3fe2 service nova] Releasing lock "refresh_cache-015e89c3-73ad-4bfd-b55c-68323fae2b29" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:36:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:36:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:36:53 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:36:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:36:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:36:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:36:53 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:36:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:53 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:54 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:36:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:54 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:55 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 015e89c3-73ad-4bfd-b55c-68323fae2b29 is timed out.
Dec 05 12:36:55 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Successfully detached device vdb from instance 015e89c3-73ad-4bfd-b55c-68323fae2b29 from the live domain config.
Dec 05 12:36:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dSpGvzRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:36:55 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee691738-513a-4c80-b79d-e37f7ec5d066]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:36:55 user nova-compute[75071]: No targets found.
Dec 05 12:36:55 user nova-compute[75071]: iSNS:
Dec 05 12:36:55 user nova-compute[75071]: No targets found.
Dec 05 12:36:55 user nova-compute[75071]: STATIC:
Dec 05 12:36:55 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c
Dec 05 12:36:55 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:36:55 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:36:55 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e
Dec 05 12:36:55 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:36:55 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:36:55 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:36:55 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:36:55 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:36:55 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77
Dec 05 12:36:55 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:36:55 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:36:55 user nova-compute[75071]: FIRMWARE:
Dec 05 12:36:55 user nova-compute[75071]: No targets found.
Dec 05 12:36:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:36:55 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:36:55 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfd407f-d3cc-41fd-81a0-d814570a4faf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[395e492f-ca6d-4f8e-96fc-1643c3449b6f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:36:55 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:36:55 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)
Dec 05 12:36:55 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e (non-flash)
Dec 05 12:36:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:36:55 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:36:55 user nova-compute[75071]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 (non-flash)
Dec 05 12:36:55 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e (non-flash)
Dec 05 12:36:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f826413bac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77'): ({'sdd'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Removing single pathed devices sdd {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e24125-6d17-44b1-9685-9207e3525fc0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad26ca3-80f7-4c34-a70d-9a34a7f6ccaa]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Flushing IO for device /dev/sdd {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b48a1c7-80c0-4b1f-89f5-878b7edb1725]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d0323c-7edd-4fe0-9e08-b07afa8fc1a5]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b55490-2c80-48d5-ac06-a93649c83c7c]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31321fd-3c2a-4984-94dc-96acfe3482ef]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77, portal: 172.16.0.220,3260]
Dec 05 12:36:55 user nova-compute[75071]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77, portal: 172.16.0.220,3260] successful.
Dec 05 12:36:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4d8820c-9c02-4d00-880a-f5cedafd6c77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9303a31-7044-428b-994d-07d64a777399]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] <== disconnect_volume: return (355ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:56 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'flavor' on Instance uuid 015e89c3-73ad-4bfd-b55c-68323fae2b29 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d29bbbf2-10af-45b2-b68b-27bd65acdbcb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.773s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:36:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:36:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:36:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:36:57 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:36:57 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:36:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=7893MB free_disk=24.771011352539062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:36:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:36:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:36:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:36:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:36:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:36:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:36:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 42776e73-1ef0-4c57-a50a-942f6f4881de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:36:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 015e89c3-73ad-4bfd-b55c-68323fae2b29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:36:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance ce0b3e61-f8dd-487a-a81a-a466c45f0814 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:36:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9f492779-584e-4a21-9991-78de01f6670c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:36:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance f6b3497d-2998-48ba-9604-4332afa95c29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:36:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:36:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:36:58 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:36:58 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:36:58 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:36:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.420s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:36:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:36:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:36:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:36:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:36:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:36:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:36:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:37:00 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:37:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:01 user nova-compute[75071]: INFO nova.compute.manager [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Detaching volume 41722047-7961-4ab1-9df9-7362702aad5e
Dec 05 12:37:01 user nova-compute[75071]: INFO nova.virt.block_device [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Attempting to driver detach volume 41722047-7961-4ab1-9df9-7362702aad5e from mountpoint /dev/vdb
Dec 05 12:37:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Attempting to detach device vdb from instance ce0b3e61-f8dd-487a-a81a-a466c45f0814 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:37:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:37:01 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:37:01 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:37:01 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:37:01 user nova-compute[75071]:   <serial>41722047-7961-4ab1-9df9-7362702aad5e</serial>
Dec 05 12:37:01 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:37:01 user nova-compute[75071]: </disk>
Dec 05 12:37:01 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:37:01 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Successfully detached device vdb from instance ce0b3e61-f8dd-487a-a81a-a466c45f0814 from the persistent domain config.
Dec 05 12:37:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce0b3e61-f8dd-487a-a81a-a466c45f0814 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:37:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:37:01 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:37:01 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:37:01 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:37:01 user nova-compute[75071]:   <serial>41722047-7961-4ab1-9df9-7362702aad5e</serial>
Dec 05 12:37:01 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:37:01 user nova-compute[75071]: </disk>
Dec 05 12:37:01 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:37:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce0b3e61-f8dd-487a-a81a-a466c45f0814 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:37:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:04 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:37:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:37:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:37:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:37:04 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:37:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Updating instance_info_cache with network_info: [{"id": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "address": "fa:16:3e:53:ed:01", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd15e936-54", "ovs_interfaceid": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:37:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:37:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:37:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:37:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:37:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:37:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:37:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:21 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ce0b3e61-f8dd-487a-a81a-a466c45f0814 is timed out.
Dec 05 12:37:21 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Successfully detached device vdb from instance ce0b3e61-f8dd-487a-a81a-a466c45f0814 from the live domain config.
Dec 05 12:37:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:37:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UBDpTryl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:37:21 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:37:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:37:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:37:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8424bfc5-37c9-4c66-848c-c0ec7903236b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:37:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:37:21 user nova-compute[75071]: No targets found.
Dec 05 12:37:21 user nova-compute[75071]: iSNS:
Dec 05 12:37:21 user nova-compute[75071]: No targets found.
Dec 05 12:37:21 user nova-compute[75071]: STATIC:
Dec 05 12:37:21 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c
Dec 05 12:37:21 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:37:21 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:37:21 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e
Dec 05 12:37:21 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:37:21 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:37:21 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:37:21 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:37:21 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:37:21 user nova-compute[75071]: FIRMWARE:
Dec 05 12:37:21 user nova-compute[75071]: No targets found.
Dec 05 12:37:21 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:37:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:37:21 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:37:21 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:37:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:37:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d733e0f-0544-4547-8c55-dfb55f4647be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:37:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:21 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2044ba35-baae-45c2-b4a3-27bae2368a81]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:37:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:37:21 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:37:21 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e (non-flash)
Dec 05 12:37:21 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:37:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:37:21 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:37:21 user nova-compute[75071]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e (non-flash)
Dec 05 12:37:21 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:37:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8264795a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:37:21 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:37:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[83964fd2-eb24-4042-8135-502d245a8c41]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6971f134-8075-48c9-9860-58f4b2d25071]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[646daa4f-cb5c-4dab-8ca0-b7dfc611593f]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc4e6fc-d4bd-48d9-8cf6-422ed12397dc]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2dc35c2-a271-464f-932c-22f5cd4bd83a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcaa0ca-16a1-48ab-82ec-2b82a1905cb7]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e, portal: 172.16.0.220,3260]
Dec 05 12:37:22 user nova-compute[75071]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e, portal: 172.16.0.220,3260] successful.
Dec 05 12:37:22 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41722047-7961-4ab1-9df9-7362702aad5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[06832b42-7ad0-497c-a92d-81eea3e210b3]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] <== disconnect_volume: return (291ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:37:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:37:23 user nova-compute[75071]: DEBUG nova.objects.instance [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lazy-loading 'flavor' on Instance uuid ce0b3e61-f8dd-487a-a81a-a466c45f0814 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:37:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-db903f81-fb9e-4a97-90f4-e438fde88a51 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.809s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "015e89c3-73ad-4bfd-b55c-68323fae2b29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:24 user nova-compute[75071]: INFO nova.compute.manager [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Terminating instance
Dec 05 12:37:24 user nova-compute[75071]: DEBUG nova.compute.manager [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-0fe6337b-6286-42e5-aa23-5506c38319d6 req-d7972b63-ff2f-4d9d-a1fe-7f7a4cfea802 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received event network-vif-unplugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0fe6337b-6286-42e5-aa23-5506c38319d6 req-d7972b63-ff2f-4d9d-a1fe-7f7a4cfea802 service nova] Acquiring lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0fe6337b-6286-42e5-aa23-5506c38319d6 req-d7972b63-ff2f-4d9d-a1fe-7f7a4cfea802 service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0fe6337b-6286-42e5-aa23-5506c38319d6 req-d7972b63-ff2f-4d9d-a1fe-7f7a4cfea802 service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-0fe6337b-6286-42e5-aa23-5506c38319d6 req-d7972b63-ff2f-4d9d-a1fe-7f7a4cfea802 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] No waiting events found dispatching network-vif-unplugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-0fe6337b-6286-42e5-aa23-5506c38319d6 req-d7972b63-ff2f-4d9d-a1fe-7f7a4cfea802 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received event network-vif-unplugged-bf98e48b-bb55-447a-88ce-caed2d082b9b for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:25 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Instance destroyed successfully.
Dec 05 12:37:25 user nova-compute[75071]: DEBUG nova.objects.instance [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'resources' on Instance uuid 015e89c3-73ad-4bfd-b55c-68323fae2b29 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:30:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2020941888',display_name='tempest-ServerRescueNegativeTestJSON-server-2020941888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2020941888',id=34,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOFth0oBwzOM1o5M+S301WBgFD1bDBox6dwVpPgnPJPuFdVExY6JDCk+kMORijWFHc7di8Z2h3DrLTrM16EW06eFFgSSHFESCZZN6ETdKv+69qC+C5Ro0WG5ROvMgSQkRQ==',key_name='tempest-keypair-955735893',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:32:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b958a2138af24f5a860e7a0c99d9ebb5',ramdisk_id='',reservation_id='r-jbvwgw0k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-170727457',owner_user_name='tempest-ServerRescueNegativeTestJSON-170727457-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:34:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3312b55016d34680b6873eedf97e9a8f',uuid=015e89c3-73ad-4bfd-b55c-68323fae2b29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "address": "fa:16:3e:40:8d:36", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf98e48b-bb", "ovs_interfaceid": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converting VIF {"id": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "address": "fa:16:3e:40:8d:36", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf98e48b-bb", "ovs_interfaceid": "bf98e48b-bb55-447a-88ce-caed2d082b9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:8d:36,bridge_name='br-int',has_traffic_filtering=True,id=bf98e48b-bb55-447a-88ce-caed2d082b9b,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf98e48b-bb') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG os_vif [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:8d:36,bridge_name='br-int',has_traffic_filtering=True,id=bf98e48b-bb55-447a-88ce-caed2d082b9b,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf98e48b-bb') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf98e48b-bb, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aead94b3-d5f2-466a-bf05-263424a5acdc) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:37:25 user nova-compute[75071]: INFO os_vif [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:8d:36,bridge_name='br-int',has_traffic_filtering=True,id=bf98e48b-bb55-447a-88ce-caed2d082b9b,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf98e48b-bb')
Dec 05 12:37:25 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Deleting instance files /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29_del
Dec 05 12:37:25 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Deletion of /opt/stack/data/nova/instances/015e89c3-73ad-4bfd-b55c-68323fae2b29_del complete
Dec 05 12:37:25 user nova-compute[75071]: INFO nova.compute.manager [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Took 0.86 seconds to destroy the instance on the hypervisor.
Dec 05 12:37:25 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:37:25 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:37:26 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:37:26 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Took 0.75 seconds to deallocate network for instance.
Dec 05 12:37:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-ad0f0ab0-dff6-409d-9f08-f9d9e5d7d396 req-a9330881-e429-4f28-8839-594f7641e860 service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received event network-vif-deleted-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:37:26 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:37:26 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:37:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:27 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Deleted allocations for instance 015e89c3-73ad-4bfd-b55c-68323fae2b29
Dec 05 12:37:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-74fbe5e1-c27e-40ef-9b22-467d3ae789f6 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.238s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-e39e42a6-0183-4741-96f0-e19512da0be9 req-2ccd6329-401c-42f3-8dab-01dc0df2ed7b service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received event network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:37:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e39e42a6-0183-4741-96f0-e19512da0be9 req-2ccd6329-401c-42f3-8dab-01dc0df2ed7b service nova] Acquiring lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e39e42a6-0183-4741-96f0-e19512da0be9 req-2ccd6329-401c-42f3-8dab-01dc0df2ed7b service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e39e42a6-0183-4741-96f0-e19512da0be9 req-2ccd6329-401c-42f3-8dab-01dc0df2ed7b service nova] Lock "015e89c3-73ad-4bfd-b55c-68323fae2b29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-e39e42a6-0183-4741-96f0-e19512da0be9 req-2ccd6329-401c-42f3-8dab-01dc0df2ed7b service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] No waiting events found dispatching network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:37:27 user nova-compute[75071]: WARNING nova.compute.manager [req-e39e42a6-0183-4741-96f0-e19512da0be9 req-2ccd6329-401c-42f3-8dab-01dc0df2ed7b service nova] [instance: 015e89c3-73ad-4bfd-b55c-68323fae2b29] Received unexpected event network-vif-plugged-bf98e48b-bb55-447a-88ce-caed2d082b9b for instance with vm_state deleted and task_state None.
Dec 05 12:37:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:37:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:34 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:37:34 user nova-compute[75071]: INFO nova.compute.claims [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Claim successful on node user
Dec 05 12:37:35 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG nova.network.neutron [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:37:35 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:37:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG nova.policy [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b2ab4b19a9b4ce397ffa1cc279e26ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9640f3ad175948f59ba184167e4bf5a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:37:35 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Creating image(s)
Dec 05 12:37:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "/opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "/opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk 1073741824" returned: 0 in 0.049s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:37:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:36 user nova-compute[75071]: DEBUG nova.network.neutron [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Successfully created port: de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:37:36 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:36 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Cannot resize image /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:37:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:37:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Ensure instance console log exists: /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:37:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:36 user nova-compute[75071]: DEBUG nova.network.neutron [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Successfully updated port: de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:37:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "refresh_cache-1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:37:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquired lock "refresh_cache-1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:37:36 user nova-compute[75071]: DEBUG nova.network.neutron [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:37:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-b0ad012a-c083-45dd-ac23-c178e8764c00 req-16d2cf02-0332-4dbe-b8a2-99776e0bbfed service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received event network-changed-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:37:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-b0ad012a-c083-45dd-ac23-c178e8764c00 req-16d2cf02-0332-4dbe-b8a2-99776e0bbfed service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Refreshing instance network info cache due to event network-changed-de4a3fbc-8399-45f2-9027-ec80fbaa1077. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:37:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b0ad012a-c083-45dd-ac23-c178e8764c00 req-16d2cf02-0332-4dbe-b8a2-99776e0bbfed service nova] Acquiring lock "refresh_cache-1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:37:36 user nova-compute[75071]: DEBUG nova.network.neutron [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:37:36 user nova-compute[75071]: DEBUG nova.network.neutron [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Updating instance_info_cache with network_info: [{"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Releasing lock "refresh_cache-1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Instance network_info: |[{"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b0ad012a-c083-45dd-ac23-c178e8764c00 req-16d2cf02-0332-4dbe-b8a2-99776e0bbfed service nova] Acquired lock "refresh_cache-1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.network.neutron [req-b0ad012a-c083-45dd-ac23-c178e8764c00 req-16d2cf02-0332-4dbe-b8a2-99776e0bbfed service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Refreshing network info cache for port de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Start _get_guest_xml network_info=[{"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:37:37 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:37:37 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2023774332',display_name='tempest-AttachVolumeTestJSON-server-2023774332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2023774332',id=39,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOMX/EZQmXhh7SdXzCFyRhmWDCDnYUHKgoB5uNuCbmikXutEQOOyGZ4O4+WzrfJeqIXgNW/+y2MaSiDfRCdQEgi/HUIV4qPam6B1OlLSXl5XEVzQ3IxLyJkjekI/XzLYg==',key_name='tempest-keypair-1505168977',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9640f3ad175948f59ba184167e4bf5a9',ramdisk_id='',reservation_id='r-er01om00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-660715611',owner_user_name='tempest-AttachVolumeTestJSON-660715611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:37:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b2ab4b19a9b4ce397ffa1cc279e26ac',uuid=1c4abc24-1295-4dd3-9fc4-8e8ac304fabf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converting VIF {"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.objects.instance [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:37:37 user nova-compute[75071]:   <uuid>1c4abc24-1295-4dd3-9fc4-8e8ac304fabf</uuid>
Dec 05 12:37:37 user nova-compute[75071]:   <name>instance-00000027</name>
Dec 05 12:37:37 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:37:37 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:37:37 user nova-compute[75071]:   <metadata>
Dec 05 12:37:37 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:37:37 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:37:37 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeTestJSON-server-2023774332</nova:name>
Dec 05 12:37:37 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:37:37</nova:creationTime>
Dec 05 12:37:37 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:37:37 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:37:37 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:37:37 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:37:37 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:37:37 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:37:37 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:37:37 user nova-compute[75071]:       <nova:owner>
Dec 05 12:37:37 user nova-compute[75071]:         <nova:user uuid="2b2ab4b19a9b4ce397ffa1cc279e26ac">tempest-AttachVolumeTestJSON-660715611-project-member</nova:user>
Dec 05 12:37:37 user nova-compute[75071]:         <nova:project uuid="9640f3ad175948f59ba184167e4bf5a9">tempest-AttachVolumeTestJSON-660715611</nova:project>
Dec 05 12:37:37 user nova-compute[75071]:       </nova:owner>
Dec 05 12:37:37 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:37:37 user nova-compute[75071]:       <nova:ports>
Dec 05 12:37:37 user nova-compute[75071]:         <nova:port uuid="de4a3fbc-8399-45f2-9027-ec80fbaa1077">
Dec 05 12:37:37 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 12:37:37 user nova-compute[75071]:         </nova:port>
Dec 05 12:37:37 user nova-compute[75071]:       </nova:ports>
Dec 05 12:37:37 user nova-compute[75071]:     </nova:instance>
Dec 05 12:37:37 user nova-compute[75071]:   </metadata>
Dec 05 12:37:37 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:37:37 user nova-compute[75071]:     <system>
Dec 05 12:37:37 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:37:37 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:37:37 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:37:37 user nova-compute[75071]:       <entry name="serial">1c4abc24-1295-4dd3-9fc4-8e8ac304fabf</entry>
Dec 05 12:37:37 user nova-compute[75071]:       <entry name="uuid">1c4abc24-1295-4dd3-9fc4-8e8ac304fabf</entry>
Dec 05 12:37:37 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:37:37 user nova-compute[75071]:     </system>
Dec 05 12:37:37 user nova-compute[75071]:   </sysinfo>
Dec 05 12:37:37 user nova-compute[75071]:   <os>
Dec 05 12:37:37 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:37:37 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:37:37 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:37:37 user nova-compute[75071]:   </os>
Dec 05 12:37:37 user nova-compute[75071]:   <features>
Dec 05 12:37:37 user nova-compute[75071]:     <acpi/>
Dec 05 12:37:37 user nova-compute[75071]:     <apic/>
Dec 05 12:37:37 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:37:37 user nova-compute[75071]:   </features>
Dec 05 12:37:37 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:37:37 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:37:37 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:37:37 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:37:37 user nova-compute[75071]:   </clock>
Dec 05 12:37:37 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:37:37 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:37:37 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:37:37 user nova-compute[75071]:   </cpu>
Dec 05 12:37:37 user nova-compute[75071]:   <devices>
Dec 05 12:37:37 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:37:37 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:37:37 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk"/>
Dec 05 12:37:37 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:37:37 user nova-compute[75071]:     </disk>
Dec 05 12:37:37 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:37:37 user nova-compute[75071]:       <mac address="fa:16:3e:3e:4e:da"/>
Dec 05 12:37:37 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:37:37 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:37:37 user nova-compute[75071]:       <target dev="tapde4a3fbc-83"/>
Dec 05 12:37:37 user nova-compute[75071]:     </interface>
Dec 05 12:37:37 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:37:37 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/console.log" append="off"/>
Dec 05 12:37:37 user nova-compute[75071]:     </serial>
Dec 05 12:37:37 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:37:37 user nova-compute[75071]:     <video>
Dec 05 12:37:37 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:37:37 user nova-compute[75071]:     </video>
Dec 05 12:37:37 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:37:37 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:37:37 user nova-compute[75071]:     </rng>
Dec 05 12:37:37 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:37:37 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:37:37 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:37:37 user nova-compute[75071]:     </memballoon>
Dec 05 12:37:37 user nova-compute[75071]:   </devices>
Dec 05 12:37:37 user nova-compute[75071]: </domain>
Dec 05 12:37:37 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2023774332',display_name='tempest-AttachVolumeTestJSON-server-2023774332',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2023774332',id=39,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOMX/EZQmXhh7SdXzCFyRhmWDCDnYUHKgoB5uNuCbmikXutEQOOyGZ4O4+WzrfJeqIXgNW/+y2MaSiDfRCdQEgi/HUIV4qPam6B1OlLSXl5XEVzQ3IxLyJkjekI/XzLYg==',key_name='tempest-keypair-1505168977',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9640f3ad175948f59ba184167e4bf5a9',ramdisk_id='',reservation_id='r-er01om00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-660715611',owner_user_name='tempest-AttachVolumeTestJSON-660715611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:37:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b2ab4b19a9b4ce397ffa1cc279e26ac',uuid=1c4abc24-1295-4dd3-9fc4-8e8ac304fabf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converting VIF {"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG os_vif [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa24488e-06b5-56b4-8ab6-f81fd6f9b97c', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde4a3fbc-83, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde4a3fbc-83, col_values=(('qos', UUID('ee984adf-cdec-4fb4-9de4-09297d218350')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde4a3fbc-83, col_values=(('external_ids', {'iface-id': 'de4a3fbc-8399-45f2-9027-ec80fbaa1077', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:4e:da', 'vm-uuid': '1c4abc24-1295-4dd3-9fc4-8e8ac304fabf'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:37 user nova-compute[75071]: INFO os_vif [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83')
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] No VIF found with MAC fa:16:3e:3e:4e:da, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.network.neutron [req-b0ad012a-c083-45dd-ac23-c178e8764c00 req-16d2cf02-0332-4dbe-b8a2-99776e0bbfed service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Updated VIF entry in instance network info cache for port de4a3fbc-8399-45f2-9027-ec80fbaa1077. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG nova.network.neutron [req-b0ad012a-c083-45dd-ac23-c178e8764c00 req-16d2cf02-0332-4dbe-b8a2-99776e0bbfed service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Updating instance_info_cache with network_info: [{"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:37:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b0ad012a-c083-45dd-ac23-c178e8764c00 req-16d2cf02-0332-4dbe-b8a2-99776e0bbfed service nova] Releasing lock "refresh_cache-1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:37:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-49b86748-6001-42fe-89df-35984f9bd37e req-5abc4ca5-3a5a-41de-8dbe-ab8cc6c8f618 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received event network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:37:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-49b86748-6001-42fe-89df-35984f9bd37e req-5abc4ca5-3a5a-41de-8dbe-ab8cc6c8f618 service nova] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-49b86748-6001-42fe-89df-35984f9bd37e req-5abc4ca5-3a5a-41de-8dbe-ab8cc6c8f618 service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-49b86748-6001-42fe-89df-35984f9bd37e req-5abc4ca5-3a5a-41de-8dbe-ab8cc6c8f618 service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-49b86748-6001-42fe-89df-35984f9bd37e req-5abc4ca5-3a5a-41de-8dbe-ab8cc6c8f618 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] No waiting events found dispatching network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:37:38 user nova-compute[75071]: WARNING nova.compute.manager [req-49b86748-6001-42fe-89df-35984f9bd37e req-5abc4ca5-3a5a-41de-8dbe-ab8cc6c8f618 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received unexpected event network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 for instance with vm_state building and task_state spawning.
Dec 05 12:37:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:37:40 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Instance spawned successfully.
Dec 05 12:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:37:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:37:40 user nova-compute[75071]: INFO nova.compute.manager [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Took 5.37 seconds to spawn the instance on the hypervisor.
Dec 05 12:37:40 user nova-compute[75071]: DEBUG nova.compute.manager [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:37:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-28ee3187-aaa1-45d6-bbf7-8fcd18aeff41 req-835be9b8-2ee8-4f7e-880b-4babd573d214 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received event network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:37:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-28ee3187-aaa1-45d6-bbf7-8fcd18aeff41 req-835be9b8-2ee8-4f7e-880b-4babd573d214 service nova] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-28ee3187-aaa1-45d6-bbf7-8fcd18aeff41 req-835be9b8-2ee8-4f7e-880b-4babd573d214 service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-28ee3187-aaa1-45d6-bbf7-8fcd18aeff41 req-835be9b8-2ee8-4f7e-880b-4babd573d214 service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-28ee3187-aaa1-45d6-bbf7-8fcd18aeff41 req-835be9b8-2ee8-4f7e-880b-4babd573d214 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] No waiting events found dispatching network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:37:40 user nova-compute[75071]: WARNING nova.compute.manager [req-28ee3187-aaa1-45d6-bbf7-8fcd18aeff41 req-835be9b8-2ee8-4f7e-880b-4babd573d214 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received unexpected event network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 for instance with vm_state active and task_state None.
Dec 05 12:37:40 user nova-compute[75071]: INFO nova.compute.manager [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Took 6.10 seconds to build instance.
Dec 05 12:37:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-62c2f240-d81b-4d2b-9311-3b5fb4ca510b tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.212s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:45 user nova-compute[75071]: DEBUG nova.compute.manager [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:37:45 user nova-compute[75071]: INFO nova.compute.manager [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] instance snapshotting
Dec 05 12:37:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Beginning live snapshot process
Dec 05 12:37:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json -f qcow2 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json -f qcow2" returned: 0 in 0.204s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json -f qcow2 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.270s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpel10so1c/b2da7c2dfc974f09a170802637ca9c0b.delta 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpel10so1c/b2da7c2dfc974f09a170802637ca9c0b.delta 1073741824" returned: 0 in 0.048s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 05 12:37:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:37:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75071) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 05 12:37:47 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 05 12:37:47 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 12:37:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpel10so1c/b2da7c2dfc974f09a170802637ca9c0b.delta /opt/stack/data/nova/instances/snapshots/tmpel10so1c/b2da7c2dfc974f09a170802637ca9c0b {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpel10so1c/b2da7c2dfc974f09a170802637ca9c0b.delta /opt/stack/data/nova/instances/snapshots/tmpel10so1c/b2da7c2dfc974f09a170802637ca9c0b" returned: 0 in 0.602s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:48 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Snapshot extracted, beginning image upload
Dec 05 12:37:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:50 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Snapshot image upload complete
Dec 05 12:37:50 user nova-compute[75071]: INFO nova.compute.manager [None req-562a4ca0-aa88-476d-bd4e-a32460186f3b tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Took 5.32 seconds to snapshot the instance on the hypervisor.
Dec 05 12:37:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:51 user nova-compute[75071]: INFO nova.compute.manager [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Terminating instance
Dec 05 12:37:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:37:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-13835b88-85b9-4b61-adf5-2210d9832b2f req-e691011e-1378-49cc-a849-96173a9ecc94 service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Received event network-vif-unplugged-4797cdcb-bed0-4fa7-af67-ab3d02b41977 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-13835b88-85b9-4b61-adf5-2210d9832b2f req-e691011e-1378-49cc-a849-96173a9ecc94 service nova] Acquiring lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-13835b88-85b9-4b61-adf5-2210d9832b2f req-e691011e-1378-49cc-a849-96173a9ecc94 service nova] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-13835b88-85b9-4b61-adf5-2210d9832b2f req-e691011e-1378-49cc-a849-96173a9ecc94 service nova] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-13835b88-85b9-4b61-adf5-2210d9832b2f req-e691011e-1378-49cc-a849-96173a9ecc94 service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] No waiting events found dispatching network-vif-unplugged-4797cdcb-bed0-4fa7-af67-ab3d02b41977 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-13835b88-85b9-4b61-adf5-2210d9832b2f req-e691011e-1378-49cc-a849-96173a9ecc94 service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Received event network-vif-unplugged-4797cdcb-bed0-4fa7-af67-ab3d02b41977 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Instance destroyed successfully.
Dec 05 12:37:52 user nova-compute[75071]: DEBUG nova.objects.instance [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lazy-loading 'resources' on Instance uuid ce0b3e61-f8dd-487a-a81a-a466c45f0814 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:33:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-468178569',display_name='tempest-TestServerVolumeAttachmentScenario-server-468178569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-468178569',id=36,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtDKr0/sFUzI2EpUlkm3puQrjPqbBi2KwD+6NPOtEnHFoQtVR4geRBmrn1lziQwyYgP1f4sHurbJhCKGIlz5QIDqf5KV1dzjL9EQ3ijMw5cNtVpCT6R9SgU8qfjE7MGnw==',key_name='tempest-keypair-1189558054',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:33:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b44f33bb08a547948df72daba2ec1722',ramdisk_id='',reservation_id='r-8ydo45zr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-111905915',owner_user_name='tempest-TestServerVolumeAttachmentScenario-111905915-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dad126ca4fd348ffb12f22ab05acc57f',uuid=ce0b3e61-f8dd-487a-a81a-a466c45f0814,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "address": "fa:16:3e:5b:20:cc", "network": {"id": "6e4d54dd-92e2-4e7f-a2d6-a4d46abe125a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478002396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b44f33bb08a547948df72daba2ec1722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4797cdcb-be", "ovs_interfaceid": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Converting VIF {"id": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "address": "fa:16:3e:5b:20:cc", "network": {"id": "6e4d54dd-92e2-4e7f-a2d6-a4d46abe125a", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1478002396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b44f33bb08a547948df72daba2ec1722", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4797cdcb-be", "ovs_interfaceid": "4797cdcb-bed0-4fa7-af67-ab3d02b41977", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:20:cc,bridge_name='br-int',has_traffic_filtering=True,id=4797cdcb-bed0-4fa7-af67-ab3d02b41977,network=Network(6e4d54dd-92e2-4e7f-a2d6-a4d46abe125a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4797cdcb-be') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG os_vif [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:20:cc,bridge_name='br-int',has_traffic_filtering=True,id=4797cdcb-bed0-4fa7-af67-ab3d02b41977,network=Network(6e4d54dd-92e2-4e7f-a2d6-a4d46abe125a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4797cdcb-be') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4797cdcb-be, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae7330f6-302b-4074-9bea-1f7452a7d441) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:52 user nova-compute[75071]: INFO os_vif [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:20:cc,bridge_name='br-int',has_traffic_filtering=True,id=4797cdcb-bed0-4fa7-af67-ab3d02b41977,network=Network(6e4d54dd-92e2-4e7f-a2d6-a4d46abe125a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4797cdcb-be')
Dec 05 12:37:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Deleting instance files /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814_del
Dec 05 12:37:52 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Deletion of /opt/stack/data/nova/instances/ce0b3e61-f8dd-487a-a81a-a466c45f0814_del complete
Dec 05 12:37:52 user nova-compute[75071]: INFO nova.compute.manager [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 05 12:37:52 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:37:52 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:37:53 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:37:53 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Took 0.69 seconds to deallocate network for instance.
Dec 05 12:37:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:53 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:37:53 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:37:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:53 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Deleted allocations for instance ce0b3e61-f8dd-487a-a81a-a466c45f0814
Dec 05 12:37:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9732dfff-7664-4e32-a149-967a7847c8c3 tempest-TestServerVolumeAttachmentScenario-111905915 tempest-TestServerVolumeAttachmentScenario-111905915-project-member] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.194s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-1d1db3ee-b155-4b5a-8fbf-356748c8c3e7 req-b8eeb5aa-bcf0-4da1-a6d6-2207539411bd service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Received event network-vif-plugged-4797cdcb-bed0-4fa7-af67-ab3d02b41977 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:37:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1d1db3ee-b155-4b5a-8fbf-356748c8c3e7 req-b8eeb5aa-bcf0-4da1-a6d6-2207539411bd service nova] Acquiring lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1d1db3ee-b155-4b5a-8fbf-356748c8c3e7 req-b8eeb5aa-bcf0-4da1-a6d6-2207539411bd service nova] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1d1db3ee-b155-4b5a-8fbf-356748c8c3e7 req-b8eeb5aa-bcf0-4da1-a6d6-2207539411bd service nova] Lock "ce0b3e61-f8dd-487a-a81a-a466c45f0814-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-1d1db3ee-b155-4b5a-8fbf-356748c8c3e7 req-b8eeb5aa-bcf0-4da1-a6d6-2207539411bd service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] No waiting events found dispatching network-vif-plugged-4797cdcb-bed0-4fa7-af67-ab3d02b41977 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:37:54 user nova-compute[75071]: WARNING nova.compute.manager [req-1d1db3ee-b155-4b5a-8fbf-356748c8c3e7 req-b8eeb5aa-bcf0-4da1-a6d6-2207539411bd service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Received unexpected event network-vif-plugged-4797cdcb-bed0-4fa7-af67-ab3d02b41977 for instance with vm_state deleted and task_state None.
Dec 05 12:37:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-1d1db3ee-b155-4b5a-8fbf-356748c8c3e7 req-b8eeb5aa-bcf0-4da1-a6d6-2207539411bd service nova] [instance: ce0b3e61-f8dd-487a-a81a-a466c45f0814] Received event network-vif-deleted-4797cdcb-bed0-4fa7-af67-ab3d02b41977 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:37:54 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:37:55 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:37:55 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:37:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:55 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:37:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:56 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:37:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:37:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:37:59 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:37:59 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:37:59 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8106MB free_disk=24.74726104736328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:37:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:37:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:37:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:37:59 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:37:59 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:37:59 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:37:59 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:37:59 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 42776e73-1ef0-4c57-a50a-942f6f4881de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:37:59 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9f492779-584e-4a21-9991-78de01f6670c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:37:59 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance f6b3497d-2998-48ba-9604-4332afa95c29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:37:59 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:37:59 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:37:59 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:37:59 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:37:59 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:37:59 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:37:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:37:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:38:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:38:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:38:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:38:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:38:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:38:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:38:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:04 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:38:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:38:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:38:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:38:04 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:38:05 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Updating instance_info_cache with network_info: [{"id": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "address": "fa:16:3e:59:88:5c", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2c318b-a7", "ovs_interfaceid": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:38:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:38:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:38:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:38:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 12:38:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 12:38:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:10 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:38:10 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 12:38:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquiring lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:38:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:38:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:38:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:38:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:38:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:38:11 user nova-compute[75071]: INFO nova.compute.claims [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Claim successful on node user
Dec 05 12:38:12 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG nova.compute.manager [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG nova.compute.manager [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG nova.network.neutron [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:38:12 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:38:12 user nova-compute[75071]: DEBUG nova.compute.manager [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG nova.policy [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f07cde1f0ad4139ade7efe260ad7545', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c9933b6650941d58025487be8dedc17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG nova.compute.manager [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:38:12 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Creating image(s)
Dec 05 12:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquiring lock "/opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "/opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "/opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/disk 1073741824" returned: 0 in 0.062s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG nova.network.neutron [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Successfully created port: 9ceddfef-b16f-4269-bf98-fdf7156c1e41 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:38:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Cannot resize image /opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Ensure instance console log exists: /opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.network.neutron [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Successfully updated port: 9ceddfef-b16f-4269-bf98-fdf7156c1e41 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquiring lock "refresh_cache-d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquired lock "refresh_cache-d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.network.neutron [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-f5a08bf1-9dc5-49e4-9a8f-2c8c490d380f req-705c8343-0359-49b4-b538-510ad36e709b service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Received event network-changed-9ceddfef-b16f-4269-bf98-fdf7156c1e41 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-f5a08bf1-9dc5-49e4-9a8f-2c8c490d380f req-705c8343-0359-49b4-b538-510ad36e709b service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Refreshing instance network info cache due to event network-changed-9ceddfef-b16f-4269-bf98-fdf7156c1e41. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f5a08bf1-9dc5-49e4-9a8f-2c8c490d380f req-705c8343-0359-49b4-b538-510ad36e709b service nova] Acquiring lock "refresh_cache-d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.network.neutron [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.network.neutron [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Updating instance_info_cache with network_info: [{"id": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "address": "fa:16:3e:50:1f:8f", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ceddfef-b1", "ovs_interfaceid": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Releasing lock "refresh_cache-d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Instance network_info: |[{"id": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "address": "fa:16:3e:50:1f:8f", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ceddfef-b1", "ovs_interfaceid": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f5a08bf1-9dc5-49e4-9a8f-2c8c490d380f req-705c8343-0359-49b4-b538-510ad36e709b service nova] Acquired lock "refresh_cache-d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.network.neutron [req-f5a08bf1-9dc5-49e4-9a8f-2c8c490d380f req-705c8343-0359-49b4-b538-510ad36e709b service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Refreshing network info cache for port 9ceddfef-b16f-4269-bf98-fdf7156c1e41 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Start _get_guest_xml network_info=[{"id": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "address": "fa:16:3e:50:1f:8f", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ceddfef-b1", "ovs_interfaceid": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:38:13 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:38:13 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:38:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1933233378',display_name='tempest-ServersNegativeTestJSON-server-1933233378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1933233378',id=40,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c9933b6650941d58025487be8dedc17',ramdisk_id='',reservation_id='r-p1jj9449',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-508219572',owner_user_name='tempest-ServersNegativeTestJSON-508219572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:38:12Z,user_data=None,user_id='3f07cde1f0ad4139ade7efe260ad7545',uuid=d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "address": "fa:16:3e:50:1f:8f", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ceddfef-b1", "ovs_interfaceid": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Converting VIF {"id": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "address": "fa:16:3e:50:1f:8f", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ceddfef-b1", "ovs_interfaceid": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:1f:8f,bridge_name='br-int',has_traffic_filtering=True,id=9ceddfef-b16f-4269-bf98-fdf7156c1e41,network=Network(7558883d-4135-4f8d-ac25-dccea82839e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ceddfef-b1') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.objects.instance [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lazy-loading 'pci_devices' on Instance uuid d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:38:13 user nova-compute[75071]:   <uuid>d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019</uuid>
Dec 05 12:38:13 user nova-compute[75071]:   <name>instance-00000028</name>
Dec 05 12:38:13 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:38:13 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:38:13 user nova-compute[75071]:   <metadata>
Dec 05 12:38:13 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:38:13 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:38:13 user nova-compute[75071]:       <nova:name>tempest-ServersNegativeTestJSON-server-1933233378</nova:name>
Dec 05 12:38:13 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:38:13</nova:creationTime>
Dec 05 12:38:13 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:38:13 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:38:13 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:38:13 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:38:13 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:38:13 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:38:13 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:38:13 user nova-compute[75071]:       <nova:owner>
Dec 05 12:38:13 user nova-compute[75071]:         <nova:user uuid="3f07cde1f0ad4139ade7efe260ad7545">tempest-ServersNegativeTestJSON-508219572-project-member</nova:user>
Dec 05 12:38:13 user nova-compute[75071]:         <nova:project uuid="1c9933b6650941d58025487be8dedc17">tempest-ServersNegativeTestJSON-508219572</nova:project>
Dec 05 12:38:13 user nova-compute[75071]:       </nova:owner>
Dec 05 12:38:13 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:38:13 user nova-compute[75071]:       <nova:ports>
Dec 05 12:38:13 user nova-compute[75071]:         <nova:port uuid="9ceddfef-b16f-4269-bf98-fdf7156c1e41">
Dec 05 12:38:13 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 05 12:38:13 user nova-compute[75071]:         </nova:port>
Dec 05 12:38:13 user nova-compute[75071]:       </nova:ports>
Dec 05 12:38:13 user nova-compute[75071]:     </nova:instance>
Dec 05 12:38:13 user nova-compute[75071]:   </metadata>
Dec 05 12:38:13 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:38:13 user nova-compute[75071]:     <system>
Dec 05 12:38:13 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:38:13 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:38:13 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:38:13 user nova-compute[75071]:       <entry name="serial">d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019</entry>
Dec 05 12:38:13 user nova-compute[75071]:       <entry name="uuid">d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019</entry>
Dec 05 12:38:13 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:38:13 user nova-compute[75071]:     </system>
Dec 05 12:38:13 user nova-compute[75071]:   </sysinfo>
Dec 05 12:38:13 user nova-compute[75071]:   <os>
Dec 05 12:38:13 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:38:13 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:38:13 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:38:13 user nova-compute[75071]:   </os>
Dec 05 12:38:13 user nova-compute[75071]:   <features>
Dec 05 12:38:13 user nova-compute[75071]:     <acpi/>
Dec 05 12:38:13 user nova-compute[75071]:     <apic/>
Dec 05 12:38:13 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:38:13 user nova-compute[75071]:   </features>
Dec 05 12:38:13 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:38:13 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:38:13 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:38:13 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:38:13 user nova-compute[75071]:   </clock>
Dec 05 12:38:13 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:38:13 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:38:13 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:38:13 user nova-compute[75071]:   </cpu>
Dec 05 12:38:13 user nova-compute[75071]:   <devices>
Dec 05 12:38:13 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:38:13 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:38:13 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/disk"/>
Dec 05 12:38:13 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:38:13 user nova-compute[75071]:     </disk>
Dec 05 12:38:13 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:38:13 user nova-compute[75071]:       <mac address="fa:16:3e:50:1f:8f"/>
Dec 05 12:38:13 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:38:13 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:38:13 user nova-compute[75071]:       <target dev="tap9ceddfef-b1"/>
Dec 05 12:38:13 user nova-compute[75071]:     </interface>
Dec 05 12:38:13 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:38:13 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/console.log" append="off"/>
Dec 05 12:38:13 user nova-compute[75071]:     </serial>
Dec 05 12:38:13 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:38:13 user nova-compute[75071]:     <video>
Dec 05 12:38:13 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:38:13 user nova-compute[75071]:     </video>
Dec 05 12:38:13 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:38:13 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:38:13 user nova-compute[75071]:     </rng>
Dec 05 12:38:13 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:38:13 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:38:13 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:38:13 user nova-compute[75071]:     </memballoon>
Dec 05 12:38:13 user nova-compute[75071]:   </devices>
Dec 05 12:38:13 user nova-compute[75071]: </domain>
Dec 05 12:38:13 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:38:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1933233378',display_name='tempest-ServersNegativeTestJSON-server-1933233378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1933233378',id=40,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c9933b6650941d58025487be8dedc17',ramdisk_id='',reservation_id='r-p1jj9449',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-508219572',owner_user_name='tempest-ServersNegativeTestJSON-508219572-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:38:12Z,user_data=None,user_id='3f07cde1f0ad4139ade7efe260ad7545',uuid=d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "address": "fa:16:3e:50:1f:8f", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ceddfef-b1", "ovs_interfaceid": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Converting VIF {"id": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "address": "fa:16:3e:50:1f:8f", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ceddfef-b1", "ovs_interfaceid": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:1f:8f,bridge_name='br-int',has_traffic_filtering=True,id=9ceddfef-b16f-4269-bf98-fdf7156c1e41,network=Network(7558883d-4135-4f8d-ac25-dccea82839e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ceddfef-b1') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG os_vif [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:1f:8f,bridge_name='br-int',has_traffic_filtering=True,id=9ceddfef-b16f-4269-bf98-fdf7156c1e41,network=Network(7558883d-4135-4f8d-ac25-dccea82839e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ceddfef-b1') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d4e19f2-c035-5c68-989e-1e6e5dbe0537', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ceddfef-b1, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ceddfef-b1, col_values=(('qos', UUID('53b9fcd6-0790-423d-b012-149dc6bfb70b')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ceddfef-b1, col_values=(('external_ids', {'iface-id': '9ceddfef-b16f-4269-bf98-fdf7156c1e41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:1f:8f', 'vm-uuid': 'd459f52d-9a1c-4fd4-ace9-0a2a7c6ae019'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:13 user nova-compute[75071]: INFO os_vif [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:1f:8f,bridge_name='br-int',has_traffic_filtering=True,id=9ceddfef-b16f-4269-bf98-fdf7156c1e41,network=Network(7558883d-4135-4f8d-ac25-dccea82839e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ceddfef-b1')
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:38:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] No VIF found with MAC fa:16:3e:50:1f:8f, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:38:14 user nova-compute[75071]: DEBUG nova.network.neutron [req-f5a08bf1-9dc5-49e4-9a8f-2c8c490d380f req-705c8343-0359-49b4-b538-510ad36e709b service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Updated VIF entry in instance network info cache for port 9ceddfef-b16f-4269-bf98-fdf7156c1e41. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:38:14 user nova-compute[75071]: DEBUG nova.network.neutron [req-f5a08bf1-9dc5-49e4-9a8f-2c8c490d380f req-705c8343-0359-49b4-b538-510ad36e709b service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Updating instance_info_cache with network_info: [{"id": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "address": "fa:16:3e:50:1f:8f", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ceddfef-b1", "ovs_interfaceid": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:38:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f5a08bf1-9dc5-49e4-9a8f-2c8c490d380f req-705c8343-0359-49b4-b538-510ad36e709b service nova] Releasing lock "refresh_cache-d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:38:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:15 user nova-compute[75071]: DEBUG nova.compute.manager [req-675f788e-e19c-43dd-951d-55e9eee75264 req-965aa709-9075-4251-abda-c1ae29886c86 service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Received event network-vif-plugged-9ceddfef-b16f-4269-bf98-fdf7156c1e41 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:38:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-675f788e-e19c-43dd-951d-55e9eee75264 req-965aa709-9075-4251-abda-c1ae29886c86 service nova] Acquiring lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:38:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-675f788e-e19c-43dd-951d-55e9eee75264 req-965aa709-9075-4251-abda-c1ae29886c86 service nova] Lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:38:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-675f788e-e19c-43dd-951d-55e9eee75264 req-965aa709-9075-4251-abda-c1ae29886c86 service nova] Lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:38:15 user nova-compute[75071]: DEBUG nova.compute.manager [req-675f788e-e19c-43dd-951d-55e9eee75264 req-965aa709-9075-4251-abda-c1ae29886c86 service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] No waiting events found dispatching network-vif-plugged-9ceddfef-b16f-4269-bf98-fdf7156c1e41 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:38:15 user nova-compute[75071]: WARNING nova.compute.manager [req-675f788e-e19c-43dd-951d-55e9eee75264 req-965aa709-9075-4251-abda-c1ae29886c86 service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Received unexpected event network-vif-plugged-9ceddfef-b16f-4269-bf98-fdf7156c1e41 for instance with vm_state building and task_state spawning.
Dec 05 12:38:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:38:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:38:17 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Instance spawned successfully.
Dec 05 12:38:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:38:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:38:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:38:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:38:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:38:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:38:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:38:17 user nova-compute[75071]: INFO nova.compute.manager [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Took 5.24 seconds to spawn the instance on the hypervisor.
Dec 05 12:38:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:38:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-11132068-d085-4d9c-9a9c-c8a6e5a3debf req-0e1d45f9-3c93-435e-a725-03b9f409bf24 service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Received event network-vif-plugged-9ceddfef-b16f-4269-bf98-fdf7156c1e41 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:38:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-11132068-d085-4d9c-9a9c-c8a6e5a3debf req-0e1d45f9-3c93-435e-a725-03b9f409bf24 service nova] Acquiring lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:38:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-11132068-d085-4d9c-9a9c-c8a6e5a3debf req-0e1d45f9-3c93-435e-a725-03b9f409bf24 service nova] Lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:38:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-11132068-d085-4d9c-9a9c-c8a6e5a3debf req-0e1d45f9-3c93-435e-a725-03b9f409bf24 service nova] Lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:38:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-11132068-d085-4d9c-9a9c-c8a6e5a3debf req-0e1d45f9-3c93-435e-a725-03b9f409bf24 service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] No waiting events found dispatching network-vif-plugged-9ceddfef-b16f-4269-bf98-fdf7156c1e41 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:38:17 user nova-compute[75071]: WARNING nova.compute.manager [req-11132068-d085-4d9c-9a9c-c8a6e5a3debf req-0e1d45f9-3c93-435e-a725-03b9f409bf24 service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Received unexpected event network-vif-plugged-9ceddfef-b16f-4269-bf98-fdf7156c1e41 for instance with vm_state building and task_state spawning.
Dec 05 12:38:17 user nova-compute[75071]: INFO nova.compute.manager [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Took 6.04 seconds to build instance.
Dec 05 12:38:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-23a907df-ed64-4b1d-93b2-81c7c334e75a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.133s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:38:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:38:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:38:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:38:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:38:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:38:25 user nova-compute[75071]: INFO nova.compute.manager [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Terminating instance
Dec 05 12:38:25 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:38:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-14bac721-cd3f-47eb-bec6-3bf0c728409c req-c6391519-7b4f-4381-9a83-cd5a882fc479 service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Received event network-vif-unplugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:38:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-14bac721-cd3f-47eb-bec6-3bf0c728409c req-c6391519-7b4f-4381-9a83-cd5a882fc479 service nova] Acquiring lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:38:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-14bac721-cd3f-47eb-bec6-3bf0c728409c req-c6391519-7b4f-4381-9a83-cd5a882fc479 service nova] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:38:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-14bac721-cd3f-47eb-bec6-3bf0c728409c req-c6391519-7b4f-4381-9a83-cd5a882fc479 service nova] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:38:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-14bac721-cd3f-47eb-bec6-3bf0c728409c req-c6391519-7b4f-4381-9a83-cd5a882fc479 service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] No waiting events found dispatching network-vif-unplugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:38:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-14bac721-cd3f-47eb-bec6-3bf0c728409c req-c6391519-7b4f-4381-9a83-cd5a882fc479 service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Received event network-vif-unplugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:38:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:25 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Instance destroyed successfully.
Dec 05 12:38:25 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'resources' on Instance uuid 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:38:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:22:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-635283916',display_name='tempest-ServerRescueNegativeTestJSON-server-635283916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-635283916',id=18,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:24:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b958a2138af24f5a860e7a0c99d9ebb5',ramdisk_id='',reservation_id='r-hszh9mt9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-170727457',owner_user_name='tempest-ServerRescueNegativeTestJSON-170727457-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:24:11Z,user_data=None,user_id='3312b55016d34680b6873eedf97e9a8f',uuid=4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "address": "fa:16:3e:59:88:5c", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2c318b-a7", "ovs_interfaceid": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:38:26 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converting VIF {"id": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "address": "fa:16:3e:59:88:5c", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d2c318b-a7", "ovs_interfaceid": "4d2c318b-a73f-4a69-b318-3f4ae56a5d7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:38:26 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=4d2c318b-a73f-4a69-b318-3f4ae56a5d7b,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2c318b-a7') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:38:26 user nova-compute[75071]: DEBUG os_vif [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=4d2c318b-a73f-4a69-b318-3f4ae56a5d7b,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2c318b-a7') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:38:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d2c318b-a7, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:38:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:38:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8464b33c-b457-49a9-bda6-d54455fde5ca) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:38:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:26 user nova-compute[75071]: INFO os_vif [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:88:5c,bridge_name='br-int',has_traffic_filtering=True,id=4d2c318b-a73f-4a69-b318-3f4ae56a5d7b,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d2c318b-a7')
Dec 05 12:38:26 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Deleting instance files /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957_del
Dec 05 12:38:26 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Deletion of /opt/stack/data/nova/instances/4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957_del complete
Dec 05 12:38:26 user nova-compute[75071]: INFO nova.compute.manager [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Took 0.77 seconds to destroy the instance on the hypervisor.
Dec 05 12:38:26 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:38:26 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:38:26 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:38:26 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:38:26 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Took 0.58 seconds to deallocate network for instance.
Dec 05 12:38:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:38:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:38:27 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:38:27 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:38:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:38:27 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Deleted allocations for instance 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957
Dec 05 12:38:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2d1d1bc9-f80f-4455-87d5-7d490c230ab0 tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.924s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:38:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-55a0153e-0b26-4e5d-9894-17882b504b29 req-777fb8b8-2f82-458f-b9e3-4af621a73ffb service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Received event network-vif-plugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:38:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-55a0153e-0b26-4e5d-9894-17882b504b29 req-777fb8b8-2f82-458f-b9e3-4af621a73ffb service nova] Acquiring lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:38:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-55a0153e-0b26-4e5d-9894-17882b504b29 req-777fb8b8-2f82-458f-b9e3-4af621a73ffb service nova] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:38:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-55a0153e-0b26-4e5d-9894-17882b504b29 req-777fb8b8-2f82-458f-b9e3-4af621a73ffb service nova] Lock "4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:38:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-55a0153e-0b26-4e5d-9894-17882b504b29 req-777fb8b8-2f82-458f-b9e3-4af621a73ffb service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] No waiting events found dispatching network-vif-plugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:38:27 user nova-compute[75071]: WARNING nova.compute.manager [req-55a0153e-0b26-4e5d-9894-17882b504b29 req-777fb8b8-2f82-458f-b9e3-4af621a73ffb service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Received unexpected event network-vif-plugged-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b for instance with vm_state deleted and task_state None.
Dec 05 12:38:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-55a0153e-0b26-4e5d-9894-17882b504b29 req-777fb8b8-2f82-458f-b9e3-4af621a73ffb service nova] [instance: 4cf59ca2-4c13-4fa3-abb5-56c9d3ef2957] Received event network-vif-deleted-4d2c318b-a73f-4a69-b318-3f4ae56a5d7b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:38:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "48774298-024b-4c96-a72f-74195ef8b5be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:38:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "48774298-024b-4c96-a72f-74195ef8b5be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:38:52 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:38:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:38:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:38:52 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:38:52 user nova-compute[75071]: INFO nova.compute.claims [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Claim successful on node user
Dec 05 12:38:53 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Refreshing inventories for resource provider 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 12:38:53 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Updating ProviderTree inventory for provider 25beb694-9dd7-475f-9657-74a5f0368417 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 12:38:53 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Updating inventory in ProviderTree for provider 25beb694-9dd7-475f-9657-74a5f0368417 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 12:38:53 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Refreshing aggregate associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 12:38:53 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Refreshing trait associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 12:38:53 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:38:53 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:38:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.584s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:38:53 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:38:53 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:38:53 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:38:53 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:38:53 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:38:53 user nova-compute[75071]: INFO nova.virt.block_device [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Booting with volume-backed-image b161e746-a23e-4c74-ab8c-45ef211d5e66 at /dev/vda
Dec 05 12:38:53 user nova-compute[75071]: DEBUG nova.policy [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '201cbbb8b3dc4a3aa8164d69c1257489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b77a4b1baadd43e1be69eecb1f5370bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:38:54 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Successfully created port: 0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:38:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:54 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Successfully updated port: 0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:38:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "refresh_cache-48774298-024b-4c96-a72f-74195ef8b5be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:38:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquired lock "refresh_cache-48774298-024b-4c96-a72f-74195ef8b5be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:38:54 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:38:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-3147848f-3d8a-4479-9002-8192c9facbe8 req-a9a7f481-0701-4371-9102-c298394b2e8d service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received event network-changed-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:38:54 user nova-compute[75071]: DEBUG nova.compute.manager [req-3147848f-3d8a-4479-9002-8192c9facbe8 req-a9a7f481-0701-4371-9102-c298394b2e8d service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Refreshing instance network info cache due to event network-changed-0d784760-630f-44d4-8ad1-1d965951b90a. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:38:54 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3147848f-3d8a-4479-9002-8192c9facbe8 req-a9a7f481-0701-4371-9102-c298394b2e8d service nova] Acquiring lock "refresh_cache-48774298-024b-4c96-a72f-74195ef8b5be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:38:55 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:38:55 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Updating instance_info_cache with network_info: [{"id": "0d784760-630f-44d4-8ad1-1d965951b90a", "address": "fa:16:3e:e2:66:18", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d784760-63", "ovs_interfaceid": "0d784760-630f-44d4-8ad1-1d965951b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:38:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Releasing lock "refresh_cache-48774298-024b-4c96-a72f-74195ef8b5be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:38:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Instance network_info: |[{"id": "0d784760-630f-44d4-8ad1-1d965951b90a", "address": "fa:16:3e:e2:66:18", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d784760-63", "ovs_interfaceid": "0d784760-630f-44d4-8ad1-1d965951b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:38:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3147848f-3d8a-4479-9002-8192c9facbe8 req-a9a7f481-0701-4371-9102-c298394b2e8d service nova] Acquired lock "refresh_cache-48774298-024b-4c96-a72f-74195ef8b5be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:38:55 user nova-compute[75071]: DEBUG nova.network.neutron [req-3147848f-3d8a-4479-9002-8192c9facbe8 req-a9a7f481-0701-4371-9102-c298394b2e8d service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Refreshing network info cache for port 0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:38:55 user nova-compute[75071]: DEBUG nova.network.neutron [req-3147848f-3d8a-4479-9002-8192c9facbe8 req-a9a7f481-0701-4371-9102-c298394b2e8d service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Updated VIF entry in instance network info cache for port 0d784760-630f-44d4-8ad1-1d965951b90a. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:38:55 user nova-compute[75071]: DEBUG nova.network.neutron [req-3147848f-3d8a-4479-9002-8192c9facbe8 req-a9a7f481-0701-4371-9102-c298394b2e8d service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Updating instance_info_cache with network_info: [{"id": "0d784760-630f-44d4-8ad1-1d965951b90a", "address": "fa:16:3e:e2:66:18", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d784760-63", "ovs_interfaceid": "0d784760-630f-44d4-8ad1-1d965951b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:38:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3147848f-3d8a-4479-9002-8192c9facbe8 req-a9a7f481-0701-4371-9102-c298394b2e8d service nova] Releasing lock "refresh_cache-48774298-024b-4c96-a72f-74195ef8b5be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:38:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:38:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:38:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:38:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:38:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:38:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:38:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:38:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:38:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:38:57 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:38:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:38:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:38:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:38:57 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:38:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:38:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:38:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:38:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:38:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:38:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:38:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:38:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:38:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:38:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:38:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:38:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:39:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:00 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:39:00 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:39:00 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8128MB free_disk=24.73431396484375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:39:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 42776e73-1ef0-4c57-a50a-942f6f4881de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9f492779-584e-4a21-9991-78de01f6670c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance f6b3497d-2998-48ba-9604-4332afa95c29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 48774298-024b-4c96-a72f-74195ef8b5be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:39:01 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:39:01 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:39:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:39:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.430s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:02 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:39:02 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:39:02 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:39:02 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:39:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG os_brick.utils [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a737ecd9-141c-45b1-85f2-32a4f2c7eb2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb82f9fd-ee1d-418a-9212-7ce3ff9c6d82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a42f296-7a4f-4b17-ba95-393845365755]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df21e07-3e79-4212-a28b-206009c065a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:39:04 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:39:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4d8bfa-ae1c-4965-87a5-b95d5fc369a2]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG os_brick.utils [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:39:04 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Updating existing volume attachment record: 2492f58d-2dcc-4c5c-9919-31af69f86998 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:39:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:39:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:39:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:39:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:39:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:39:07 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Updating instance_info_cache with network_info: [{"id": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "address": "fa:16:3e:ee:3d:ba", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfb6b0b-8b", "ovs_interfaceid": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:39:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:39:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:39:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:39:14 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Creating image(s)
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Ensure instance console log exists: /opt/stack/data/nova/instances/48774298-024b-4c96-a72f-74195ef8b5be/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Start _get_guest_xml network_info=[{"id": "0d784760-630f-44d4-8ad1-1d965951b90a", "address": "fa:16:3e:e2:66:18", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d784760-63", "ovs_interfaceid": "0d784760-630f-44d4-8ad1-1d965951b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '2492f58d-2dcc-4c5c-9919-31af69f86998', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvTCSUVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '48774298-024b-4c96-a72f-74195ef8b5be', 'attached_at': '', 'detached_at': '', 'volume_id': '814f5874-1607-4eee-ad82-cc04df760f75', 'serial': '814f5874-1607-4eee-ad82-cc04df760f75'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:39:14 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:39:14 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvTCSUVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:39:14 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:39:14 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:39:14 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2ebb96-22bb-49cb-bfe3-4110bd07a2ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:39:14 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cee458a-3787-498f-b215-1ce46ebdb02b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75] added
Dec 05 12:39:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7611e66-2303-406f-864e-c5f3abf7c740]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b54797b-ca71-42b9-b5ab-93a061cf6a32]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvTCSUVt {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvTCSUVt" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f8db74-94fb-4985-8d5a-475932396976]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HvTCSUVt'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de83345-5793-47c5-872f-74289e313961]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e192ef39-558b-4fbb-a97f-8545f9c96853]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:39:14 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:39:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:39:14 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:39:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[31258b30-08ae-4818-bfca-68e50a3985eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75, portal: 172.16.0.220,3260]
Dec 05 12:39:14 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75, portal: 172.16.0.220,3260] successful.
Dec 05 12:39:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[324fe2cd-a155-4414-86ee-2a0bf7841365]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a985b9f-3afc-4dfd-9de9-fc148b3499d5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:39:14 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:39:14 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:39:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:39:14 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:39:14 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:39:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[228c0fb4-51f8-411a-8214-c5ae06b7042f]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvTCSUVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:14 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:39:14 user nova-compute[75071]: INFO nova.compute.claims [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Claim successful on node user
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:39:15 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23437316330363132', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437316330363132', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.policy [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4450515c258b48b585fd4d6ac0d46987', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9aa06b8affa40c483794bb096c9fdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:39:15 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Creating image(s)
Dec 05 12:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "/opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "/opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "/opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:38:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1043281140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1043281140',id=41,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b77a4b1baadd43e1be69eecb1f5370bd',ramdisk_id='',reservation_id='r-r39akty7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86909184',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:38:54Z,user_data=None,user_id='201cbbb8b3dc4a3aa8164d69c1257489',uuid=48774298-024b-4c96-a72f-74195ef8b5be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d784760-630f-44d4-8ad1-1d965951b90a", "address": "fa:16:3e:e2:66:18", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d784760-63", "ovs_interfaceid": "0d784760-630f-44d4-8ad1-1d965951b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converting VIF {"id": "0d784760-630f-44d4-8ad1-1d965951b90a", "address": "fa:16:3e:e2:66:18", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d784760-63", "ovs_interfaceid": "0d784760-630f-44d4-8ad1-1d965951b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:66:18,bridge_name='br-int',has_traffic_filtering=True,id=0d784760-630f-44d4-8ad1-1d965951b90a,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d784760-63') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'pci_devices' on Instance uuid 48774298-024b-4c96-a72f-74195ef8b5be {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:39:15 user nova-compute[75071]:   <uuid>48774298-024b-4c96-a72f-74195ef8b5be</uuid>
Dec 05 12:39:15 user nova-compute[75071]:   <name>instance-00000029</name>
Dec 05 12:39:15 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:39:15 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:39:15 user nova-compute[75071]:   <metadata>
Dec 05 12:39:15 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:39:15 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:39:15 user nova-compute[75071]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1043281140</nova:name>
Dec 05 12:39:15 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:39:14</nova:creationTime>
Dec 05 12:39:15 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:39:15 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:39:15 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:39:15 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:39:15 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:39:15 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:39:15 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:39:15 user nova-compute[75071]:       <nova:owner>
Dec 05 12:39:15 user nova-compute[75071]:         <nova:user uuid="201cbbb8b3dc4a3aa8164d69c1257489">tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member</nova:user>
Dec 05 12:39:15 user nova-compute[75071]:         <nova:project uuid="b77a4b1baadd43e1be69eecb1f5370bd">tempest-ServerBootFromVolumeStableRescueTest-86909184</nova:project>
Dec 05 12:39:15 user nova-compute[75071]:       </nova:owner>
Dec 05 12:39:15 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:39:15 user nova-compute[75071]:       <nova:ports>
Dec 05 12:39:15 user nova-compute[75071]:         <nova:port uuid="0d784760-630f-44d4-8ad1-1d965951b90a">
Dec 05 12:39:15 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 05 12:39:15 user nova-compute[75071]:         </nova:port>
Dec 05 12:39:15 user nova-compute[75071]:       </nova:ports>
Dec 05 12:39:15 user nova-compute[75071]:     </nova:instance>
Dec 05 12:39:15 user nova-compute[75071]:   </metadata>
Dec 05 12:39:15 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:39:15 user nova-compute[75071]:     <system>
Dec 05 12:39:15 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:39:15 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:39:15 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:39:15 user nova-compute[75071]:       <entry name="serial">48774298-024b-4c96-a72f-74195ef8b5be</entry>
Dec 05 12:39:15 user nova-compute[75071]:       <entry name="uuid">48774298-024b-4c96-a72f-74195ef8b5be</entry>
Dec 05 12:39:15 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:39:15 user nova-compute[75071]:     </system>
Dec 05 12:39:15 user nova-compute[75071]:   </sysinfo>
Dec 05 12:39:15 user nova-compute[75071]:   <os>
Dec 05 12:39:15 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:39:15 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:39:15 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:39:15 user nova-compute[75071]:   </os>
Dec 05 12:39:15 user nova-compute[75071]:   <features>
Dec 05 12:39:15 user nova-compute[75071]:     <acpi/>
Dec 05 12:39:15 user nova-compute[75071]:     <apic/>
Dec 05 12:39:15 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:39:15 user nova-compute[75071]:   </features>
Dec 05 12:39:15 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:39:15 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:39:15 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:39:15 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:39:15 user nova-compute[75071]:   </clock>
Dec 05 12:39:15 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:39:15 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:39:15 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:39:15 user nova-compute[75071]:   </cpu>
Dec 05 12:39:15 user nova-compute[75071]:   <devices>
Dec 05 12:39:15 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:39:15 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:39:15 user nova-compute[75071]:       <source dev="/dev/sdb"/>
Dec 05 12:39:15 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:39:15 user nova-compute[75071]:       <serial>814f5874-1607-4eee-ad82-cc04df760f75</serial>
Dec 05 12:39:15 user nova-compute[75071]:     </disk>
Dec 05 12:39:15 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:39:15 user nova-compute[75071]:       <mac address="fa:16:3e:e2:66:18"/>
Dec 05 12:39:15 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:39:15 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:39:15 user nova-compute[75071]:       <target dev="tap0d784760-63"/>
Dec 05 12:39:15 user nova-compute[75071]:     </interface>
Dec 05 12:39:15 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:39:15 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/48774298-024b-4c96-a72f-74195ef8b5be/console.log" append="off"/>
Dec 05 12:39:15 user nova-compute[75071]:     </serial>
Dec 05 12:39:15 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:39:15 user nova-compute[75071]:     <video>
Dec 05 12:39:15 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:39:15 user nova-compute[75071]:     </video>
Dec 05 12:39:15 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:39:15 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:39:15 user nova-compute[75071]:     </rng>
Dec 05 12:39:15 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:39:15 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:39:15 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:39:15 user nova-compute[75071]:     </memballoon>
Dec 05 12:39:15 user nova-compute[75071]:   </devices>
Dec 05 12:39:15 user nova-compute[75071]: </domain>
Dec 05 12:39:15 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:38:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1043281140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1043281140',id=41,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b77a4b1baadd43e1be69eecb1f5370bd',ramdisk_id='',reservation_id='r-r39akty7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86909184',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:38:54Z,user_data=None,user_id='201cbbb8b3dc4a3aa8164d69c1257489',uuid=48774298-024b-4c96-a72f-74195ef8b5be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d784760-630f-44d4-8ad1-1d965951b90a", "address": "fa:16:3e:e2:66:18", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d784760-63", "ovs_interfaceid": "0d784760-630f-44d4-8ad1-1d965951b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converting VIF {"id": "0d784760-630f-44d4-8ad1-1d965951b90a", "address": "fa:16:3e:e2:66:18", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d784760-63", "ovs_interfaceid": "0d784760-630f-44d4-8ad1-1d965951b90a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:66:18,bridge_name='br-int',has_traffic_filtering=True,id=0d784760-630f-44d4-8ad1-1d965951b90a,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d784760-63') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG os_vif [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:66:18,bridge_name='br-int',has_traffic_filtering=True,id=0d784760-630f-44d4-8ad1-1d965951b90a,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d784760-63') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29a992d1-2b4a-5421-a907-32f7ddb0a782', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d784760-63, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d784760-63, col_values=(('qos', UUID('3516507e-f2d6-4866-926f-c1fd2de62c31')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d784760-63, col_values=(('external_ids', {'iface-id': '0d784760-630f-44d4-8ad1-1d965951b90a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:66:18', 'vm-uuid': '48774298-024b-4c96-a72f-74195ef8b5be'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:15 user nova-compute[75071]: INFO os_vif [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:66:18,bridge_name='br-int',has_traffic_filtering=True,id=0d784760-630f-44d4-8ad1-1d965951b90a,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d784760-63')
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] No VIF found with MAC fa:16:3e:e2:66:18, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.196s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:15 user nova-compute[75071]: INFO nova.compute.manager [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Terminating instance
Dec 05 12:39:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk 1073741824" returned: 0 in 0.066s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.199s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Checking if we can resize image /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Cannot resize image /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Ensure instance console log exists: /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-df2514d7-8a38-4b54-aba1-f1698bb65abf req-576bf063-6b2e-4108-a5c6-f5803cf69633 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received event network-vif-unplugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-df2514d7-8a38-4b54-aba1-f1698bb65abf req-576bf063-6b2e-4108-a5c6-f5803cf69633 service nova] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-df2514d7-8a38-4b54-aba1-f1698bb65abf req-576bf063-6b2e-4108-a5c6-f5803cf69633 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-df2514d7-8a38-4b54-aba1-f1698bb65abf req-576bf063-6b2e-4108-a5c6-f5803cf69633 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-df2514d7-8a38-4b54-aba1-f1698bb65abf req-576bf063-6b2e-4108-a5c6-f5803cf69633 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] No waiting events found dispatching network-vif-unplugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-df2514d7-8a38-4b54-aba1-f1698bb65abf req-576bf063-6b2e-4108-a5c6-f5803cf69633 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received event network-vif-unplugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:39:16 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Successfully created port: 7bb59ccd-77fa-411d-a777-05117b9bc509 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:17 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Instance destroyed successfully.
Dec 05 12:39:17 user nova-compute[75071]: DEBUG nova.objects.instance [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lazy-loading 'resources' on Instance uuid 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:22:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1939676217',display_name='tempest-ServerRescueNegativeTestJSON-server-1939676217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1939676217',id=17,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:27:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b958a2138af24f5a860e7a0c99d9ebb5',ramdisk_id='',reservation_id='r-ampwzrjs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-170727457',owner_user_name='tempest-ServerRescueNegativeTestJSON-170727457-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:28:55Z,user_data=None,user_id='3312b55016d34680b6873eedf97e9a8f',uuid=9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "address": "fa:16:3e:53:ed:01", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd15e936-54", "ovs_interfaceid": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converting VIF {"id": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "address": "fa:16:3e:53:ed:01", "network": {"id": "55f0e8dd-0cd8-47e1-9afd-4730a152938b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-151330153-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b958a2138af24f5a860e7a0c99d9ebb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd15e936-54", "ovs_interfaceid": "dd15e936-54b4-4e4b-a17a-9bad21c19bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:ed:01,bridge_name='br-int',has_traffic_filtering=True,id=dd15e936-54b4-4e4b-a17a-9bad21c19bac,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd15e936-54') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG os_vif [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:ed:01,bridge_name='br-int',has_traffic_filtering=True,id=dd15e936-54b4-4e4b-a17a-9bad21c19bac,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd15e936-54') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd15e936-54, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1a9f057-b471-4910-97a4-7267647d98c2) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:17 user nova-compute[75071]: INFO os_vif [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:ed:01,bridge_name='br-int',has_traffic_filtering=True,id=dd15e936-54b4-4e4b-a17a-9bad21c19bac,network=Network(55f0e8dd-0cd8-47e1-9afd-4730a152938b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd15e936-54')
Dec 05 12:39:17 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Deleting instance files /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f_del
Dec 05 12:39:17 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Deletion of /opt/stack/data/nova/instances/9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f_del complete
Dec 05 12:39:17 user nova-compute[75071]: INFO nova.compute.manager [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Took 1.41 seconds to destroy the instance on the hypervisor.
Dec 05 12:39:17 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Successfully updated port: 7bb59ccd-77fa-411d-a777-05117b9bc509 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "refresh_cache-72bb9c85-25b6-4a08-96bf-59881754adea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquired lock "refresh_cache-72bb9c85-25b6-4a08-96bf-59881754adea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-172e8837-f7de-49ca-ba9b-94246601fc03 req-bcf412c8-94b9-4e7a-b4ca-787de8abf09b service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received event network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-172e8837-f7de-49ca-ba9b-94246601fc03 req-bcf412c8-94b9-4e7a-b4ca-787de8abf09b service nova] Acquiring lock "48774298-024b-4c96-a72f-74195ef8b5be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-172e8837-f7de-49ca-ba9b-94246601fc03 req-bcf412c8-94b9-4e7a-b4ca-787de8abf09b service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-172e8837-f7de-49ca-ba9b-94246601fc03 req-bcf412c8-94b9-4e7a-b4ca-787de8abf09b service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-172e8837-f7de-49ca-ba9b-94246601fc03 req-bcf412c8-94b9-4e7a-b4ca-787de8abf09b service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] No waiting events found dispatching network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:39:17 user nova-compute[75071]: WARNING nova.compute.manager [req-172e8837-f7de-49ca-ba9b-94246601fc03 req-bcf412c8-94b9-4e7a-b4ca-787de8abf09b service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received unexpected event network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a for instance with vm_state building and task_state spawning.
Dec 05 12:39:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Updating instance_info_cache with network_info: [{"id": "7bb59ccd-77fa-411d-a777-05117b9bc509", "address": "fa:16:3e:b6:47:30", "network": {"id": "d81e562f-84e3-4bb7-ac06-dbed56646c43", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206547008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9aa06b8affa40c483794bb096c9fdeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb59ccd-77", "ovs_interfaceid": "7bb59ccd-77fa-411d-a777-05117b9bc509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Releasing lock "refresh_cache-72bb9c85-25b6-4a08-96bf-59881754adea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Instance network_info: |[{"id": "7bb59ccd-77fa-411d-a777-05117b9bc509", "address": "fa:16:3e:b6:47:30", "network": {"id": "d81e562f-84e3-4bb7-ac06-dbed56646c43", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206547008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9aa06b8affa40c483794bb096c9fdeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb59ccd-77", "ovs_interfaceid": "7bb59ccd-77fa-411d-a777-05117b9bc509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Start _get_guest_xml network_info=[{"id": "7bb59ccd-77fa-411d-a777-05117b9bc509", "address": "fa:16:3e:b6:47:30", "network": {"id": "d81e562f-84e3-4bb7-ac06-dbed56646c43", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206547008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9aa06b8affa40c483794bb096c9fdeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb59ccd-77", "ovs_interfaceid": "7bb59ccd-77fa-411d-a777-05117b9bc509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:39:18 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:39:18 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-265891495',display_name='tempest-SnapshotDataIntegrityTests-server-265891495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-265891495',id=42,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIdk45xKiV3UXoHNqLtilGBlZthWf4fYGGTJSKxDm1ljOk55sR7jfkcnBul3pBL97KDLn51Pwhuqy/ocBjWXOdjF8U5N5/NmCiHGakoL6rQleu1tSsFKagBoMoNtTGYlQ==',key_name='tempest-keypair-539634521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9aa06b8affa40c483794bb096c9fdeb',ramdisk_id='',reservation_id='r-fcyc67n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1051142258',owner_user_name='tempest-SnapshotDataIntegrityTests-1051142258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:39:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4450515c258b48b585fd4d6ac0d46987',uuid=72bb9c85-25b6-4a08-96bf-59881754adea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bb59ccd-77fa-411d-a777-05117b9bc509", "address": "fa:16:3e:b6:47:30", "network": {"id": "d81e562f-84e3-4bb7-ac06-dbed56646c43", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206547008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9aa06b8affa40c483794bb096c9fdeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb59ccd-77", "ovs_interfaceid": "7bb59ccd-77fa-411d-a777-05117b9bc509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Converting VIF {"id": "7bb59ccd-77fa-411d-a777-05117b9bc509", "address": "fa:16:3e:b6:47:30", "network": {"id": "d81e562f-84e3-4bb7-ac06-dbed56646c43", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206547008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9aa06b8affa40c483794bb096c9fdeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb59ccd-77", "ovs_interfaceid": "7bb59ccd-77fa-411d-a777-05117b9bc509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:47:30,bridge_name='br-int',has_traffic_filtering=True,id=7bb59ccd-77fa-411d-a777-05117b9bc509,network=Network(d81e562f-84e3-4bb7-ac06-dbed56646c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb59ccd-77') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lazy-loading 'pci_devices' on Instance uuid 72bb9c85-25b6-4a08-96bf-59881754adea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:39:18 user nova-compute[75071]:   <uuid>72bb9c85-25b6-4a08-96bf-59881754adea</uuid>
Dec 05 12:39:18 user nova-compute[75071]:   <name>instance-0000002a</name>
Dec 05 12:39:18 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:39:18 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:39:18 user nova-compute[75071]:   <metadata>
Dec 05 12:39:18 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:39:18 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:39:18 user nova-compute[75071]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-265891495</nova:name>
Dec 05 12:39:18 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:39:18</nova:creationTime>
Dec 05 12:39:18 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:39:18 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:39:18 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:39:18 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:39:18 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:39:18 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:39:18 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:39:18 user nova-compute[75071]:       <nova:owner>
Dec 05 12:39:18 user nova-compute[75071]:         <nova:user uuid="4450515c258b48b585fd4d6ac0d46987">tempest-SnapshotDataIntegrityTests-1051142258-project-member</nova:user>
Dec 05 12:39:18 user nova-compute[75071]:         <nova:project uuid="b9aa06b8affa40c483794bb096c9fdeb">tempest-SnapshotDataIntegrityTests-1051142258</nova:project>
Dec 05 12:39:18 user nova-compute[75071]:       </nova:owner>
Dec 05 12:39:18 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:39:18 user nova-compute[75071]:       <nova:ports>
Dec 05 12:39:18 user nova-compute[75071]:         <nova:port uuid="7bb59ccd-77fa-411d-a777-05117b9bc509">
Dec 05 12:39:18 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 05 12:39:18 user nova-compute[75071]:         </nova:port>
Dec 05 12:39:18 user nova-compute[75071]:       </nova:ports>
Dec 05 12:39:18 user nova-compute[75071]:     </nova:instance>
Dec 05 12:39:18 user nova-compute[75071]:   </metadata>
Dec 05 12:39:18 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:39:18 user nova-compute[75071]:     <system>
Dec 05 12:39:18 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:39:18 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:39:18 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:39:18 user nova-compute[75071]:       <entry name="serial">72bb9c85-25b6-4a08-96bf-59881754adea</entry>
Dec 05 12:39:18 user nova-compute[75071]:       <entry name="uuid">72bb9c85-25b6-4a08-96bf-59881754adea</entry>
Dec 05 12:39:18 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:39:18 user nova-compute[75071]:     </system>
Dec 05 12:39:18 user nova-compute[75071]:   </sysinfo>
Dec 05 12:39:18 user nova-compute[75071]:   <os>
Dec 05 12:39:18 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:39:18 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:39:18 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:39:18 user nova-compute[75071]:   </os>
Dec 05 12:39:18 user nova-compute[75071]:   <features>
Dec 05 12:39:18 user nova-compute[75071]:     <acpi/>
Dec 05 12:39:18 user nova-compute[75071]:     <apic/>
Dec 05 12:39:18 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:39:18 user nova-compute[75071]:   </features>
Dec 05 12:39:18 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:39:18 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:39:18 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:39:18 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:39:18 user nova-compute[75071]:   </clock>
Dec 05 12:39:18 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:39:18 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:39:18 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:39:18 user nova-compute[75071]:   </cpu>
Dec 05 12:39:18 user nova-compute[75071]:   <devices>
Dec 05 12:39:18 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:39:18 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:39:18 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk"/>
Dec 05 12:39:18 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:39:18 user nova-compute[75071]:     </disk>
Dec 05 12:39:18 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:39:18 user nova-compute[75071]:       <mac address="fa:16:3e:b6:47:30"/>
Dec 05 12:39:18 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:39:18 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:39:18 user nova-compute[75071]:       <target dev="tap7bb59ccd-77"/>
Dec 05 12:39:18 user nova-compute[75071]:     </interface>
Dec 05 12:39:18 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:39:18 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/console.log" append="off"/>
Dec 05 12:39:18 user nova-compute[75071]:     </serial>
Dec 05 12:39:18 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:39:18 user nova-compute[75071]:     <video>
Dec 05 12:39:18 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:39:18 user nova-compute[75071]:     </video>
Dec 05 12:39:18 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:39:18 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:39:18 user nova-compute[75071]:     </rng>
Dec 05 12:39:18 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:39:18 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:39:18 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:39:18 user nova-compute[75071]:     </memballoon>
Dec 05 12:39:18 user nova-compute[75071]:   </devices>
Dec 05 12:39:18 user nova-compute[75071]: </domain>
Dec 05 12:39:18 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-265891495',display_name='tempest-SnapshotDataIntegrityTests-server-265891495',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-265891495',id=42,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIdk45xKiV3UXoHNqLtilGBlZthWf4fYGGTJSKxDm1ljOk55sR7jfkcnBul3pBL97KDLn51Pwhuqy/ocBjWXOdjF8U5N5/NmCiHGakoL6rQleu1tSsFKagBoMoNtTGYlQ==',key_name='tempest-keypair-539634521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9aa06b8affa40c483794bb096c9fdeb',ramdisk_id='',reservation_id='r-fcyc67n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1051142258',owner_user_name='tempest-SnapshotDataIntegrityTests-1051142258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:39:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4450515c258b48b585fd4d6ac0d46987',uuid=72bb9c85-25b6-4a08-96bf-59881754adea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bb59ccd-77fa-411d-a777-05117b9bc509", "address": "fa:16:3e:b6:47:30", "network": {"id": "d81e562f-84e3-4bb7-ac06-dbed56646c43", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206547008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9aa06b8affa40c483794bb096c9fdeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb59ccd-77", "ovs_interfaceid": "7bb59ccd-77fa-411d-a777-05117b9bc509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Converting VIF {"id": "7bb59ccd-77fa-411d-a777-05117b9bc509", "address": "fa:16:3e:b6:47:30", "network": {"id": "d81e562f-84e3-4bb7-ac06-dbed56646c43", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206547008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9aa06b8affa40c483794bb096c9fdeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb59ccd-77", "ovs_interfaceid": "7bb59ccd-77fa-411d-a777-05117b9bc509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:47:30,bridge_name='br-int',has_traffic_filtering=True,id=7bb59ccd-77fa-411d-a777-05117b9bc509,network=Network(d81e562f-84e3-4bb7-ac06-dbed56646c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb59ccd-77') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG os_vif [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:47:30,bridge_name='br-int',has_traffic_filtering=True,id=7bb59ccd-77fa-411d-a777-05117b9bc509,network=Network(d81e562f-84e3-4bb7-ac06-dbed56646c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb59ccd-77') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e4ea4606-ca19-5c57-871f-9fbf084f5c20', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bb59ccd-77, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7bb59ccd-77, col_values=(('qos', UUID('2e1fe8d5-4d6b-43a1-8abf-e3b92cdeb2b0')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7bb59ccd-77, col_values=(('external_ids', {'iface-id': '7bb59ccd-77fa-411d-a777-05117b9bc509', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:47:30', 'vm-uuid': '72bb9c85-25b6-4a08-96bf-59881754adea'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:18 user nova-compute[75071]: INFO os_vif [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:47:30,bridge_name='br-int',has_traffic_filtering=True,id=7bb59ccd-77fa-411d-a777-05117b9bc509,network=Network(d81e562f-84e3-4bb7-ac06-dbed56646c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb59ccd-77')
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:39:18 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Took 0.90 seconds to deallocate network for instance.
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] No VIF found with MAC fa:16:3e:b6:47:30, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:18 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Deleted allocations for instance 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-5288290c-b9d0-4a8b-95c1-54135044cce0 req-e22554bf-0971-422b-91cb-80575f922f92 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5288290c-b9d0-4a8b-95c1-54135044cce0 req-e22554bf-0971-422b-91cb-80575f922f92 service nova] Acquiring lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5288290c-b9d0-4a8b-95c1-54135044cce0 req-e22554bf-0971-422b-91cb-80575f922f92 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5288290c-b9d0-4a8b-95c1-54135044cce0 req-e22554bf-0971-422b-91cb-80575f922f92 service nova] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-5288290c-b9d0-4a8b-95c1-54135044cce0 req-e22554bf-0971-422b-91cb-80575f922f92 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] No waiting events found dispatching network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:39:18 user nova-compute[75071]: WARNING nova.compute.manager [req-5288290c-b9d0-4a8b-95c1-54135044cce0 req-e22554bf-0971-422b-91cb-80575f922f92 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received unexpected event network-vif-plugged-dd15e936-54b4-4e4b-a17a-9bad21c19bac for instance with vm_state deleted and task_state None.
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-5288290c-b9d0-4a8b-95c1-54135044cce0 req-e22554bf-0971-422b-91cb-80575f922f92 service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Received event network-changed-7bb59ccd-77fa-411d-a777-05117b9bc509 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-5288290c-b9d0-4a8b-95c1-54135044cce0 req-e22554bf-0971-422b-91cb-80575f922f92 service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Refreshing instance network info cache due to event network-changed-7bb59ccd-77fa-411d-a777-05117b9bc509. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5288290c-b9d0-4a8b-95c1-54135044cce0 req-e22554bf-0971-422b-91cb-80575f922f92 service nova] Acquiring lock "refresh_cache-72bb9c85-25b6-4a08-96bf-59881754adea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5288290c-b9d0-4a8b-95c1-54135044cce0 req-e22554bf-0971-422b-91cb-80575f922f92 service nova] Acquired lock "refresh_cache-72bb9c85-25b6-4a08-96bf-59881754adea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG nova.network.neutron [req-5288290c-b9d0-4a8b-95c1-54135044cce0 req-e22554bf-0971-422b-91cb-80575f922f92 service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Refreshing network info cache for port 7bb59ccd-77fa-411d-a777-05117b9bc509 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:39:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9244621a-3f83-41d3-9451-b33d45f1bcdb tempest-ServerRescueNegativeTestJSON-170727457 tempest-ServerRescueNegativeTestJSON-170727457-project-member] Lock "9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.808s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG nova.network.neutron [req-5288290c-b9d0-4a8b-95c1-54135044cce0 req-e22554bf-0971-422b-91cb-80575f922f92 service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Updated VIF entry in instance network info cache for port 7bb59ccd-77fa-411d-a777-05117b9bc509. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG nova.network.neutron [req-5288290c-b9d0-4a8b-95c1-54135044cce0 req-e22554bf-0971-422b-91cb-80575f922f92 service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Updating instance_info_cache with network_info: [{"id": "7bb59ccd-77fa-411d-a777-05117b9bc509", "address": "fa:16:3e:b6:47:30", "network": {"id": "d81e562f-84e3-4bb7-ac06-dbed56646c43", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206547008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9aa06b8affa40c483794bb096c9fdeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb59ccd-77", "ovs_interfaceid": "7bb59ccd-77fa-411d-a777-05117b9bc509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5288290c-b9d0-4a8b-95c1-54135044cce0 req-e22554bf-0971-422b-91cb-80575f922f92 service nova] Releasing lock "refresh_cache-72bb9c85-25b6-4a08-96bf-59881754adea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-5288290c-b9d0-4a8b-95c1-54135044cce0 req-e22554bf-0971-422b-91cb-80575f922f92 service nova] [instance: 9d5e316d-b6a5-41c4-b4b4-2bf8ea5edd0f] Received event network-vif-deleted-dd15e936-54b4-4e4b-a17a-9bad21c19bac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:39:19 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Instance spawned successfully.
Dec 05 12:39:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:39:19 user nova-compute[75071]: INFO nova.compute.manager [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Took 5.31 seconds to spawn the instance on the hypervisor.
Dec 05 12:39:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:39:19 user nova-compute[75071]: INFO nova.compute.manager [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Took 26.60 seconds to build instance.
Dec 05 12:39:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c56575bd-988e-48f2-9019-bcf28f497bd7 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "48774298-024b-4c96-a72f-74195ef8b5be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.696s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-56715ebe-6847-4028-9995-7d09a1597d54 req-e5b19eb5-27fe-4b79-bd68-7dd7c184fcae service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received event network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-56715ebe-6847-4028-9995-7d09a1597d54 req-e5b19eb5-27fe-4b79-bd68-7dd7c184fcae service nova] Acquiring lock "48774298-024b-4c96-a72f-74195ef8b5be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-56715ebe-6847-4028-9995-7d09a1597d54 req-e5b19eb5-27fe-4b79-bd68-7dd7c184fcae service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-56715ebe-6847-4028-9995-7d09a1597d54 req-e5b19eb5-27fe-4b79-bd68-7dd7c184fcae service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG nova.compute.manager [req-56715ebe-6847-4028-9995-7d09a1597d54 req-e5b19eb5-27fe-4b79-bd68-7dd7c184fcae service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] No waiting events found dispatching network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:39:19 user nova-compute[75071]: WARNING nova.compute.manager [req-56715ebe-6847-4028-9995-7d09a1597d54 req-e5b19eb5-27fe-4b79-bd68-7dd7c184fcae service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received unexpected event network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a for instance with vm_state active and task_state None.
Dec 05 12:39:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-ca6f1907-5c96-484b-9836-b42c28333fc4 req-5770522a-0c5f-46bc-885d-dcbdced89d16 service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Received event network-vif-plugged-7bb59ccd-77fa-411d-a777-05117b9bc509 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:39:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ca6f1907-5c96-484b-9836-b42c28333fc4 req-5770522a-0c5f-46bc-885d-dcbdced89d16 service nova] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ca6f1907-5c96-484b-9836-b42c28333fc4 req-5770522a-0c5f-46bc-885d-dcbdced89d16 service nova] Lock "72bb9c85-25b6-4a08-96bf-59881754adea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ca6f1907-5c96-484b-9836-b42c28333fc4 req-5770522a-0c5f-46bc-885d-dcbdced89d16 service nova] Lock "72bb9c85-25b6-4a08-96bf-59881754adea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-ca6f1907-5c96-484b-9836-b42c28333fc4 req-5770522a-0c5f-46bc-885d-dcbdced89d16 service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] No waiting events found dispatching network-vif-plugged-7bb59ccd-77fa-411d-a777-05117b9bc509 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:39:21 user nova-compute[75071]: WARNING nova.compute.manager [req-ca6f1907-5c96-484b-9836-b42c28333fc4 req-5770522a-0c5f-46bc-885d-dcbdced89d16 service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Received unexpected event network-vif-plugged-7bb59ccd-77fa-411d-a777-05117b9bc509 for instance with vm_state building and task_state spawning.
Dec 05 12:39:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-ca6f1907-5c96-484b-9836-b42c28333fc4 req-5770522a-0c5f-46bc-885d-dcbdced89d16 service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Received event network-vif-plugged-7bb59ccd-77fa-411d-a777-05117b9bc509 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:39:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ca6f1907-5c96-484b-9836-b42c28333fc4 req-5770522a-0c5f-46bc-885d-dcbdced89d16 service nova] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ca6f1907-5c96-484b-9836-b42c28333fc4 req-5770522a-0c5f-46bc-885d-dcbdced89d16 service nova] Lock "72bb9c85-25b6-4a08-96bf-59881754adea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ca6f1907-5c96-484b-9836-b42c28333fc4 req-5770522a-0c5f-46bc-885d-dcbdced89d16 service nova] Lock "72bb9c85-25b6-4a08-96bf-59881754adea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-ca6f1907-5c96-484b-9836-b42c28333fc4 req-5770522a-0c5f-46bc-885d-dcbdced89d16 service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] No waiting events found dispatching network-vif-plugged-7bb59ccd-77fa-411d-a777-05117b9bc509 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:39:21 user nova-compute[75071]: WARNING nova.compute.manager [req-ca6f1907-5c96-484b-9836-b42c28333fc4 req-5770522a-0c5f-46bc-885d-dcbdced89d16 service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Received unexpected event network-vif-plugged-7bb59ccd-77fa-411d-a777-05117b9bc509 for instance with vm_state building and task_state spawning.
Dec 05 12:39:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:39:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:39:21 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Instance spawned successfully.
Dec 05 12:39:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:39:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:39:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:39:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:39:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:39:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:39:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:39:21 user nova-compute[75071]: INFO nova.compute.manager [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Took 6.43 seconds to spawn the instance on the hypervisor.
Dec 05 12:39:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:39:22 user nova-compute[75071]: INFO nova.compute.manager [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Took 7.19 seconds to build instance.
Dec 05 12:39:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b989990c-bacd-4ac6-8b85-12524f33792c tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.327s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-57aa12b4-b782-4430-ae79-bb7db6aa67e9 req-1445b6cc-deac-48f6-9cf8-ff2b00dd6033 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received event network-changed-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:39:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-57aa12b4-b782-4430-ae79-bb7db6aa67e9 req-1445b6cc-deac-48f6-9cf8-ff2b00dd6033 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Refreshing instance network info cache due to event network-changed-de4a3fbc-8399-45f2-9027-ec80fbaa1077. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:39:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-57aa12b4-b782-4430-ae79-bb7db6aa67e9 req-1445b6cc-deac-48f6-9cf8-ff2b00dd6033 service nova] Acquiring lock "refresh_cache-1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:39:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-57aa12b4-b782-4430-ae79-bb7db6aa67e9 req-1445b6cc-deac-48f6-9cf8-ff2b00dd6033 service nova] Acquired lock "refresh_cache-1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:39:25 user nova-compute[75071]: DEBUG nova.network.neutron [req-57aa12b4-b782-4430-ae79-bb7db6aa67e9 req-1445b6cc-deac-48f6-9cf8-ff2b00dd6033 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Refreshing network info cache for port de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:39:26 user nova-compute[75071]: DEBUG nova.network.neutron [req-57aa12b4-b782-4430-ae79-bb7db6aa67e9 req-1445b6cc-deac-48f6-9cf8-ff2b00dd6033 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Updated VIF entry in instance network info cache for port de4a3fbc-8399-45f2-9027-ec80fbaa1077. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:39:26 user nova-compute[75071]: DEBUG nova.network.neutron [req-57aa12b4-b782-4430-ae79-bb7db6aa67e9 req-1445b6cc-deac-48f6-9cf8-ff2b00dd6033 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Updating instance_info_cache with network_info: [{"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:39:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-57aa12b4-b782-4430-ae79-bb7db6aa67e9 req-1445b6cc-deac-48f6-9cf8-ff2b00dd6033 service nova] Releasing lock "refresh_cache-1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:39:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:28 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'flavor' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:39:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:28 user nova-compute[75071]: INFO nova.compute.manager [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Attaching volume 56de68af-8509-405a-9b7d-cee36a223be6 to /dev/vdb
Dec 05 12:39:28 user nova-compute[75071]: DEBUG os_brick.utils [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:39:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[176cfcd3-5df3-4f97-adf1-abaa86356ed9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd465ab6-a5e2-45d2-9c32-1d5133872089]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c715aa3-7d9e-41ef-904f-5acda475f9ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa977cc-b619-49bf-967d-cba27c45d2e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:39:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:39:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:39:29 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:39:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[298d8e70-b3b4-4b98-ba31-2641d0f7b45b]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:39:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:39:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:39:29 user nova-compute[75071]: DEBUG os_brick.utils [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:39:29 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Updating existing volume attachment record: 0110c13e-ee19-4bbe-8175-ed9afaba4357 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:39:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INcfTbng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:39:38 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:39:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:39:38 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:39:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:39:38 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:39:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fec2f9-a579-4529-b9c1-c72283c7fdbd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:39:38 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5601ac1-15f9-41de-8d07-4e24bae75ec6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6] added
Dec 05 12:39:38 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e1a7b2-e7ec-4cbb-9a11-02a884c6ebd7]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5186b38-d02b-4058-a91f-e04c0c9cd94b]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v INcfTbng {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v INcfTbng" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9205a954-829d-42b3-8ade-16fb625224b9]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'INcfTbng'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:39:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7286433-f763-4237-8bba-af2e9b908da7]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[be06d612-b3ae-4d9f-b8b4-212d3defbbb9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:39:39 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:39:39 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:39:39 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:39:39 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:39:39 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:39:39 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1265426-eec9-4066-8383-2d8fcdb314b8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6, portal: 172.16.0.220,3260]
Dec 05 12:39:39 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6, portal: 172.16.0.220,3260] successful.
Dec 05 12:39:39 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcde5ac-a619-4715-8369-5fa5943702bd]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[462d2d59-e2fb-4891-af2e-1d9cf31d10e5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:39:39 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:39:39 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:39:39 user nova-compute[75071]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:39:39 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:39:39 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:39:39 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:39:39 user nova-compute[75071]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:39:39 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7402b9a2-2596-4cde-958a-209397f08d49]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:39:39 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INcfTbng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:39:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:39:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26135316362343661', 'path': '/dev/sdd'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:39:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135316362343661', 'path': '/dev/sdd'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:39:40 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'flavor' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:39:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:39:40 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:39:40 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Dec 05 12:39:40 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:39:40 user nova-compute[75071]:   <serial>56de68af-8509-405a-9b7d-cee36a223be6</serial>
Dec 05 12:39:40 user nova-compute[75071]: </disk>
Dec 05 12:39:40 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:39:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:39:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:39:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] No VIF found with MAC fa:16:3e:3e:4e:da, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:39:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2606ce83-ac6c-4424-9c76-c4a8515e774c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.871s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-339a9143-904d-46da-a475-725b115214d6 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-339a9143-904d-46da-a475-725b115214d6 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-339a9143-904d-46da-a475-725b115214d6 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:39:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-339a9143-904d-46da-a475-725b115214d6 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75071) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Dec 05 12:39:41 user nova-compute[75071]: DEBUG nova.objects.instance [None req-339a9143-904d-46da-a475-725b115214d6 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'flavor' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:39:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-bc19ff6d-a9a0-4e17-849b-c8622e7e4f27 req-444c8ada-2178-40e8-a7ea-8778aa882145 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received event network-vif-unplugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:39:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bc19ff6d-a9a0-4e17-849b-c8622e7e4f27 req-444c8ada-2178-40e8-a7ea-8778aa882145 service nova] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bc19ff6d-a9a0-4e17-849b-c8622e7e4f27 req-444c8ada-2178-40e8-a7ea-8778aa882145 service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bc19ff6d-a9a0-4e17-849b-c8622e7e4f27 req-444c8ada-2178-40e8-a7ea-8778aa882145 service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-bc19ff6d-a9a0-4e17-849b-c8622e7e4f27 req-444c8ada-2178-40e8-a7ea-8778aa882145 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] No waiting events found dispatching network-vif-unplugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:39:42 user nova-compute[75071]: WARNING nova.compute.manager [req-bc19ff6d-a9a0-4e17-849b-c8622e7e4f27 req-444c8ada-2178-40e8-a7ea-8778aa882145 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received unexpected event network-vif-unplugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 for instance with vm_state active and task_state powering-off.
Dec 05 12:39:42 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Instance destroyed successfully.
Dec 05 12:39:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-339a9143-904d-46da-a475-725b115214d6 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:39:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-339a9143-904d-46da-a475-725b115214d6 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.897s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-4d15a2a5-bb48-47a4-a928-594eb308c3e2 req-978a6f12-3d68-460b-a2f5-10ba5cc76aea service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received event network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:39:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4d15a2a5-bb48-47a4-a928-594eb308c3e2 req-978a6f12-3d68-460b-a2f5-10ba5cc76aea service nova] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4d15a2a5-bb48-47a4-a928-594eb308c3e2 req-978a6f12-3d68-460b-a2f5-10ba5cc76aea service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4d15a2a5-bb48-47a4-a928-594eb308c3e2 req-978a6f12-3d68-460b-a2f5-10ba5cc76aea service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-4d15a2a5-bb48-47a4-a928-594eb308c3e2 req-978a6f12-3d68-460b-a2f5-10ba5cc76aea service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] No waiting events found dispatching network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:39:44 user nova-compute[75071]: WARNING nova.compute.manager [req-4d15a2a5-bb48-47a4-a928-594eb308c3e2 req-978a6f12-3d68-460b-a2f5-10ba5cc76aea service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received unexpected event network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 for instance with vm_state stopped and task_state None.
Dec 05 12:39:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:56 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:39:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:39:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:39:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:39:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:39:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:39:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:39:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:39:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:39:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:39:59 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:39:59 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquiring lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquiring lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:40:01 user nova-compute[75071]: INFO nova.compute.manager [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Terminating instance
Dec 05 12:40:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-47322606-76f0-4e97-921b-afdc4594c61f req-70a27f11-0bae-406f-b158-6c0eb5ff032c service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Received event network-vif-unplugged-9ceddfef-b16f-4269-bf98-fdf7156c1e41 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-47322606-76f0-4e97-921b-afdc4594c61f req-70a27f11-0bae-406f-b158-6c0eb5ff032c service nova] Acquiring lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-47322606-76f0-4e97-921b-afdc4594c61f req-70a27f11-0bae-406f-b158-6c0eb5ff032c service nova] Lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-47322606-76f0-4e97-921b-afdc4594c61f req-70a27f11-0bae-406f-b158-6c0eb5ff032c service nova] Lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-47322606-76f0-4e97-921b-afdc4594c61f req-70a27f11-0bae-406f-b158-6c0eb5ff032c service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] No waiting events found dispatching network-vif-unplugged-9ceddfef-b16f-4269-bf98-fdf7156c1e41 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-47322606-76f0-4e97-921b-afdc4594c61f req-70a27f11-0bae-406f-b158-6c0eb5ff032c service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Received event network-vif-unplugged-9ceddfef-b16f-4269-bf98-fdf7156c1e41 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:02 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Instance destroyed successfully.
Dec 05 12:40:02 user nova-compute[75071]: DEBUG nova.objects.instance [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lazy-loading 'resources' on Instance uuid d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:38:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1933233378',display_name='tempest-ServersNegativeTestJSON-server-1933233378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1933233378',id=40,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:38:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c9933b6650941d58025487be8dedc17',ramdisk_id='',reservation_id='r-p1jj9449',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-508219572',owner_user_name='tempest-ServersNegativeTestJSON-508219572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:38:18Z,user_data=None,user_id='3f07cde1f0ad4139ade7efe260ad7545',uuid=d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "address": "fa:16:3e:50:1f:8f", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ceddfef-b1", "ovs_interfaceid": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Converting VIF {"id": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "address": "fa:16:3e:50:1f:8f", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ceddfef-b1", "ovs_interfaceid": "9ceddfef-b16f-4269-bf98-fdf7156c1e41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:1f:8f,bridge_name='br-int',has_traffic_filtering=True,id=9ceddfef-b16f-4269-bf98-fdf7156c1e41,network=Network(7558883d-4135-4f8d-ac25-dccea82839e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ceddfef-b1') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG os_vif [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:1f:8f,bridge_name='br-int',has_traffic_filtering=True,id=9ceddfef-b16f-4269-bf98-fdf7156c1e41,network=Network(7558883d-4135-4f8d-ac25-dccea82839e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ceddfef-b1') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ceddfef-b1, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53b9fcd6-0790-423d-b012-149dc6bfb70b) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:02 user nova-compute[75071]: INFO os_vif [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:1f:8f,bridge_name='br-int',has_traffic_filtering=True,id=9ceddfef-b16f-4269-bf98-fdf7156c1e41,network=Network(7558883d-4135-4f8d-ac25-dccea82839e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ceddfef-b1')
Dec 05 12:40:02 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Deleting instance files /opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019_del
Dec 05 12:40:02 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Deletion of /opt/stack/data/nova/instances/d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019_del complete
Dec 05 12:40:02 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:40:02 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:40:02 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8004MB free_disk=24.729862213134766GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:40:02 user nova-compute[75071]: INFO nova.compute.manager [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Took 1.18 seconds to destroy the instance on the hypervisor.
Dec 05 12:40:02 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:40:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:40:02 user nova-compute[75071]: INFO nova.compute.manager [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Terminating instance
Dec 05 12:40:02 user nova-compute[75071]: DEBUG nova.compute.manager [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance e0c82eba-8448-4780-b92d-62d7c60ec7ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 42776e73-1ef0-4c57-a50a-942f6f4881de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9f492779-584e-4a21-9991-78de01f6670c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance f6b3497d-2998-48ba-9604-4332afa95c29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 48774298-024b-4c96-a72f-74195ef8b5be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 72bb9c85-25b6-4a08-96bf-59881754adea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:40:03 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Took 0.50 seconds to deallocate network for instance.
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-9d786c8b-ebc1-43d9-b028-cbe67706977b req-fc46681c-3a6e-4e13-abdf-393d42f64ffb service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Received event network-vif-deleted-9ceddfef-b16f-4269-bf98-fdf7156c1e41 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:40:03 user nova-compute[75071]: INFO nova.compute.manager [req-9d786c8b-ebc1-43d9-b028-cbe67706977b req-fc46681c-3a6e-4e13-abdf-393d42f64ffb service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Neutron deleted interface 9ceddfef-b16f-4269-bf98-fdf7156c1e41; detaching it from the instance and deleting it from the info cache
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.network.neutron [req-9d786c8b-ebc1-43d9-b028-cbe67706977b req-fc46681c-3a6e-4e13-abdf-393d42f64ffb service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-9d786c8b-ebc1-43d9-b028-cbe67706977b req-fc46681c-3a6e-4e13-abdf-393d42f64ffb service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Detach interface failed, port_id=9ceddfef-b16f-4269-bf98-fdf7156c1e41, reason: Instance d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:40:03 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Instance destroyed successfully.
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.objects.instance [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lazy-loading 'resources' on Instance uuid e0c82eba-8448-4780-b92d-62d7c60ec7ef {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:16:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-614681634',display_name='tempest-ServerStableDeviceRescueTest-server-614681634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-614681634',id=3,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBND8W1Zybd+g0C1dD78+dtozfG5vmhl919CuxP9SZzLTJGFsxhQvcxXPbGJgPQvvH3zGP+Wa5JPpC8q2E+mX0mftBd0gOdevPIVnDM93JeHOz80YSlDkAH90qcFoDmdGHg==',key_name='tempest-keypair-1105909075',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:21:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9e4d6230093b414ea5528dc2f9788a78',ramdisk_id='',reservation_id='r-jnssfdf0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-639129617',owner_user_name='tempest-ServerStableDeviceRescueTest-639129617-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1da411f6b242492ab5f67a8d21766f6d',uuid=e0c82eba-8448-4780-b92d-62d7c60ec7ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Converting VIF {"id": "30895720-729f-445d-b49a-d843f1cb23a8", "address": "fa:16:3e:65:08:02", "network": {"id": "44eba32b-49a9-4087-b09b-fb9ebfe41506", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1735441615-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9e4d6230093b414ea5528dc2f9788a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30895720-72", "ovs_interfaceid": "30895720-729f-445d-b49a-d843f1cb23a8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:08:02,bridge_name='br-int',has_traffic_filtering=True,id=30895720-729f-445d-b49a-d843f1cb23a8,network=Network(44eba32b-49a9-4087-b09b-fb9ebfe41506),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30895720-72') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG os_vif [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:08:02,bridge_name='br-int',has_traffic_filtering=True,id=30895720-729f-445d-b49a-d843f1cb23a8,network=Network(44eba32b-49a9-4087-b09b-fb9ebfe41506),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30895720-72') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30895720-72, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b2496b2-b06d-448b-8c27-197a9ac9a5da) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:03 user nova-compute[75071]: INFO os_vif [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:08:02,bridge_name='br-int',has_traffic_filtering=True,id=30895720-729f-445d-b49a-d843f1cb23a8,network=Network(44eba32b-49a9-4087-b09b-fb9ebfe41506),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30895720-72')
Dec 05 12:40:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oAHbNekR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:40:03 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:40:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:03 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Deleted allocations for instance d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019
Dec 05 12:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9229a2-c37f-4fdc-93c9-0e4be7fc6fdb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:40:03 user nova-compute[75071]: No targets found.
Dec 05 12:40:03 user nova-compute[75071]: iSNS:
Dec 05 12:40:03 user nova-compute[75071]: No targets found.
Dec 05 12:40:03 user nova-compute[75071]: STATIC:
Dec 05 12:40:03 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c
Dec 05 12:40:03 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:40:03 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:40:03 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219
Dec 05 12:40:03 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:40:03 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:40:03 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75
Dec 05 12:40:03 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:40:03 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:40:03 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6
Dec 05 12:40:03 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:40:03 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:40:03 user nova-compute[75071]: FIRMWARE:
Dec 05 12:40:03 user nova-compute[75071]: No targets found.
Dec 05 12:40:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:40:03 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:40:03 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a66a0d-6e9d-493c-8c84-2fcdf3293cb3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2068682d-da8e-4be5-9aeb-8ae543a1cd31]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:40:03 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:40:03 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:40:03 user nova-compute[75071]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:40:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 (non-flash)
Dec 05 12:40:03 user nova-compute[75071]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:40:03 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:40:03 user nova-compute[75071]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:40:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f826412f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd0ef03-391a-46eb-a793-f2d6a13794ac]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:40:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-02a5269b-1914-47ee-a191-d2eb2a200875 tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.276s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98dbf7e-5bbc-4daf-9b9e-b3f636dca0a5]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00f17cd-3675-4c15-b105-be50fd7423d3]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedae33e-0eb6-4796-af97-f1b5f6a1fa55]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[03318261-3dd4-4240-b7e9-a1db574b7e7a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-e9024732-cfc5-4e0b-9207-bef496f5f36d req-a70c9ca5-abb5-4e56-a74a-e3fce4ddce8c service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Received event network-vif-plugged-9ceddfef-b16f-4269-bf98-fdf7156c1e41 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e9024732-cfc5-4e0b-9207-bef496f5f36d req-a70c9ca5-abb5-4e56-a74a-e3fce4ddce8c service nova] Acquiring lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e9024732-cfc5-4e0b-9207-bef496f5f36d req-a70c9ca5-abb5-4e56-a74a-e3fce4ddce8c service nova] Lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e9024732-cfc5-4e0b-9207-bef496f5f36d req-a70c9ca5-abb5-4e56-a74a-e3fce4ddce8c service nova] Lock "d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-e9024732-cfc5-4e0b-9207-bef496f5f36d req-a70c9ca5-abb5-4e56-a74a-e3fce4ddce8c service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] No waiting events found dispatching network-vif-plugged-9ceddfef-b16f-4269-bf98-fdf7156c1e41 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:40:04 user nova-compute[75071]: WARNING nova.compute.manager [req-e9024732-cfc5-4e0b-9207-bef496f5f36d req-a70c9ca5-abb5-4e56-a74a-e3fce4ddce8c service nova] [instance: d459f52d-9a1c-4fd4-ace9-0a2a7c6ae019] Received unexpected event network-vif-plugged-9ceddfef-b16f-4269-bf98-fdf7156c1e41 for instance with vm_state deleted and task_state None.
Dec 05 12:40:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-e9024732-cfc5-4e0b-9207-bef496f5f36d req-a70c9ca5-abb5-4e56-a74a-e3fce4ddce8c service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received event network-vif-unplugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e9024732-cfc5-4e0b-9207-bef496f5f36d req-a70c9ca5-abb5-4e56-a74a-e3fce4ddce8c service nova] Acquiring lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e9024732-cfc5-4e0b-9207-bef496f5f36d req-a70c9ca5-abb5-4e56-a74a-e3fce4ddce8c service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e9024732-cfc5-4e0b-9207-bef496f5f36d req-a70c9ca5-abb5-4e56-a74a-e3fce4ddce8c service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-e9024732-cfc5-4e0b-9207-bef496f5f36d req-a70c9ca5-abb5-4e56-a74a-e3fce4ddce8c service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] No waiting events found dispatching network-vif-unplugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-e9024732-cfc5-4e0b-9207-bef496f5f36d req-a70c9ca5-abb5-4e56-a74a-e3fce4ddce8c service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received event network-vif-unplugged-30895720-729f-445d-b49a-d843f1cb23a8 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-e9024732-cfc5-4e0b-9207-bef496f5f36d req-a70c9ca5-abb5-4e56-a74a-e3fce4ddce8c service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received event network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e9024732-cfc5-4e0b-9207-bef496f5f36d req-a70c9ca5-abb5-4e56-a74a-e3fce4ddce8c service nova] Acquiring lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e9024732-cfc5-4e0b-9207-bef496f5f36d req-a70c9ca5-abb5-4e56-a74a-e3fce4ddce8c service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e9024732-cfc5-4e0b-9207-bef496f5f36d req-a70c9ca5-abb5-4e56-a74a-e3fce4ddce8c service nova] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG nova.compute.manager [req-e9024732-cfc5-4e0b-9207-bef496f5f36d req-a70c9ca5-abb5-4e56-a74a-e3fce4ddce8c service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] No waiting events found dispatching network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:40:04 user nova-compute[75071]: WARNING nova.compute.manager [req-e9024732-cfc5-4e0b-9207-bef496f5f36d req-a70c9ca5-abb5-4e56-a74a-e3fce4ddce8c service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received unexpected event network-vif-plugged-30895720-729f-445d-b49a-d843f1cb23a8 for instance with vm_state active and task_state deleting.
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff252d61-f3f9-4cab-b146-c511c178f1f6]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219, portal: 172.16.0.220,3260]
Dec 05 12:40:04 user nova-compute[75071]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219, portal: 172.16.0.220,3260] successful.
Dec 05 12:40:04 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4aad4b4-ae4a-421e-9dce-491dbd59a219 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b976d5-3779-409c-a8f7-9d7f9cd07c50]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] <== disconnect_volume: return (396ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:40:04 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Deleting instance files /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef_del
Dec 05 12:40:04 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Deletion of /opt/stack/data/nova/instances/e0c82eba-8448-4780-b92d-62d7c60ec7ef_del complete
Dec 05 12:40:04 user nova-compute[75071]: INFO nova.compute.manager [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Took 1.33 seconds to destroy the instance on the hypervisor.
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:40:04 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:40:05 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:40:05 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Took 0.92 seconds to deallocate network for instance.
Dec 05 12:40:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-7a80ccf2-01b9-4856-94e4-a0a9abd95fd3 req-c5e17c92-9e8b-47b9-9c67-c31d7a823cff service nova] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Received event network-vif-deleted-30895720-729f-445d-b49a-d843f1cb23a8 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:40:06 user nova-compute[75071]: INFO nova.compute.manager [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] [instance: e0c82eba-8448-4780-b92d-62d7c60ec7ef] Took 0.78 seconds to detach 1 volumes for instance.
Dec 05 12:40:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:40:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:40:06 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:40:06 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:40:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:40:06 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Deleted allocations for instance e0c82eba-8448-4780-b92d-62d7c60ec7ef
Dec 05 12:40:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-172d472d-8523-4a95-9bd6-6ea6f5faaabd tempest-ServerStableDeviceRescueTest-639129617 tempest-ServerStableDeviceRescueTest-639129617-project-member] Lock "e0c82eba-8448-4780-b92d-62d7c60ec7ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.479s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:40:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:40:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:40:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-42776e73-1ef0-4c57-a50a-942f6f4881de" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:40:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-42776e73-1ef0-4c57-a50a-942f6f4881de" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:40:06 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:40:07 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Updating instance_info_cache with network_info: [{"id": "3774446d-0014-4060-b722-f3480e92a274", "address": "fa:16:3e:c9:ac:48", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3774446d-00", "ovs_interfaceid": "3774446d-0014-4060-b722-f3480e92a274", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:40:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-42776e73-1ef0-4c57-a50a-942f6f4881de" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:40:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:40:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:40:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:40:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:40:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:40:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:40:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:40:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:40:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:40:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:40:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5006 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:40:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:40:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:40:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:40:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:43 user nova-compute[75071]: INFO nova.compute.manager [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Rescuing
Dec 05 12:40:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "refresh_cache-48774298-024b-4c96-a72f-74195ef8b5be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:40:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquired lock "refresh_cache-48774298-024b-4c96-a72f-74195ef8b5be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:40:43 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:40:44 user nova-compute[75071]: DEBUG nova.network.neutron [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Updating instance_info_cache with network_info: [{"id": "0d784760-630f-44d4-8ad1-1d965951b90a", "address": "fa:16:3e:e2:66:18", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d784760-63", "ovs_interfaceid": "0d784760-630f-44d4-8ad1-1d965951b90a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:40:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Releasing lock "refresh_cache-48774298-024b-4c96-a72f-74195ef8b5be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:40:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-cf152d55-1e72-4e02-b796-304b4306d449 req-05310fbb-b3f8-44df-8725-b960edce2384 service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received event network-vif-unplugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:40:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cf152d55-1e72-4e02-b796-304b4306d449 req-05310fbb-b3f8-44df-8725-b960edce2384 service nova] Acquiring lock "48774298-024b-4c96-a72f-74195ef8b5be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:40:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cf152d55-1e72-4e02-b796-304b4306d449 req-05310fbb-b3f8-44df-8725-b960edce2384 service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:40:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cf152d55-1e72-4e02-b796-304b4306d449 req-05310fbb-b3f8-44df-8725-b960edce2384 service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:40:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-cf152d55-1e72-4e02-b796-304b4306d449 req-05310fbb-b3f8-44df-8725-b960edce2384 service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] No waiting events found dispatching network-vif-unplugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:40:44 user nova-compute[75071]: WARNING nova.compute.manager [req-cf152d55-1e72-4e02-b796-304b4306d449 req-05310fbb-b3f8-44df-8725-b960edce2384 service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received unexpected event network-vif-unplugged-0d784760-630f-44d4-8ad1-1d965951b90a for instance with vm_state active and task_state rescuing.
Dec 05 12:40:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Instance destroyed successfully.
Dec 05 12:40:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Attempting a stable device rescue
Dec 05 12:40:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75071) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 05 12:40:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Instance directory exists: not creating {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 05 12:40:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Creating image(s)
Dec 05 12:40:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "/opt/stack/data/nova/instances/48774298-024b-4c96-a72f-74195ef8b5be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:40:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "/opt/stack/data/nova/instances/48774298-024b-4c96-a72f-74195ef8b5be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:40:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "/opt/stack/data/nova/instances/48774298-024b-4c96-a72f-74195ef8b5be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:40:45 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'trusted_certs' on Instance uuid 48774298-024b-4c96-a72f-74195ef8b5be {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:40:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "4fb8a478fd077b5909a679b30ad5f87d25ed3b78" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:40:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "4fb8a478fd077b5909a679b30ad5f87d25ed3b78" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:40:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fb8a478fd077b5909a679b30ad5f87d25ed3b78.part --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fb8a478fd077b5909a679b30ad5f87d25ed3b78.part --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:46 user nova-compute[75071]: DEBUG nova.virt.images [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] e9ddc205-86fd-4b64-b4c1-48262d4c1d07 was qcow2, converting to raw {{(pid=75071) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 05 12:40:46 user nova-compute[75071]: DEBUG nova.privsep.utils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75071) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 05 12:40:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4fb8a478fd077b5909a679b30ad5f87d25ed3b78.part /opt/stack/data/nova/instances/_base/4fb8a478fd077b5909a679b30ad5f87d25ed3b78.converted {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-5bfaf529-7ff8-4a2e-a25b-f8856d505b10 req-5bed1baa-4016-4343-9ec6-f9c328ef272d service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received event network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:40:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5bfaf529-7ff8-4a2e-a25b-f8856d505b10 req-5bed1baa-4016-4343-9ec6-f9c328ef272d service nova] Acquiring lock "48774298-024b-4c96-a72f-74195ef8b5be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:40:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5bfaf529-7ff8-4a2e-a25b-f8856d505b10 req-5bed1baa-4016-4343-9ec6-f9c328ef272d service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:40:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5bfaf529-7ff8-4a2e-a25b-f8856d505b10 req-5bed1baa-4016-4343-9ec6-f9c328ef272d service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:40:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-5bfaf529-7ff8-4a2e-a25b-f8856d505b10 req-5bed1baa-4016-4343-9ec6-f9c328ef272d service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] No waiting events found dispatching network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:40:46 user nova-compute[75071]: WARNING nova.compute.manager [req-5bfaf529-7ff8-4a2e-a25b-f8856d505b10 req-5bed1baa-4016-4343-9ec6-f9c328ef272d service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received unexpected event network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a for instance with vm_state active and task_state rescuing.
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4fb8a478fd077b5909a679b30ad5f87d25ed3b78.part /opt/stack/data/nova/instances/_base/4fb8a478fd077b5909a679b30ad5f87d25ed3b78.converted" returned: 0 in 0.535s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fb8a478fd077b5909a679b30ad5f87d25ed3b78.converted --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fb8a478fd077b5909a679b30ad5f87d25ed3b78.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "4fb8a478fd077b5909a679b30ad5f87d25ed3b78" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.060s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "4fb8a478fd077b5909a679b30ad5f87d25ed3b78" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "4fb8a478fd077b5909a679b30ad5f87d25ed3b78" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fb8a478fd077b5909a679b30ad5f87d25ed3b78 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4fb8a478fd077b5909a679b30ad5f87d25ed3b78 --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4fb8a478fd077b5909a679b30ad5f87d25ed3b78,backing_fmt=raw /opt/stack/data/nova/instances/48774298-024b-4c96-a72f-74195ef8b5be/disk.rescue {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4fb8a478fd077b5909a679b30ad5f87d25ed3b78,backing_fmt=raw /opt/stack/data/nova/instances/48774298-024b-4c96-a72f-74195ef8b5be/disk.rescue" returned: 0 in 0.054s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "4fb8a478fd077b5909a679b30ad5f87d25ed3b78" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'migration_context' on Instance uuid 48774298-024b-4c96-a72f-74195ef8b5be {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.objects.base [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Object Instance<48774298-024b-4c96-a72f-74195ef8b5be> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Start _get_guest_xml network_info=[{"id": "0d784760-630f-44d4-8ad1-1d965951b90a", "address": "fa:16:3e:e2:66:18", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "vif_mac": "fa:16:3e:e2:66:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d784760-63", "ovs_interfaceid": "0d784760-630f-44d4-8ad1-1d965951b90a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e9ddc205-86fd-4b64-b4c1-48262d4c1d07', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '2492f58d-2dcc-4c5c-9919-31af69f86998', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvTCSUVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '48774298-024b-4c96-a72f-74195ef8b5be', 'attached_at': '', 'detached_at': '', 'volume_id': '814f5874-1607-4eee-ad82-cc04df760f75', 'serial': '814f5874-1607-4eee-ad82-cc04df760f75'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'resources' on Instance uuid 48774298-024b-4c96-a72f-74195ef8b5be {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.objects.base [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Object Instance<48774298-024b-4c96-a72f-74195ef8b5be> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'numa_topology' on Instance uuid 48774298-024b-4c96-a72f-74195ef8b5be {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.objects.base [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Object Instance<48774298-024b-4c96-a72f-74195ef8b5be> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:40:47 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:40:47 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'vcpu_model' on Instance uuid 48774298-024b-4c96-a72f-74195ef8b5be {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.objects.base [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Object Instance<48774298-024b-4c96-a72f-74195ef8b5be> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvTCSUVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:40:47 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:40:47 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:40:47 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a8a77c-7e4f-43ab-8ce8-8866cbff491d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = HvTCSUVt\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 05 12:40:47 user nova-compute[75071]: node.name = iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75
Dec 05 12:40:47 user nova-compute[75071]: node.tpgt = -1
Dec 05 12:40:47 user nova-compute[75071]: node.startup = automatic
Dec 05 12:40:47 user nova-compute[75071]: node.leading_login = No
Dec 05 12:40:47 user nova-compute[75071]: iface.iscsi_ifacename = default
Dec 05 12:40:47 user nova-compute[75071]: iface.net_ifacename = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.ipaddress = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.prefix_len = 0
Dec 05 12:40:47 user nova-compute[75071]: iface.hwaddress = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.transport_name = tcp
Dec 05 12:40:47 user nova-compute[75071]: iface.initiatorname = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.state = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.vlan_id = 0
Dec 05 12:40:47 user nova-compute[75071]: iface.vlan_priority = 0
Dec 05 12:40:47 user nova-compute[75071]: iface.vlan_state = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.iface_num = 0
Dec 05 12:40:47 user nova-compute[75071]: iface.mtu = 0
Dec 05 12:40:47 user nova-compute[75071]: iface.port = 0
Dec 05 12:40:47 user nova-compute[75071]: iface.bootproto = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.subnet_mask = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.gateway = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.dhcp_alt_client_id_state = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.dhcp_alt_client_id = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.dhcp_dns = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.dhcp_learn_iqn = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.dhcp_req_vendor_id_state = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.dhcp_vendor_id_state = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.dhcp_vendor_id = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.dhcp_slp_da = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.fragmentation = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.gratuitous_arp = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.incoming_forwarding = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.tos_state = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.tos = 0
Dec 05 12:40:47 user nova-compute[75071]: iface.ttl = 0
Dec 05 12:40:47 user nova-compute[75071]: iface.delayed_ack = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.tcp_nagle = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.tcp_wsf_state = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.tcp_wsf = 0
Dec 05 12:40:47 user nova-compute[75071]: iface.tcp_timer_scale = 0
Dec 05 12:40:47 user nova-compute[75071]: iface.tcp_timestamp = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.redirect = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.def_task_mgmt_timeout = 0
Dec 05 12:40:47 user nova-compute[75071]: iface.header_digest = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.data_digest = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.immediate_data = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.initial_r2t = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.data_seq_inorder = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.data_pdu_inorder = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.erl = 0
Dec 05 12:40:47 user nova-compute[75071]: iface.max_receive_data_len = 0
Dec 05 12:40:47 user nova-compute[75071]: iface.first_burst_len = 0
Dec 05 12:40:47 user nova-compute[75071]: iface.max_outstanding_r2t = 0
Dec 05 12:40:47 user nova-compute[75071]: iface.max_burst_len = 0
Dec 05 12:40:47 user nova-compute[75071]: iface.chap_auth = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.bidi_chap = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.strict_login_compliance = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.discovery_auth = <empty>
Dec 05 12:40:47 user nova-compute[75071]: iface.discovery_logout = <empty>
Dec 05 12:40:47 user nova-compute[75071]: node.discovery_address = <empty>
Dec 05 12:40:47 user nova-compute[75071]: node.discovery_port = 0
Dec 05 12:40:47 user nova-compute[75071]: node.discovery_type = static
Dec 05 12:40:47 user nova-compute[75071]: node.session.initial_cmdsn = 0
Dec 05 12:40:47 user nova-compute[75071]: node.session.initial_login_retry_max = 8
Dec 05 12:40:47 user nova-compute[75071]: node.session.xmit_thread_priority = -20
Dec 05 12:40:47 user nova-compute[75071]: node.session.cmds_max = 128
Dec 05 12:40:47 user nova-compute[75071]: node.session.queue_depth = 32
Dec 05 12:40:47 user nova-compute[75071]: node.session.nr_sessions = 1
Dec 05 12:40:47 user nova-compute[75071]: node.session.auth.authmethod = CHAP
Dec 05 12:40:47 user nova-compute[75071]: node.session.auth.username = HvTCSUVt
Dec 05 12:40:47 user nova-compute[75071]: node.session.auth.password = ***
Dec 05 12:40:47 user nova-compute[75071]: node.session.auth.username_in = <empty>
Dec 05 12:40:47 user nova-compute[75071]: node.session.auth.password_in = <empty>
Dec 05 12:40:47 user nova-compute[75071]: node.session.auth.chap_algs = MD5
Dec 05 12:40:47 user nova-compute[75071]: node.session.timeo.replacement_timeout = 120
Dec 05 12:40:47 user nova-compute[75071]: node.session.err_timeo.abort_timeout = 15
Dec 05 12:40:47 user nova-compute[75071]: node.session.err_timeo.lu_reset_timeout = 30
Dec 05 12:40:47 user nova-compute[75071]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 05 12:40:47 user nova-compute[75071]: node.session.err_timeo.host_reset_timeout = 60
Dec 05 12:40:47 user nova-compute[75071]: node.session.iscsi.FastAbort = Yes
Dec 05 12:40:47 user nova-compute[75071]: node.session.iscsi.InitialR2T = No
Dec 05 12:40:47 user nova-compute[75071]: node.session.iscsi.ImmediateData = Yes
Dec 05 12:40:47 user nova-compute[75071]: node.session.iscsi.FirstBurstLength = 262144
Dec 05 12:40:47 user nova-compute[75071]: node.session.iscsi.MaxBurstLength = 16776192
Dec 05 12:40:47 user nova-compute[75071]: node.session.iscsi.DefaultTime2Retain = 0
Dec 05 12:40:47 user nova-compute[75071]: node.session.iscsi.DefaultTime2Wait = 2
Dec 05 12:40:47 user nova-compute[75071]: node.session.iscsi.MaxConnections = 1
Dec 05 12:40:47 user nova-compute[75071]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 05 12:40:47 user nova-compute[75071]: node.session.iscsi.ERL = 0
Dec 05 12:40:47 user nova-compute[75071]: node.session.scan = manual
Dec 05 12:40:47 user nova-compute[75071]: node.session.reopen_max = 0
Dec 05 12:40:47 user nova-compute[75071]: node.conn[0].address = 172.16.0.220
Dec 05 12:40:47 user nova-compute[75071]: node.conn[0].port = 3260
Dec 05 12:40:47 user nova-compute[75071]: node.conn[0].startup = manual
Dec 05 12:40:47 user nova-compute[75071]: node.conn[0].tcp.window_size = 524288
Dec 05 12:40:47 user nova-compute[75071]: node.conn[0].tcp.type_of_service = 0
Dec 05 12:40:47 user nova-compute[75071]: node.conn[0].timeo.logout_timeout = 15
Dec 05 12:40:47 user nova-compute[75071]: node.conn[0].timeo.login_timeout = 15
Dec 05 12:40:47 user nova-compute[75071]: node.conn[0].timeo.auth_timeout = 45
Dec 05 12:40:47 user nova-compute[75071]: node.conn[0].timeo.noop_out_interval = 5
Dec 05 12:40:47 user nova-compute[75071]: node.conn[0].timeo.noop_out_timeout = 5
Dec 05 12:40:47 user nova-compute[75071]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 05 12:40:47 user nova-compute[75071]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 05 12:40:47 user nova-compute[75071]: node.conn[0].iscsi.HeaderDigest = None
Dec 05 12:40:47 user nova-compute[75071]: node.conn[0].iscsi.DataDigest = None
Dec 05 12:40:47 user nova-compute[75071]: node.conn[0].iscsi.IFMarker = No
Dec 05 12:40:47 user nova-compute[75071]: node.conn[0].iscsi.OFMarker = No
Dec 05 12:40:47 user nova-compute[75071]: # END RECORD
Dec 05 12:40:47 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea54afb-f199-45bd-9b22-5095c04f36cf]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9465b4-a3b3-42a1-b288-5f7e2ae2d2d0]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvTCSUVt {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HvTCSUVt" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[297311fe-0650-4384-87a6-562472e8f1fe]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HvTCSUVt'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0397ab28-518d-46fb-b63d-249c8539d00c]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[115fc9b1-09b4-4f10-bda5-60087f91524b]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:40:47 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:40:47 user nova-compute[75071]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:40:47 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:40:47 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:40:47 user nova-compute[75071]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:40:47 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.138s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] HCTL ('33', '0', '0', 0) found on session 43 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad1c27b-b1d8-47af-ba46-78b95c0f85fb]: (4, ('0 0 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Searching for a device in session 43 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvTCSUVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.161s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] <== connect_volume: return (163ms) {'type': 'block', 'scsi_wwn': '23437316330363132', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437316330363132', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:38:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1043281140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1043281140',id=41,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:39:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b77a4b1baadd43e1be69eecb1f5370bd',ramdisk_id='',reservation_id='r-r39akty7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86909184',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:39:19Z,user_data=None,user_id='201cbbb8b3dc4a3aa8164d69c1257489',uuid=48774298-024b-4c96-a72f-74195ef8b5be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d784760-630f-44d4-8ad1-1d965951b90a", "address": "fa:16:3e:e2:66:18", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "vif_mac": "fa:16:3e:e2:66:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d784760-63", "ovs_interfaceid": "0d784760-630f-44d4-8ad1-1d965951b90a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converting VIF {"id": "0d784760-630f-44d4-8ad1-1d965951b90a", "address": "fa:16:3e:e2:66:18", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "vif_mac": "fa:16:3e:e2:66:18"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d784760-63", "ovs_interfaceid": "0d784760-630f-44d4-8ad1-1d965951b90a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:66:18,bridge_name='br-int',has_traffic_filtering=True,id=0d784760-630f-44d4-8ad1-1d965951b90a,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d784760-63') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.objects.instance [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'pci_devices' on Instance uuid 48774298-024b-4c96-a72f-74195ef8b5be {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.objects.base [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Object Instance<48774298-024b-4c96-a72f-74195ef8b5be> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:40:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:40:47 user nova-compute[75071]:   <uuid>48774298-024b-4c96-a72f-74195ef8b5be</uuid>
Dec 05 12:40:47 user nova-compute[75071]:   <name>instance-00000029</name>
Dec 05 12:40:47 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:40:47 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:40:47 user nova-compute[75071]:   <metadata>
Dec 05 12:40:47 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:40:47 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:40:47 user nova-compute[75071]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1043281140</nova:name>
Dec 05 12:40:47 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:40:47</nova:creationTime>
Dec 05 12:40:47 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:40:47 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:40:47 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:40:47 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:40:47 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:40:47 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:40:47 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:40:47 user nova-compute[75071]:       <nova:owner>
Dec 05 12:40:47 user nova-compute[75071]:         <nova:user uuid="201cbbb8b3dc4a3aa8164d69c1257489">tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member</nova:user>
Dec 05 12:40:47 user nova-compute[75071]:         <nova:project uuid="b77a4b1baadd43e1be69eecb1f5370bd">tempest-ServerBootFromVolumeStableRescueTest-86909184</nova:project>
Dec 05 12:40:47 user nova-compute[75071]:       </nova:owner>
Dec 05 12:40:47 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:40:47 user nova-compute[75071]:       <nova:ports>
Dec 05 12:40:47 user nova-compute[75071]:         <nova:port uuid="0d784760-630f-44d4-8ad1-1d965951b90a">
Dec 05 12:40:47 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 05 12:40:47 user nova-compute[75071]:         </nova:port>
Dec 05 12:40:47 user nova-compute[75071]:       </nova:ports>
Dec 05 12:40:47 user nova-compute[75071]:     </nova:instance>
Dec 05 12:40:47 user nova-compute[75071]:   </metadata>
Dec 05 12:40:47 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:40:47 user nova-compute[75071]:     <system>
Dec 05 12:40:47 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:40:47 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:40:47 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:40:47 user nova-compute[75071]:       <entry name="serial">48774298-024b-4c96-a72f-74195ef8b5be</entry>
Dec 05 12:40:47 user nova-compute[75071]:       <entry name="uuid">48774298-024b-4c96-a72f-74195ef8b5be</entry>
Dec 05 12:40:47 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:40:47 user nova-compute[75071]:     </system>
Dec 05 12:40:47 user nova-compute[75071]:   </sysinfo>
Dec 05 12:40:47 user nova-compute[75071]:   <os>
Dec 05 12:40:47 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:40:47 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:40:47 user nova-compute[75071]:   </os>
Dec 05 12:40:47 user nova-compute[75071]:   <features>
Dec 05 12:40:47 user nova-compute[75071]:     <acpi/>
Dec 05 12:40:47 user nova-compute[75071]:     <apic/>
Dec 05 12:40:47 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:40:47 user nova-compute[75071]:   </features>
Dec 05 12:40:47 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:40:47 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:40:47 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:40:47 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:40:47 user nova-compute[75071]:   </clock>
Dec 05 12:40:47 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:40:47 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:40:47 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:40:47 user nova-compute[75071]:   </cpu>
Dec 05 12:40:47 user nova-compute[75071]:   <devices>
Dec 05 12:40:47 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:40:47 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:40:47 user nova-compute[75071]:       <source dev="/dev/sdb"/>
Dec 05 12:40:47 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:40:47 user nova-compute[75071]:       <serial>814f5874-1607-4eee-ad82-cc04df760f75</serial>
Dec 05 12:40:47 user nova-compute[75071]:     </disk>
Dec 05 12:40:47 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:40:47 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:40:47 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/48774298-024b-4c96-a72f-74195ef8b5be/disk.rescue"/>
Dec 05 12:40:47 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Dec 05 12:40:47 user nova-compute[75071]:       <boot order="1"/>
Dec 05 12:40:47 user nova-compute[75071]:     </disk>
Dec 05 12:40:47 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:40:47 user nova-compute[75071]:       <mac address="fa:16:3e:e2:66:18"/>
Dec 05 12:40:47 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:40:47 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:40:47 user nova-compute[75071]:       <target dev="tap0d784760-63"/>
Dec 05 12:40:47 user nova-compute[75071]:     </interface>
Dec 05 12:40:47 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:40:47 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/48774298-024b-4c96-a72f-74195ef8b5be/console.log" append="off"/>
Dec 05 12:40:47 user nova-compute[75071]:     </serial>
Dec 05 12:40:47 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:40:47 user nova-compute[75071]:     <video>
Dec 05 12:40:47 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:40:47 user nova-compute[75071]:     </video>
Dec 05 12:40:47 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:40:47 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:40:47 user nova-compute[75071]:     </rng>
Dec 05 12:40:47 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:40:47 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:40:47 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:40:47 user nova-compute[75071]:     </memballoon>
Dec 05 12:40:47 user nova-compute[75071]:   </devices>
Dec 05 12:40:47 user nova-compute[75071]: </domain>
Dec 05 12:40:47 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:40:47 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Instance destroyed successfully.
Dec 05 12:40:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:40:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:40:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] No VIF found with MAC fa:16:3e:e2:66:18, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:40:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-5d4903cb-eea1-43b4-a79d-7b047798144a req-f81d4ac1-d735-4aae-a15a-3dfe8d99b5fe service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received event network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:40:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5d4903cb-eea1-43b4-a79d-7b047798144a req-f81d4ac1-d735-4aae-a15a-3dfe8d99b5fe service nova] Acquiring lock "48774298-024b-4c96-a72f-74195ef8b5be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:40:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5d4903cb-eea1-43b4-a79d-7b047798144a req-f81d4ac1-d735-4aae-a15a-3dfe8d99b5fe service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:40:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5d4903cb-eea1-43b4-a79d-7b047798144a req-f81d4ac1-d735-4aae-a15a-3dfe8d99b5fe service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:40:49 user nova-compute[75071]: DEBUG nova.compute.manager [req-5d4903cb-eea1-43b4-a79d-7b047798144a req-f81d4ac1-d735-4aae-a15a-3dfe8d99b5fe service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] No waiting events found dispatching network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:40:49 user nova-compute[75071]: WARNING nova.compute.manager [req-5d4903cb-eea1-43b4-a79d-7b047798144a req-f81d4ac1-d735-4aae-a15a-3dfe8d99b5fe service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received unexpected event network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a for instance with vm_state active and task_state rescuing.
Dec 05 12:40:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-72b7bb3d-c65f-4175-93e2-aa6c617c6bcc req-f461e8a5-b1b8-4244-82a0-6b15b08600a4 service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received event network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:40:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-72b7bb3d-c65f-4175-93e2-aa6c617c6bcc req-f461e8a5-b1b8-4244-82a0-6b15b08600a4 service nova] Acquiring lock "48774298-024b-4c96-a72f-74195ef8b5be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:40:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-72b7bb3d-c65f-4175-93e2-aa6c617c6bcc req-f461e8a5-b1b8-4244-82a0-6b15b08600a4 service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:40:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-72b7bb3d-c65f-4175-93e2-aa6c617c6bcc req-f461e8a5-b1b8-4244-82a0-6b15b08600a4 service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:40:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-72b7bb3d-c65f-4175-93e2-aa6c617c6bcc req-f461e8a5-b1b8-4244-82a0-6b15b08600a4 service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] No waiting events found dispatching network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:40:51 user nova-compute[75071]: WARNING nova.compute.manager [req-72b7bb3d-c65f-4175-93e2-aa6c617c6bcc req-f461e8a5-b1b8-4244-82a0-6b15b08600a4 service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received unexpected event network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a for instance with vm_state active and task_state rescuing.
Dec 05 12:40:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-6593388d-0d17-436c-af01-6480c9e51099 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:40:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:57 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:40:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:40:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:40:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:40:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:40:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:41:00 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:41:00 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:41:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:41:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:41:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:41:00 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:41:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:41:01 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:41:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48774298-024b-4c96-a72f-74195ef8b5be/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48774298-024b-4c96-a72f-74195ef8b5be/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48774298-024b-4c96-a72f-74195ef8b5be/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48774298-024b-4c96-a72f-74195ef8b5be/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:41:03 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:41:03 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:41:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8315MB free_disk=24.77657699584961GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:41:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.004s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:41:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:41:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 42776e73-1ef0-4c57-a50a-942f6f4881de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:41:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9f492779-584e-4a21-9991-78de01f6670c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:41:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance f6b3497d-2998-48ba-9604-4332afa95c29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:41:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:41:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 48774298-024b-4c96-a72f-74195ef8b5be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:41:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 72bb9c85-25b6-4a08-96bf-59881754adea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:41:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:41:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:41:04 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:41:04 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:41:04 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:41:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.608s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:41:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:41:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:41:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:41:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-180648b0-c65b-4653-b9a7-d1a8303ec450 req-6a9ce7e3-577a-4375-b6f5-f4cd0b6f961a service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Received event network-changed-7bb59ccd-77fa-411d-a777-05117b9bc509 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:41:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-180648b0-c65b-4653-b9a7-d1a8303ec450 req-6a9ce7e3-577a-4375-b6f5-f4cd0b6f961a service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Refreshing instance network info cache due to event network-changed-7bb59ccd-77fa-411d-a777-05117b9bc509. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:41:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-180648b0-c65b-4653-b9a7-d1a8303ec450 req-6a9ce7e3-577a-4375-b6f5-f4cd0b6f961a service nova] Acquiring lock "refresh_cache-72bb9c85-25b6-4a08-96bf-59881754adea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:41:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-180648b0-c65b-4653-b9a7-d1a8303ec450 req-6a9ce7e3-577a-4375-b6f5-f4cd0b6f961a service nova] Acquired lock "refresh_cache-72bb9c85-25b6-4a08-96bf-59881754adea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:41:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-180648b0-c65b-4653-b9a7-d1a8303ec450 req-6a9ce7e3-577a-4375-b6f5-f4cd0b6f961a service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Refreshing network info cache for port 7bb59ccd-77fa-411d-a777-05117b9bc509 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:41:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-180648b0-c65b-4653-b9a7-d1a8303ec450 req-6a9ce7e3-577a-4375-b6f5-f4cd0b6f961a service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Updated VIF entry in instance network info cache for port 7bb59ccd-77fa-411d-a777-05117b9bc509. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:41:06 user nova-compute[75071]: DEBUG nova.network.neutron [req-180648b0-c65b-4653-b9a7-d1a8303ec450 req-6a9ce7e3-577a-4375-b6f5-f4cd0b6f961a service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Updating instance_info_cache with network_info: [{"id": "7bb59ccd-77fa-411d-a777-05117b9bc509", "address": "fa:16:3e:b6:47:30", "network": {"id": "d81e562f-84e3-4bb7-ac06-dbed56646c43", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206547008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9aa06b8affa40c483794bb096c9fdeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb59ccd-77", "ovs_interfaceid": "7bb59ccd-77fa-411d-a777-05117b9bc509", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:41:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-180648b0-c65b-4653-b9a7-d1a8303ec450 req-6a9ce7e3-577a-4375-b6f5-f4cd0b6f961a service nova] Releasing lock "refresh_cache-72bb9c85-25b6-4a08-96bf-59881754adea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:41:08 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:41:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:41:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-9f492779-584e-4a21-9991-78de01f6670c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:41:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-9f492779-584e-4a21-9991-78de01f6670c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:41:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:41:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:41:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:41:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:41:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:41:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Updating instance_info_cache with network_info: [{"id": "5c69855c-e879-4e6a-800c-d78be52ba433", "address": "fa:16:3e:6a:3f:fe", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c69855c-e8", "ovs_interfaceid": "5c69855c-e879-4e6a-800c-d78be52ba433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-9f492779-584e-4a21-9991-78de01f6670c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG nova.objects.instance [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lazy-loading 'flavor' on Instance uuid 72bb9c85-25b6-4a08-96bf-59881754adea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:41:09 user nova-compute[75071]: INFO nova.compute.manager [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Attaching volume 89837156-1be5-4508-b199-1f6e5346cc35 to /dev/vdb
Dec 05 12:41:09 user nova-compute[75071]: DEBUG os_brick.utils [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01753d8-68d2-49c8-b131-ae8665061cc4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9cf772-b412-42a2-b848-c68e861d2598]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e800cbae-89eb-4cb6-9281-6af20218f30b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a0f4a7-299c-4df8-8cfa-704d84864580]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:41:09 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:41:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dd34f2-49ba-4885-9eeb-536eed3e629e]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:41:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:41:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:41:10 user nova-compute[75071]: DEBUG os_brick.utils [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:41:10 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Updating existing volume attachment record: 9e1f6b6c-9231-420e-a749-05bb643226b6 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:41:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JXFgSjqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:41:19 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:41:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:41:19 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:41:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:41:19 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:41:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6506ec9e-92bb-4043-a25f-f7aee97badd0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:41:19 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9de1e6-1725-4bf7-a382-08a128a33ea5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35] added
Dec 05 12:41:19 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1e720c-0f7d-4cf6-a565-ac82b90288de]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[334fe93d-d9b0-4a5a-add4-ad6d1b031f53]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JXFgSjqr {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JXFgSjqr" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0a2182-b782-46a1-8596-006f340b9926]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JXFgSjqr'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:41:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29653d2-27b7-40b7-8283-fb016c2ac020]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[76117902-beef-4822-b74e-f15fa2b52eca]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:41:20 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:41:20 user nova-compute[75071]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:41:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:41:20 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:41:20 user nova-compute[75071]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:41:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7795438b-a828-4dcc-a76e-34e733705755]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35, portal: 172.16.0.220,3260]
Dec 05 12:41:20 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35, portal: 172.16.0.220,3260] successful.
Dec 05 12:41:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae644cb-7c32-4a3a-b131-d157eb33fea6]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b38e4a9-1953-4f87-a26b-45b98d163c79]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:41:20 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:41:20 user nova-compute[75071]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:41:20 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 (non-flash)
Dec 05 12:41:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:41:20 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:41:20 user nova-compute[75071]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:41:20 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 (non-flash)
Dec 05 12:41:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03848c3-d24b-4a6b-8301-352a8ad35521]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:41:21 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:41:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JXFgSjqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:41:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:41:21 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26332353739366539', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:41:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332353739366539', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:41:21 user nova-compute[75071]: DEBUG nova.objects.instance [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lazy-loading 'flavor' on Instance uuid 72bb9c85-25b6-4a08-96bf-59881754adea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:41:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:41:21 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:41:21 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Dec 05 12:41:21 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:41:21 user nova-compute[75071]:   <serial>89837156-1be5-4508-b199-1f6e5346cc35</serial>
Dec 05 12:41:21 user nova-compute[75071]: </disk>
Dec 05 12:41:21 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:41:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:41:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:41:21 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] No VIF found with MAC fa:16:3e:b6:47:30, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:41:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4f68ddeb-3f69-42ac-9610-dd29e9caf7c9 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.050s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:41:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:32 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'flavor' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:41:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "refresh_cache-1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:41:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquired lock "refresh_cache-1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:41:32 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:41:32 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'info_cache' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:41:32 user nova-compute[75071]: DEBUG nova.objects.base [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Object Instance<1c4abc24-1295-4dd3-9fc4-8e8ac304fabf> lazy-loaded attributes: flavor,info_cache {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Updating instance_info_cache with network_info: [{"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Releasing lock "refresh_cache-1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:41:33 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Instance destroyed successfully.
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'resources' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.objects.base [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Object Instance<1c4abc24-1295-4dd3-9fc4-8e8ac304fabf> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2023774332',display_name='tempest-AttachVolumeTestJSON-server-2023774332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2023774332',id=39,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOMX/EZQmXhh7SdXzCFyRhmWDCDnYUHKgoB5uNuCbmikXutEQOOyGZ4O4+WzrfJeqIXgNW/+y2MaSiDfRCdQEgi/HUIV4qPam6B1OlLSXl5XEVzQ3IxLyJkjekI/XzLYg==',key_name='tempest-keypair-1505168977',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:37:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9640f3ad175948f59ba184167e4bf5a9',ramdisk_id='',reservation_id='r-er01om00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-660715611',owner_user_name='tempest-AttachVolumeTestJSON-660715611-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:39:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b2ab4b19a9b4ce397ffa1cc279e26ac',uuid=1c4abc24-1295-4dd3-9fc4-8e8ac304fabf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converting VIF {"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_vif [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde4a3fbc-83, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee984adf-cdec-4fb4-9de4-09297d218350) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:41:33 user nova-compute[75071]: INFO os_vif [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83')
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INcfTbng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:41:33 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9593ab2f-7f49-4884-8876-499f8f356ce7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:41:33 user nova-compute[75071]: No targets found.
Dec 05 12:41:33 user nova-compute[75071]: iSNS:
Dec 05 12:41:33 user nova-compute[75071]: No targets found.
Dec 05 12:41:33 user nova-compute[75071]: STATIC:
Dec 05 12:41:33 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35
Dec 05 12:41:33 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:41:33 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:41:33 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c
Dec 05 12:41:33 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:41:33 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:41:33 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75
Dec 05 12:41:33 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:41:33 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:41:33 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6
Dec 05 12:41:33 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:41:33 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:41:33 user nova-compute[75071]: FIRMWARE:
Dec 05 12:41:33 user nova-compute[75071]: No targets found.
Dec 05 12:41:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:41:33 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:41:33 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee74dee1-ca24-47cf-b420-fb3bc03c89fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be243e5-0a1d-4d29-a3c6-943de365b46e]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:41:33 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:41:33 user nova-compute[75071]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:41:33 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 (non-flash)
Dec 05 12:41:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:41:33 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:41:33 user nova-compute[75071]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:41:33 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 (non-flash)
Dec 05 12:41:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8264139c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6'): ({'sdd'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Removing single pathed devices sdd {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[485198d7-ee37-4102-8256-b5b91aa92c9c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a106d559-bcc9-4b3b-9697-5cfb7b08a7c1]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Flushing IO for device /dev/sdd {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[987badb6-1fa5-469d-a2c3-80b3662169cd]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[105a0a40-edf2-4fb6-a034-1df8696fb68d]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[79adb026-3d77-4e58-8048-164e0636693b]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5d7f64-f199-4ae8-8860-ecde1362bb8e]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6, portal: 172.16.0.220,3260]
Dec 05 12:41:33 user nova-compute[75071]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6, portal: 172.16.0.220,3260] successful.
Dec 05 12:41:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[20710f37-8e2a-4d4e-ad92-6c2cd2d9ea00]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] <== disconnect_volume: return (313ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Start _get_guest_xml network_info=[{"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '0110c13e-ee19-4bbe-8175-ed9afaba4357', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INcfTbng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '1c4abc24-1295-4dd3-9fc4-8e8ac304fabf', 'attached_at': '', 'detached_at': '', 'volume_id': '56de68af-8509-405a-9b7d-cee36a223be6', 'serial': '56de68af-8509-405a-9b7d-cee36a223be6'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'numa_topology' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.objects.base [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Object Instance<1c4abc24-1295-4dd3-9fc4-8e8ac304fabf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:41:33 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:41:33 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.objects.base [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Object Instance<1c4abc24-1295-4dd3-9fc4-8e8ac304fabf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INcfTbng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:41:33 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:41:33 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:41:33 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ad832a-13d6-4baa-aca6-547a63f1a54b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:41:33 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dd919f-9440-4107-b7c2-246e0bca4345]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6] added
Dec 05 12:41:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e805940-c563-4b34-ab98-e18530371939]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ab8f5b-2438-4a3b-b8b3-fa5bc1768749]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v INcfTbng {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v INcfTbng" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c2c70c-7e31-46b6-b38e-00e5d0a947cf]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'INcfTbng'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb4f6a0-e077-4922-b4d9-60247eb92b8e]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e54d0b-811f-403f-b8b2-fa4ec855b8ac]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:41:33 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:41:33 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 (non-flash)
Dec 05 12:41:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:41:33 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:41:33 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 (non-flash)
Dec 05 12:41:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[732dda2f-d683-4157-b999-ae029125a250]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6, portal: 172.16.0.220,3260]
Dec 05 12:41:33 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6, portal: 172.16.0.220,3260] successful.
Dec 05 12:41:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adefb06-3343-4dcd-855d-d4c25daba349]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4550118e-7b7c-40a2-b4bd-a8e03441a7e3]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:41:33 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:41:33 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 (non-flash)
Dec 05 12:41:33 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:41:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:41:33 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:41:33 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 (non-flash)
Dec 05 12:41:33 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:41:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff83442-5b81-4672-865f-8a348bb025ea]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:41:34 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:41:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INcfTbng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:41:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26135316362343661', 'path': '/dev/sdd'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135316362343661', 'path': '/dev/sdd'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2023774332',display_name='tempest-AttachVolumeTestJSON-server-2023774332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2023774332',id=39,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOMX/EZQmXhh7SdXzCFyRhmWDCDnYUHKgoB5uNuCbmikXutEQOOyGZ4O4+WzrfJeqIXgNW/+y2MaSiDfRCdQEgi/HUIV4qPam6B1OlLSXl5XEVzQ3IxLyJkjekI/XzLYg==',key_name='tempest-keypair-1505168977',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:37:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9640f3ad175948f59ba184167e4bf5a9',ramdisk_id='',reservation_id='r-er01om00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-660715611',owner_user_name='tempest-AttachVolumeTestJSON-660715611-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:39:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b2ab4b19a9b4ce397ffa1cc279e26ac',uuid=1c4abc24-1295-4dd3-9fc4-8e8ac304fabf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converting VIF {"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG nova.objects.base [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Object Instance<1c4abc24-1295-4dd3-9fc4-8e8ac304fabf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:41:35 user nova-compute[75071]:   <uuid>1c4abc24-1295-4dd3-9fc4-8e8ac304fabf</uuid>
Dec 05 12:41:35 user nova-compute[75071]:   <name>instance-00000027</name>
Dec 05 12:41:35 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:41:35 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:41:35 user nova-compute[75071]:   <metadata>
Dec 05 12:41:35 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:41:35 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:41:35 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeTestJSON-server-2023774332</nova:name>
Dec 05 12:41:35 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:41:33</nova:creationTime>
Dec 05 12:41:35 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:41:35 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:41:35 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:41:35 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:41:35 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:41:35 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:41:35 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:41:35 user nova-compute[75071]:       <nova:owner>
Dec 05 12:41:35 user nova-compute[75071]:         <nova:user uuid="2b2ab4b19a9b4ce397ffa1cc279e26ac">tempest-AttachVolumeTestJSON-660715611-project-member</nova:user>
Dec 05 12:41:35 user nova-compute[75071]:         <nova:project uuid="9640f3ad175948f59ba184167e4bf5a9">tempest-AttachVolumeTestJSON-660715611</nova:project>
Dec 05 12:41:35 user nova-compute[75071]:       </nova:owner>
Dec 05 12:41:35 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:41:35 user nova-compute[75071]:       <nova:ports>
Dec 05 12:41:35 user nova-compute[75071]:         <nova:port uuid="de4a3fbc-8399-45f2-9027-ec80fbaa1077">
Dec 05 12:41:35 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 12:41:35 user nova-compute[75071]:         </nova:port>
Dec 05 12:41:35 user nova-compute[75071]:       </nova:ports>
Dec 05 12:41:35 user nova-compute[75071]:     </nova:instance>
Dec 05 12:41:35 user nova-compute[75071]:   </metadata>
Dec 05 12:41:35 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:41:35 user nova-compute[75071]:     <system>
Dec 05 12:41:35 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:41:35 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:41:35 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:41:35 user nova-compute[75071]:       <entry name="serial">1c4abc24-1295-4dd3-9fc4-8e8ac304fabf</entry>
Dec 05 12:41:35 user nova-compute[75071]:       <entry name="uuid">1c4abc24-1295-4dd3-9fc4-8e8ac304fabf</entry>
Dec 05 12:41:35 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:41:35 user nova-compute[75071]:     </system>
Dec 05 12:41:35 user nova-compute[75071]:   </sysinfo>
Dec 05 12:41:35 user nova-compute[75071]:   <os>
Dec 05 12:41:35 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:41:35 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:41:35 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:41:35 user nova-compute[75071]:   </os>
Dec 05 12:41:35 user nova-compute[75071]:   <features>
Dec 05 12:41:35 user nova-compute[75071]:     <acpi/>
Dec 05 12:41:35 user nova-compute[75071]:     <apic/>
Dec 05 12:41:35 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:41:35 user nova-compute[75071]:   </features>
Dec 05 12:41:35 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:41:35 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:41:35 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:41:35 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:41:35 user nova-compute[75071]:   </clock>
Dec 05 12:41:35 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:41:35 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:41:35 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:41:35 user nova-compute[75071]:   </cpu>
Dec 05 12:41:35 user nova-compute[75071]:   <devices>
Dec 05 12:41:35 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:41:35 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:41:35 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk"/>
Dec 05 12:41:35 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:41:35 user nova-compute[75071]:     </disk>
Dec 05 12:41:35 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:41:35 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:41:35 user nova-compute[75071]:       <source dev="/dev/sdd"/>
Dec 05 12:41:35 user nova-compute[75071]:       <target dev="vdb" bus="virtio"/>
Dec 05 12:41:35 user nova-compute[75071]:       <serial>56de68af-8509-405a-9b7d-cee36a223be6</serial>
Dec 05 12:41:35 user nova-compute[75071]:     </disk>
Dec 05 12:41:35 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:41:35 user nova-compute[75071]:       <mac address="fa:16:3e:3e:4e:da"/>
Dec 05 12:41:35 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:41:35 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:41:35 user nova-compute[75071]:       <target dev="tapde4a3fbc-83"/>
Dec 05 12:41:35 user nova-compute[75071]:     </interface>
Dec 05 12:41:35 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:41:35 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/console.log" append="off"/>
Dec 05 12:41:35 user nova-compute[75071]:     </serial>
Dec 05 12:41:35 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:41:35 user nova-compute[75071]:     <video>
Dec 05 12:41:35 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:41:35 user nova-compute[75071]:     </video>
Dec 05 12:41:35 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:41:35 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:41:35 user nova-compute[75071]:     </rng>
Dec 05 12:41:35 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:41:35 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:41:35 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:41:35 user nova-compute[75071]:     </memballoon>
Dec 05 12:41:35 user nova-compute[75071]:   </devices>
Dec 05 12:41:35 user nova-compute[75071]: </domain>
Dec 05 12:41:35 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG nova.objects.base [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Object Instance<1c4abc24-1295-4dd3-9fc4-8e8ac304fabf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.200s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Cannot resize image /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'migration_context' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG nova.objects.base [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Object Instance<1c4abc24-1295-4dd3-9fc4-8e8ac304fabf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2023774332',display_name='tempest-AttachVolumeTestJSON-server-2023774332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2023774332',id=39,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOMX/EZQmXhh7SdXzCFyRhmWDCDnYUHKgoB5uNuCbmikXutEQOOyGZ4O4+WzrfJeqIXgNW/+y2MaSiDfRCdQEgi/HUIV4qPam6B1OlLSXl5XEVzQ3IxLyJkjekI/XzLYg==',key_name='tempest-keypair-1505168977',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:37:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='9640f3ad175948f59ba184167e4bf5a9',ramdisk_id='',reservation_id='r-er01om00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-660715611',owner_user_name='tempest-AttachVolumeTestJSON-660715611-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:39:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b2ab4b19a9b4ce397ffa1cc279e26ac',uuid=1c4abc24-1295-4dd3-9fc4-8e8ac304fabf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converting VIF {"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG os_vif [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa24488e-06b5-56b4-8ab6-f81fd6f9b97c', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde4a3fbc-83, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde4a3fbc-83, col_values=(('qos', UUID('11d9ccb7-0d5f-4e91-af09-7093ac58db93')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde4a3fbc-83, col_values=(('external_ids', {'iface-id': 'de4a3fbc-8399-45f2-9027-ec80fbaa1077', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:4e:da', 'vm-uuid': '1c4abc24-1295-4dd3-9fc4-8e8ac304fabf'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:41:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:35 user nova-compute[75071]: INFO os_vif [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83')
Dec 05 12:41:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-38969a7e-c919-4c48-9816-223bc62ab0e4 req-ac8a8d0b-eaae-47f9-9d3c-08c4879ef811 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received event network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:41:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-38969a7e-c919-4c48-9816-223bc62ab0e4 req-ac8a8d0b-eaae-47f9-9d3c-08c4879ef811 service nova] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:41:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-38969a7e-c919-4c48-9816-223bc62ab0e4 req-ac8a8d0b-eaae-47f9-9d3c-08c4879ef811 service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:41:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-38969a7e-c919-4c48-9816-223bc62ab0e4 req-ac8a8d0b-eaae-47f9-9d3c-08c4879ef811 service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:41:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-38969a7e-c919-4c48-9816-223bc62ab0e4 req-ac8a8d0b-eaae-47f9-9d3c-08c4879ef811 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] No waiting events found dispatching network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:41:37 user nova-compute[75071]: WARNING nova.compute.manager [req-38969a7e-c919-4c48-9816-223bc62ab0e4 req-ac8a8d0b-eaae-47f9-9d3c-08c4879ef811 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received unexpected event network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 for instance with vm_state stopped and task_state powering-on.
Dec 05 12:41:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-19188a51-3851-49ee-8c69-181f5825d823 req-38c3c240-2f50-450a-809f-3a6ab35377fd service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received event network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:41:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-19188a51-3851-49ee-8c69-181f5825d823 req-38c3c240-2f50-450a-809f-3a6ab35377fd service nova] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:41:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-19188a51-3851-49ee-8c69-181f5825d823 req-38c3c240-2f50-450a-809f-3a6ab35377fd service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:41:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-19188a51-3851-49ee-8c69-181f5825d823 req-38c3c240-2f50-450a-809f-3a6ab35377fd service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:41:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-19188a51-3851-49ee-8c69-181f5825d823 req-38c3c240-2f50-450a-809f-3a6ab35377fd service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] No waiting events found dispatching network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:41:39 user nova-compute[75071]: WARNING nova.compute.manager [req-19188a51-3851-49ee-8c69-181f5825d823 req-38c3c240-2f50-450a-809f-3a6ab35377fd service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received unexpected event network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 for instance with vm_state stopped and task_state powering-on.
Dec 05 12:41:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:41:39 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Instance rebooted successfully.
Dec 05 12:41:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-1679692d-c855-43b5-aa88-0ad461fbf6be tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:41:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:41:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:41:39 user nova-compute[75071]: INFO nova.compute.manager [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Detaching volume 89837156-1be5-4508-b199-1f6e5346cc35
Dec 05 12:41:39 user nova-compute[75071]: INFO nova.virt.block_device [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Attempting to driver detach volume 89837156-1be5-4508-b199-1f6e5346cc35 from mountpoint /dev/vdb
Dec 05 12:41:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Attempting to detach device vdb from instance 72bb9c85-25b6-4a08-96bf-59881754adea from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:41:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:41:39 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:41:39 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Dec 05 12:41:39 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:41:39 user nova-compute[75071]:   <serial>89837156-1be5-4508-b199-1f6e5346cc35</serial>
Dec 05 12:41:39 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:41:39 user nova-compute[75071]: </disk>
Dec 05 12:41:39 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:41:39 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Successfully detached device vdb from instance 72bb9c85-25b6-4a08-96bf-59881754adea from the persistent domain config.
Dec 05 12:41:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72bb9c85-25b6-4a08-96bf-59881754adea from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:41:39 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:41:39 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:41:39 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Dec 05 12:41:39 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:41:39 user nova-compute[75071]:   <serial>89837156-1be5-4508-b199-1f6e5346cc35</serial>
Dec 05 12:41:39 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:41:39 user nova-compute[75071]: </disk>
Dec 05 12:41:39 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:41:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72bb9c85-25b6-4a08-96bf-59881754adea {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:41:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:41:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:58 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:41:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:41:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:41:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:42:00 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 72bb9c85-25b6-4a08-96bf-59881754adea is timed out.
Dec 05 12:42:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Successfully detached device vdb from instance 72bb9c85-25b6-4a08-96bf-59881754adea from the live domain config.
Dec 05 12:42:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JXFgSjqr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:42:00 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cfcd9d-3342-4f74-8052-ca013f1984cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:42:00 user nova-compute[75071]: No targets found.
Dec 05 12:42:00 user nova-compute[75071]: iSNS:
Dec 05 12:42:00 user nova-compute[75071]: No targets found.
Dec 05 12:42:00 user nova-compute[75071]: STATIC:
Dec 05 12:42:00 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35
Dec 05 12:42:00 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:42:00 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:42:00 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c
Dec 05 12:42:00 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:42:00 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:42:00 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75
Dec 05 12:42:00 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:42:00 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:42:00 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6
Dec 05 12:42:00 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:42:00 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:42:00 user nova-compute[75071]: FIRMWARE:
Dec 05 12:42:00 user nova-compute[75071]: No targets found.
Dec 05 12:42:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:42:00 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:42:00 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2a3228-985b-4a2d-9b0a-854c800fe4a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8d121d-5579-45ba-a0e6-b46983fdb153]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:42:00 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:42:00 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 (non-flash)
Dec 05 12:42:00 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:42:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:42:00 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:42:00 user nova-compute[75071]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 (non-flash)
Dec 05 12:42:00 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:42:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8240667d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[569d4e4a-d507-487b-b5a5-75260a2adeae]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acd9cce-14cc-4b90-82ec-880f6a3d9d65]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9502b5-014c-4cf9-a28a-7a6d33b9c869]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[380913b3-abaa-4c7a-baef-cb24b5e0428a]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fd0dfc-d705-4f2a-b650-6cafc29faa42]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ab452c-6ca8-4ffd-a62f-1f58b77a690f]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35, portal: 172.16.0.220,3260]
Dec 05 12:42:00 user nova-compute[75071]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35, portal: 172.16.0.220,3260] successful.
Dec 05 12:42:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89837156-1be5-4508-b199-1f6e5346cc35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a327a12-78d7-4818-89dd-ca5ff3781375]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] <== disconnect_volume: return (325ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:42:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:42:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:42:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:42:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:42:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:42:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:42:01 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:42:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:01 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lazy-loading 'flavor' on Instance uuid 72bb9c85-25b6-4a08-96bf-59881754adea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:42:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0be20eea-8aed-43fa-89b3-f17bb4a9af21 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.339s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:42:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:42:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48774298-024b-4c96-a72f-74195ef8b5be/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48774298-024b-4c96-a72f-74195ef8b5be/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48774298-024b-4c96-a72f-74195ef8b5be/disk.rescue --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:02 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48774298-024b-4c96-a72f-74195ef8b5be/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:42:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:04 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:42:04 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:42:04 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8161MB free_disk=24.761425018310547GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:42:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:42:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:42:04 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:42:04 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 42776e73-1ef0-4c57-a50a-942f6f4881de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:42:04 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9f492779-584e-4a21-9991-78de01f6670c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:42:04 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance f6b3497d-2998-48ba-9604-4332afa95c29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:42:04 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:42:04 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 48774298-024b-4c96-a72f-74195ef8b5be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:42:04 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 72bb9c85-25b6-4a08-96bf-59881754adea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:42:04 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:42:04 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:42:05 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:42:05 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:42:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:42:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.441s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:42:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:42:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:42:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:42:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:09 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:42:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:42:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 12:42:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lazy-loading 'flavor' on Instance uuid 72bb9c85-25b6-4a08-96bf-59881754adea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:42:33 user nova-compute[75071]: INFO nova.compute.manager [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Attaching volume 0e65fff2-4d20-4174-a824-c59ecf5cfe8c to /dev/vdb
Dec 05 12:42:33 user nova-compute[75071]: DEBUG os_brick.utils [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e7850d-3e5e-4899-ae78-356d42312430]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[46de7391-8632-498f-aca6-761612aaa690]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf22acc6-8057-40d6-b152-a9b5b4120dc0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53e5d0d-bee7-4696-8e5b-3175deb76fb7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:42:33 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:42:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8561419e-670b-4901-a4ca-b88347cbda3f]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG os_brick.utils [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:42:33 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Updating existing volume attachment record: ffe709bf-a4ff-4511-9101-b25f333706b1 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:42:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:34 user nova-compute[75071]: INFO nova.compute.manager [None req-03166106-5b33-4ff0-aed8-20f0bfa354b6 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Unrescuing
Dec 05 12:42:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-03166106-5b33-4ff0-aed8-20f0bfa354b6 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "refresh_cache-48774298-024b-4c96-a72f-74195ef8b5be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:42:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-03166106-5b33-4ff0-aed8-20f0bfa354b6 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquired lock "refresh_cache-48774298-024b-4c96-a72f-74195ef8b5be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:42:34 user nova-compute[75071]: DEBUG nova.network.neutron [None req-03166106-5b33-4ff0-aed8-20f0bfa354b6 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:42:34 user nova-compute[75071]: DEBUG nova.network.neutron [None req-03166106-5b33-4ff0-aed8-20f0bfa354b6 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Updating instance_info_cache with network_info: [{"id": "0d784760-630f-44d4-8ad1-1d965951b90a", "address": "fa:16:3e:e2:66:18", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d784760-63", "ovs_interfaceid": "0d784760-630f-44d4-8ad1-1d965951b90a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:42:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-03166106-5b33-4ff0-aed8-20f0bfa354b6 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Releasing lock "refresh_cache-48774298-024b-4c96-a72f-74195ef8b5be" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:42:34 user nova-compute[75071]: DEBUG nova.objects.instance [None req-03166106-5b33-4ff0-aed8-20f0bfa354b6 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'flavor' on Instance uuid 48774298-024b-4c96-a72f-74195ef8b5be {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:42:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-b90dbdac-3196-4a99-b700-ff1b0ae4a0b7 req-2317032c-372e-46af-b8ee-2013a8a9903e service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received event network-vif-unplugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:42:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b90dbdac-3196-4a99-b700-ff1b0ae4a0b7 req-2317032c-372e-46af-b8ee-2013a8a9903e service nova] Acquiring lock "48774298-024b-4c96-a72f-74195ef8b5be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:42:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b90dbdac-3196-4a99-b700-ff1b0ae4a0b7 req-2317032c-372e-46af-b8ee-2013a8a9903e service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:42:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b90dbdac-3196-4a99-b700-ff1b0ae4a0b7 req-2317032c-372e-46af-b8ee-2013a8a9903e service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:42:35 user nova-compute[75071]: DEBUG nova.compute.manager [req-b90dbdac-3196-4a99-b700-ff1b0ae4a0b7 req-2317032c-372e-46af-b8ee-2013a8a9903e service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] No waiting events found dispatching network-vif-unplugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:42:35 user nova-compute[75071]: WARNING nova.compute.manager [req-b90dbdac-3196-4a99-b700-ff1b0ae4a0b7 req-2317032c-372e-46af-b8ee-2013a8a9903e service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received unexpected event network-vif-unplugged-0d784760-630f-44d4-8ad1-1d965951b90a for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:42:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:35 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Instance destroyed successfully.
Dec 05 12:42:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-96d2b9c5-9c0d-4625-96f4-c2142d0dd47e req-6de8068d-12cc-497b-81c7-04c8ec15c582 service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received event network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:42:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-96d2b9c5-9c0d-4625-96f4-c2142d0dd47e req-6de8068d-12cc-497b-81c7-04c8ec15c582 service nova] Acquiring lock "48774298-024b-4c96-a72f-74195ef8b5be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:42:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-96d2b9c5-9c0d-4625-96f4-c2142d0dd47e req-6de8068d-12cc-497b-81c7-04c8ec15c582 service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:42:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-96d2b9c5-9c0d-4625-96f4-c2142d0dd47e req-6de8068d-12cc-497b-81c7-04c8ec15c582 service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:42:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-96d2b9c5-9c0d-4625-96f4-c2142d0dd47e req-6de8068d-12cc-497b-81c7-04c8ec15c582 service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] No waiting events found dispatching network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:42:37 user nova-compute[75071]: WARNING nova.compute.manager [req-96d2b9c5-9c0d-4625-96f4-c2142d0dd47e req-6de8068d-12cc-497b-81c7-04c8ec15c582 service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received unexpected event network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:42:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-96d2b9c5-9c0d-4625-96f4-c2142d0dd47e req-6de8068d-12cc-497b-81c7-04c8ec15c582 service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received event network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:42:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-96d2b9c5-9c0d-4625-96f4-c2142d0dd47e req-6de8068d-12cc-497b-81c7-04c8ec15c582 service nova] Acquiring lock "48774298-024b-4c96-a72f-74195ef8b5be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:42:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-96d2b9c5-9c0d-4625-96f4-c2142d0dd47e req-6de8068d-12cc-497b-81c7-04c8ec15c582 service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:42:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-96d2b9c5-9c0d-4625-96f4-c2142d0dd47e req-6de8068d-12cc-497b-81c7-04c8ec15c582 service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:42:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-96d2b9c5-9c0d-4625-96f4-c2142d0dd47e req-6de8068d-12cc-497b-81c7-04c8ec15c582 service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] No waiting events found dispatching network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:42:37 user nova-compute[75071]: WARNING nova.compute.manager [req-96d2b9c5-9c0d-4625-96f4-c2142d0dd47e req-6de8068d-12cc-497b-81c7-04c8ec15c582 service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received unexpected event network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a for instance with vm_state rescued and task_state unrescuing.
Dec 05 12:42:39 user nova-compute[75071]: DEBUG nova.compute.manager [None req-03166106-5b33-4ff0-aed8-20f0bfa354b6 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:42:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-12d56795-b9b5-4b57-bab8-36f70ac1617c req-e062643d-e7ba-4bcf-8719-73865ea7a981 service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received event network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:42:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-12d56795-b9b5-4b57-bab8-36f70ac1617c req-e062643d-e7ba-4bcf-8719-73865ea7a981 service nova] Acquiring lock "48774298-024b-4c96-a72f-74195ef8b5be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:42:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-12d56795-b9b5-4b57-bab8-36f70ac1617c req-e062643d-e7ba-4bcf-8719-73865ea7a981 service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:42:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-12d56795-b9b5-4b57-bab8-36f70ac1617c req-e062643d-e7ba-4bcf-8719-73865ea7a981 service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:42:39 user nova-compute[75071]: DEBUG nova.compute.manager [req-12d56795-b9b5-4b57-bab8-36f70ac1617c req-e062643d-e7ba-4bcf-8719-73865ea7a981 service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] No waiting events found dispatching network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:42:39 user nova-compute[75071]: WARNING nova.compute.manager [req-12d56795-b9b5-4b57-bab8-36f70ac1617c req-e062643d-e7ba-4bcf-8719-73865ea7a981 service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received unexpected event network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a for instance with vm_state active and task_state None.
Dec 05 12:42:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fbSnCpcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:42:43 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:42:43 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:42:43 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[294f3eab-1be0-485f-a37a-d077f219f6cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:42:43 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1359b54-2614-4a55-b008-1ffbbe474647]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c] added
Dec 05 12:42:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[101c3af7-93e1-438e-a3a1-173d48870cd4]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[30df73e6-02f7-426a-8f75-d69d315a5b1a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fbSnCpcG {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fbSnCpcG" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edc8f8a-1d92-400d-83a8-8e1a3bd0257b]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fbSnCpcG'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d8756d-5e4d-4cd9-9f72-07d0805c0b15]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caafbfe-dc3e-4dc1-9ed1-c683153e4957]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:42:43 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:42:43 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:42:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:42:43 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:42:43 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:42:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2d1260-5ae0-42ff-9999-87f5bc4288e4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c, portal: 172.16.0.220,3260]
Dec 05 12:42:43 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c, portal: 172.16.0.220,3260] successful.
Dec 05 12:42:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad85f75-07cd-410d-a615-86b01893e781]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[16991651-7b78-4e8f-859d-ab21aff143f8]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:42:43 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:42:43 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:42:43 user nova-compute[75071]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c (non-flash)
Dec 05 12:42:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:42:43 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:42:43 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:42:43 user nova-compute[75071]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c (non-flash)
Dec 05 12:42:43 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1914d142-5b72-454f-912a-a5ac5ead2ee5]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:42:43 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fbSnCpcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:42:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:42:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23265653361386333', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:42:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265653361386333', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:42:44 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lazy-loading 'flavor' on Instance uuid 72bb9c85-25b6-4a08-96bf-59881754adea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:42:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:42:44 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:42:44 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Dec 05 12:42:44 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:42:44 user nova-compute[75071]:   <serial>0e65fff2-4d20-4174-a824-c59ecf5cfe8c</serial>
Dec 05 12:42:44 user nova-compute[75071]: </disk>
Dec 05 12:42:44 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:42:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:42:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:42:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] No VIF found with MAC fa:16:3e:b6:47:30, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:42:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2213f257-801b-4701-8ba7-0721140ae97a tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.728s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:42:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:42:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:42:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:42:46 user nova-compute[75071]: INFO nova.compute.manager [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Detaching volume 0e65fff2-4d20-4174-a824-c59ecf5cfe8c
Dec 05 12:42:46 user nova-compute[75071]: INFO nova.virt.block_device [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Attempting to driver detach volume 0e65fff2-4d20-4174-a824-c59ecf5cfe8c from mountpoint /dev/vdb
Dec 05 12:42:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Attempting to detach device vdb from instance 72bb9c85-25b6-4a08-96bf-59881754adea from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:42:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:42:46 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:42:46 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Dec 05 12:42:46 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:42:46 user nova-compute[75071]:   <serial>0e65fff2-4d20-4174-a824-c59ecf5cfe8c</serial>
Dec 05 12:42:46 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:42:46 user nova-compute[75071]: </disk>
Dec 05 12:42:46 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:42:46 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Successfully detached device vdb from instance 72bb9c85-25b6-4a08-96bf-59881754adea from the persistent domain config.
Dec 05 12:42:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72bb9c85-25b6-4a08-96bf-59881754adea from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:42:46 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:42:46 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:42:46 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Dec 05 12:42:46 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:42:46 user nova-compute[75071]:   <serial>0e65fff2-4d20-4174-a824-c59ecf5cfe8c</serial>
Dec 05 12:42:46 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:42:46 user nova-compute[75071]: </disk>
Dec 05 12:42:46 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:42:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72bb9c85-25b6-4a08-96bf-59881754adea {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:42:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:42:59 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:43:00 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:43:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:43:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:43:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:43:02 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:43:02 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:43:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:43:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:43:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:03 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:43:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:43:04 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:43:04 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:43:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:06 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:43:06 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:43:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8302MB free_disk=24.759357452392578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:43:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:43:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 42776e73-1ef0-4c57-a50a-942f6f4881de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:43:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9f492779-584e-4a21-9991-78de01f6670c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:43:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance f6b3497d-2998-48ba-9604-4332afa95c29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:43:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:43:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 48774298-024b-4c96-a72f-74195ef8b5be actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:43:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 72bb9c85-25b6-4a08-96bf-59881754adea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:43:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:43:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:43:06 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:43:06 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:43:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:43:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:07 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 72bb9c85-25b6-4a08-96bf-59881754adea is timed out.
Dec 05 12:43:07 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Successfully detached device vdb from instance 72bb9c85-25b6-4a08-96bf-59881754adea from the live domain config.
Dec 05 12:43:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fbSnCpcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:43:07 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d481d764-eabe-4a70-a014-de5273320540]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:43:07 user nova-compute[75071]: No targets found.
Dec 05 12:43:07 user nova-compute[75071]: iSNS:
Dec 05 12:43:07 user nova-compute[75071]: No targets found.
Dec 05 12:43:07 user nova-compute[75071]: STATIC:
Dec 05 12:43:07 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c
Dec 05 12:43:07 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:43:07 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:43:07 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c
Dec 05 12:43:07 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:43:07 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:43:07 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75
Dec 05 12:43:07 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:43:07 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:43:07 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6
Dec 05 12:43:07 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:43:07 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:43:07 user nova-compute[75071]: FIRMWARE:
Dec 05 12:43:07 user nova-compute[75071]: No targets found.
Dec 05 12:43:07 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:43:07 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:43:07 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5054b6-9394-49f8-b8b7-137851f7b053]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce90bef-1c2d-4d79-825f-54c6e6698769]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:43:07 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:43:07 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:43:07 user nova-compute[75071]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c (non-flash)
Dec 05 12:43:07 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:43:07 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:43:07 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:43:07 user nova-compute[75071]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c (non-flash)
Dec 05 12:43:07 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8240638af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c667ea-c566-4457-8514-18cdbb8cb0fe]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c2df07-790c-4f4c-b6dc-6a2112a3802b]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8453099-219d-4e02-9187-b5f295739a52]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[761d46a3-8434-40b6-b80d-cc047452e858]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c769b5-8186-4206-ba82-25f76d3edbe9]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f574d5d-e3f6-4622-849e-b353abba95fa]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c, portal: 172.16.0.220,3260]
Dec 05 12:43:07 user nova-compute[75071]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c, portal: 172.16.0.220,3260] successful.
Dec 05 12:43:07 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e65fff2-4d20-4174-a824-c59ecf5cfe8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d28859-a30e-4bc3-b27a-c5f4fa0ddc9a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] <== disconnect_volume: return (312ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:43:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:43:08 user nova-compute[75071]: DEBUG nova.objects.instance [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lazy-loading 'flavor' on Instance uuid 72bb9c85-25b6-4a08-96bf-59881754adea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:43:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-edf0ed83-f2e0-4382-ad03-abb26c89e727 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.761s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:09 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:43:09 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:43:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:43:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:43:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 12:43:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:43:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:43:11 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:43:11 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lazy-loading 'info_cache' on Instance uuid 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:43:12 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Updating instance_info_cache with network_info: [{"id": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "address": "fa:16:3e:ee:3d:ba", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfb6b0b-8b", "ovs_interfaceid": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:43:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:43:12 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:43:12 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:43:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:43:17 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:43:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 12:43:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 12:43:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:43:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:43:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 12:43:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:23 user nova-compute[75071]: INFO nova.compute.manager [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Detaching volume 56de68af-8509-405a-9b7d-cee36a223be6
Dec 05 12:43:23 user nova-compute[75071]: INFO nova.virt.block_device [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Attempting to driver detach volume 56de68af-8509-405a-9b7d-cee36a223be6 from mountpoint /dev/vdb
Dec 05 12:43:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Attempting to detach device vdb from instance 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:43:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:43:23 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:43:23 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Dec 05 12:43:23 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:43:23 user nova-compute[75071]:   <serial>56de68af-8509-405a-9b7d-cee36a223be6</serial>
Dec 05 12:43:23 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 12:43:23 user nova-compute[75071]: </disk>
Dec 05 12:43:23 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:43:23 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Successfully detached device vdb from instance 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf from the persistent domain config.
Dec 05 12:43:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:43:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:43:23 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:43:23 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Dec 05 12:43:23 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:43:23 user nova-compute[75071]:   <serial>56de68af-8509-405a-9b7d-cee36a223be6</serial>
Dec 05 12:43:23 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 05 12:43:23 user nova-compute[75071]: </disk>
Dec 05 12:43:23 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:43:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:43:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_power_states {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 42776e73-1ef0-4c57-a50a-942f6f4881de {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 9f492779-584e-4a21-9991-78de01f6670c {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid f6b3497d-2998-48ba-9604-4332afa95c29 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 48774298-024b-4c96-a72f-74195ef8b5be {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 72bb9c85-25b6-4a08-96bf-59881754adea {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "42776e73-1ef0-4c57-a50a-942f6f4881de" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "9f492779-584e-4a21-9991-78de01f6670c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "9f492779-584e-4a21-9991-78de01f6670c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "f6b3497d-2998-48ba-9604-4332afa95c29" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "f6b3497d-2998-48ba-9604-4332afa95c29" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "48774298-024b-4c96-a72f-74195ef8b5be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "48774298-024b-4c96-a72f-74195ef8b5be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "9f492779-584e-4a21-9991-78de01f6670c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "f6b3497d-2998-48ba-9604-4332afa95c29" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "48774298-024b-4c96-a72f-74195ef8b5be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:39 user nova-compute[75071]: DEBUG nova.objects.instance [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lazy-loading 'flavor' on Instance uuid 72bb9c85-25b6-4a08-96bf-59881754adea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:43:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:39 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:39 user nova-compute[75071]: INFO nova.compute.manager [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Attaching volume 9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b to /dev/vdb
Dec 05 12:43:39 user nova-compute[75071]: DEBUG os_brick.utils [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:43:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c8a3df-7794-4700-bbab-51009438b6ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:39 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[459fdb32-9a97-490f-981b-ce6b986d6abf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:39 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f49b0f-9cb7-4bbd-a871-1f4374fdef13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd6ce5c-1015-418a-9f28-26a3c7daaf78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:43:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:43:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:43:40 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:43:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea9c6c6-940a-4e89-b8b4-d1ce269b05d9]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:43:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:43:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:43:40 user nova-compute[75071]: DEBUG os_brick.utils [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:43:40 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Updating existing volume attachment record: b8a6a840-4cc8-4632-98fa-7b272376c468 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:43:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Acquiring lock "52ff4123-828f-43d1-b152-e791c5246fa8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "52ff4123-828f-43d1-b152-e791c5246fa8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:43:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:41 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:43:41 user nova-compute[75071]: INFO nova.compute.claims [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Claim successful on node user
Dec 05 12:43:41 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:43:41 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:43:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:43:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:43:41 user nova-compute[75071]: DEBUG nova.network.neutron [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:43:41 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:43:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:43:41 user nova-compute[75071]: DEBUG nova.policy [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '62aa364a59b14c97a8ef58a1e019b496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0a80672aa2240ac92bd2778cf23dcac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:43:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:43:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:43:41 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Creating image(s)
Dec 05 12:43:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Acquiring lock "/opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "/opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "/opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk 1073741824" returned: 0 in 0.053s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG nova.network.neutron [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Successfully created port: 78015c9f-5f8c-48f1-bba3-4159569e0613 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Cannot resize image /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Ensure instance console log exists: /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.network.neutron [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Successfully updated port: 78015c9f-5f8c-48f1-bba3-4159569e0613 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Acquiring lock "refresh_cache-52ff4123-828f-43d1-b152-e791c5246fa8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Acquired lock "refresh_cache-52ff4123-828f-43d1-b152-e791c5246fa8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.network.neutron [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.network.neutron [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-a340393e-d050-4a8a-8f00-ecfcfac040c8 req-b7df9229-392c-4ad7-a073-e01793ceca86 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Received event network-changed-78015c9f-5f8c-48f1-bba3-4159569e0613 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-a340393e-d050-4a8a-8f00-ecfcfac040c8 req-b7df9229-392c-4ad7-a073-e01793ceca86 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Refreshing instance network info cache due to event network-changed-78015c9f-5f8c-48f1-bba3-4159569e0613. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a340393e-d050-4a8a-8f00-ecfcfac040c8 req-b7df9229-392c-4ad7-a073-e01793ceca86 service nova] Acquiring lock "refresh_cache-52ff4123-828f-43d1-b152-e791c5246fa8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.network.neutron [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Updating instance_info_cache with network_info: [{"id": "78015c9f-5f8c-48f1-bba3-4159569e0613", "address": "fa:16:3e:30:43:31", "network": {"id": "f55368ee-ff6e-48a6-8464-24657f475faf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-806121992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a80672aa2240ac92bd2778cf23dcac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78015c9f-5f", "ovs_interfaceid": "78015c9f-5f8c-48f1-bba3-4159569e0613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Releasing lock "refresh_cache-52ff4123-828f-43d1-b152-e791c5246fa8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Instance network_info: |[{"id": "78015c9f-5f8c-48f1-bba3-4159569e0613", "address": "fa:16:3e:30:43:31", "network": {"id": "f55368ee-ff6e-48a6-8464-24657f475faf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-806121992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a80672aa2240ac92bd2778cf23dcac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78015c9f-5f", "ovs_interfaceid": "78015c9f-5f8c-48f1-bba3-4159569e0613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a340393e-d050-4a8a-8f00-ecfcfac040c8 req-b7df9229-392c-4ad7-a073-e01793ceca86 service nova] Acquired lock "refresh_cache-52ff4123-828f-43d1-b152-e791c5246fa8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.network.neutron [req-a340393e-d050-4a8a-8f00-ecfcfac040c8 req-b7df9229-392c-4ad7-a073-e01793ceca86 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Refreshing network info cache for port 78015c9f-5f8c-48f1-bba3-4159569e0613 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Start _get_guest_xml network_info=[{"id": "78015c9f-5f8c-48f1-bba3-4159569e0613", "address": "fa:16:3e:30:43:31", "network": {"id": "f55368ee-ff6e-48a6-8464-24657f475faf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-806121992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a80672aa2240ac92bd2778cf23dcac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78015c9f-5f", "ovs_interfaceid": "78015c9f-5f8c-48f1-bba3-4159569e0613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:43:43 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:43:43 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-766389935',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-766389935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7663899',id=43,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVDE7Oi95BSa3dALH8Hcq9jf1c8hL0zu6uQpPOehyPM8f45LnY9+GyRcH9iG8KSLx/2SYNDSlrWPk351ZUAaHCoR0h9JhjPpUy+HNXpNGXOKBml74MdNP7BqH4NOQM69A==',key_name='tempest-keypair-1431934925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0a80672aa2240ac92bd2778cf23dcac',ramdisk_id='',reservation_id='r-fui1sy8l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1284190924',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:43:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62aa364a59b14c97a8ef58a1e019b496',uuid=52ff4123-828f-43d1-b152-e791c5246fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78015c9f-5f8c-48f1-bba3-4159569e0613", "address": "fa:16:3e:30:43:31", "network": {"id": "f55368ee-ff6e-48a6-8464-24657f475faf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-806121992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a80672aa2240ac92bd2778cf23dcac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78015c9f-5f", "ovs_interfaceid": "78015c9f-5f8c-48f1-bba3-4159569e0613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Converting VIF {"id": "78015c9f-5f8c-48f1-bba3-4159569e0613", "address": "fa:16:3e:30:43:31", "network": {"id": "f55368ee-ff6e-48a6-8464-24657f475faf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-806121992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a80672aa2240ac92bd2778cf23dcac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78015c9f-5f", "ovs_interfaceid": "78015c9f-5f8c-48f1-bba3-4159569e0613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:43:31,bridge_name='br-int',has_traffic_filtering=True,id=78015c9f-5f8c-48f1-bba3-4159569e0613,network=Network(f55368ee-ff6e-48a6-8464-24657f475faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78015c9f-5f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.objects.instance [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lazy-loading 'pci_devices' on Instance uuid 52ff4123-828f-43d1-b152-e791c5246fa8 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:43:43 user nova-compute[75071]:   <uuid>52ff4123-828f-43d1-b152-e791c5246fa8</uuid>
Dec 05 12:43:43 user nova-compute[75071]:   <name>instance-0000002b</name>
Dec 05 12:43:43 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:43:43 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:43:43 user nova-compute[75071]:   <metadata>
Dec 05 12:43:43 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:43:43 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:43:43 user nova-compute[75071]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-766389935</nova:name>
Dec 05 12:43:43 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:43:43</nova:creationTime>
Dec 05 12:43:43 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:43:43 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:43:43 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:43:43 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:43:43 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:43:43 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:43:43 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:43:43 user nova-compute[75071]:       <nova:owner>
Dec 05 12:43:43 user nova-compute[75071]:         <nova:user uuid="62aa364a59b14c97a8ef58a1e019b496">tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member</nova:user>
Dec 05 12:43:43 user nova-compute[75071]:         <nova:project uuid="e0a80672aa2240ac92bd2778cf23dcac">tempest-TestServerVolumeAttachScenarioOldVersion-1284190924</nova:project>
Dec 05 12:43:43 user nova-compute[75071]:       </nova:owner>
Dec 05 12:43:43 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:43:43 user nova-compute[75071]:       <nova:ports>
Dec 05 12:43:43 user nova-compute[75071]:         <nova:port uuid="78015c9f-5f8c-48f1-bba3-4159569e0613">
Dec 05 12:43:43 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 05 12:43:43 user nova-compute[75071]:         </nova:port>
Dec 05 12:43:43 user nova-compute[75071]:       </nova:ports>
Dec 05 12:43:43 user nova-compute[75071]:     </nova:instance>
Dec 05 12:43:43 user nova-compute[75071]:   </metadata>
Dec 05 12:43:43 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:43:43 user nova-compute[75071]:     <system>
Dec 05 12:43:43 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:43:43 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:43:43 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:43:43 user nova-compute[75071]:       <entry name="serial">52ff4123-828f-43d1-b152-e791c5246fa8</entry>
Dec 05 12:43:43 user nova-compute[75071]:       <entry name="uuid">52ff4123-828f-43d1-b152-e791c5246fa8</entry>
Dec 05 12:43:43 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:43:43 user nova-compute[75071]:     </system>
Dec 05 12:43:43 user nova-compute[75071]:   </sysinfo>
Dec 05 12:43:43 user nova-compute[75071]:   <os>
Dec 05 12:43:43 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:43:43 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:43:43 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:43:43 user nova-compute[75071]:   </os>
Dec 05 12:43:43 user nova-compute[75071]:   <features>
Dec 05 12:43:43 user nova-compute[75071]:     <acpi/>
Dec 05 12:43:43 user nova-compute[75071]:     <apic/>
Dec 05 12:43:43 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:43:43 user nova-compute[75071]:   </features>
Dec 05 12:43:43 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:43:43 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:43:43 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:43:43 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:43:43 user nova-compute[75071]:   </clock>
Dec 05 12:43:43 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:43:43 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:43:43 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:43:43 user nova-compute[75071]:   </cpu>
Dec 05 12:43:43 user nova-compute[75071]:   <devices>
Dec 05 12:43:43 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:43:43 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:43:43 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk"/>
Dec 05 12:43:43 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:43:43 user nova-compute[75071]:     </disk>
Dec 05 12:43:43 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:43:43 user nova-compute[75071]:       <mac address="fa:16:3e:30:43:31"/>
Dec 05 12:43:43 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:43:43 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:43:43 user nova-compute[75071]:       <target dev="tap78015c9f-5f"/>
Dec 05 12:43:43 user nova-compute[75071]:     </interface>
Dec 05 12:43:43 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:43:43 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/console.log" append="off"/>
Dec 05 12:43:43 user nova-compute[75071]:     </serial>
Dec 05 12:43:43 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:43:43 user nova-compute[75071]:     <video>
Dec 05 12:43:43 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:43:43 user nova-compute[75071]:     </video>
Dec 05 12:43:43 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:43:43 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:43:43 user nova-compute[75071]:     </rng>
Dec 05 12:43:43 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:43:43 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:43:43 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:43:43 user nova-compute[75071]:     </memballoon>
Dec 05 12:43:43 user nova-compute[75071]:   </devices>
Dec 05 12:43:43 user nova-compute[75071]: </domain>
Dec 05 12:43:43 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-766389935',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-766389935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7663899',id=43,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVDE7Oi95BSa3dALH8Hcq9jf1c8hL0zu6uQpPOehyPM8f45LnY9+GyRcH9iG8KSLx/2SYNDSlrWPk351ZUAaHCoR0h9JhjPpUy+HNXpNGXOKBml74MdNP7BqH4NOQM69A==',key_name='tempest-keypair-1431934925',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0a80672aa2240ac92bd2778cf23dcac',ramdisk_id='',reservation_id='r-fui1sy8l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1284190924',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:43:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62aa364a59b14c97a8ef58a1e019b496',uuid=52ff4123-828f-43d1-b152-e791c5246fa8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78015c9f-5f8c-48f1-bba3-4159569e0613", "address": "fa:16:3e:30:43:31", "network": {"id": "f55368ee-ff6e-48a6-8464-24657f475faf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-806121992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a80672aa2240ac92bd2778cf23dcac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78015c9f-5f", "ovs_interfaceid": "78015c9f-5f8c-48f1-bba3-4159569e0613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Converting VIF {"id": "78015c9f-5f8c-48f1-bba3-4159569e0613", "address": "fa:16:3e:30:43:31", "network": {"id": "f55368ee-ff6e-48a6-8464-24657f475faf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-806121992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a80672aa2240ac92bd2778cf23dcac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78015c9f-5f", "ovs_interfaceid": "78015c9f-5f8c-48f1-bba3-4159569e0613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:43:31,bridge_name='br-int',has_traffic_filtering=True,id=78015c9f-5f8c-48f1-bba3-4159569e0613,network=Network(f55368ee-ff6e-48a6-8464-24657f475faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78015c9f-5f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG os_vif [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:43:31,bridge_name='br-int',has_traffic_filtering=True,id=78015c9f-5f8c-48f1-bba3-4159569e0613,network=Network(f55368ee-ff6e-48a6-8464-24657f475faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78015c9f-5f') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '451461ea-863b-5bd4-8861-5f5d61ba4575', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78015c9f-5f, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78015c9f-5f, col_values=(('qos', UUID('9edccd9f-9985-4fc1-a236-eb45e7a52ae0')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78015c9f-5f, col_values=(('external_ids', {'iface-id': '78015c9f-5f8c-48f1-bba3-4159569e0613', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:43:31', 'vm-uuid': '52ff4123-828f-43d1-b152-e791c5246fa8'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:43 user nova-compute[75071]: INFO os_vif [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:43:31,bridge_name='br-int',has_traffic_filtering=True,id=78015c9f-5f8c-48f1-bba3-4159569e0613,network=Network(f55368ee-ff6e-48a6-8464-24657f475faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78015c9f-5f')
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] No VIF found with MAC fa:16:3e:30:43:31, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.network.neutron [req-a340393e-d050-4a8a-8f00-ecfcfac040c8 req-b7df9229-392c-4ad7-a073-e01793ceca86 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Updated VIF entry in instance network info cache for port 78015c9f-5f8c-48f1-bba3-4159569e0613. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG nova.network.neutron [req-a340393e-d050-4a8a-8f00-ecfcfac040c8 req-b7df9229-392c-4ad7-a073-e01793ceca86 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Updating instance_info_cache with network_info: [{"id": "78015c9f-5f8c-48f1-bba3-4159569e0613", "address": "fa:16:3e:30:43:31", "network": {"id": "f55368ee-ff6e-48a6-8464-24657f475faf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-806121992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a80672aa2240ac92bd2778cf23dcac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78015c9f-5f", "ovs_interfaceid": "78015c9f-5f8c-48f1-bba3-4159569e0613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:43:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a340393e-d050-4a8a-8f00-ecfcfac040c8 req-b7df9229-392c-4ad7-a073-e01793ceca86 service nova] Releasing lock "refresh_cache-52ff4123-828f-43d1-b152-e791c5246fa8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:43:44 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf is timed out.
Dec 05 12:43:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:44 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Successfully detached device vdb from instance 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf from the live domain config.
Dec 05 12:43:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'INcfTbng', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:43:44 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a41aecc-4b48-45d7-a467-6cf05cf479ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:43:44 user nova-compute[75071]: No targets found.
Dec 05 12:43:44 user nova-compute[75071]: iSNS:
Dec 05 12:43:44 user nova-compute[75071]: No targets found.
Dec 05 12:43:44 user nova-compute[75071]: STATIC:
Dec 05 12:43:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c
Dec 05 12:43:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:43:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:43:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75
Dec 05 12:43:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:43:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:43:44 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6
Dec 05 12:43:44 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:43:44 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:43:44 user nova-compute[75071]: FIRMWARE:
Dec 05 12:43:44 user nova-compute[75071]: No targets found.
Dec 05 12:43:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:43:44 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:43:44 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5198953-dc2f-410c-9f88-969416d776b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3365d651-a5f4-4e4b-afa2-2138cf8b6267]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:43:44 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:43:44 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:43:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:43:44 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:43:44 user nova-compute[75071]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 (non-flash)
Dec 05 12:43:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f826413b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6'): ({'sdd'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Removing single pathed devices sdd {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf07803-9510-4bc7-a3d2-9e2609ed0998]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb580572-9081-40cd-81e5-05c9538cad58]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Flushing IO for device /dev/sdd {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7cfae3-cac8-4c8a-b932-d25ac8acb6ce]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[012b4dd9-f99f-45af-8b7c-fc2acbe54b3a]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e92e1e-c394-400c-a161-b1e10848733f]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b496ab9-2275-4752-b08f-59dcc8bbd504]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6, portal: 172.16.0.220,3260]
Dec 05 12:43:44 user nova-compute[75071]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6, portal: 172.16.0.220,3260] successful.
Dec 05 12:43:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56de68af-8509-405a-9b7d-cee36a223be6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fe77f9-5e08-402b-a514-18a036f33afa]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] <== disconnect_volume: return (311ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:43:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-65536dcc-5359-49ab-9fdb-1c803529bf9e req-7e5527ca-7e1e-448d-9626-2713627c5491 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Received event network-vif-plugged-78015c9f-5f8c-48f1-bba3-4159569e0613 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:43:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-65536dcc-5359-49ab-9fdb-1c803529bf9e req-7e5527ca-7e1e-448d-9626-2713627c5491 service nova] Acquiring lock "52ff4123-828f-43d1-b152-e791c5246fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-65536dcc-5359-49ab-9fdb-1c803529bf9e req-7e5527ca-7e1e-448d-9626-2713627c5491 service nova] Lock "52ff4123-828f-43d1-b152-e791c5246fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-65536dcc-5359-49ab-9fdb-1c803529bf9e req-7e5527ca-7e1e-448d-9626-2713627c5491 service nova] Lock "52ff4123-828f-43d1-b152-e791c5246fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:45 user nova-compute[75071]: DEBUG nova.compute.manager [req-65536dcc-5359-49ab-9fdb-1c803529bf9e req-7e5527ca-7e1e-448d-9626-2713627c5491 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] No waiting events found dispatching network-vif-plugged-78015c9f-5f8c-48f1-bba3-4159569e0613 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:43:45 user nova-compute[75071]: WARNING nova.compute.manager [req-65536dcc-5359-49ab-9fdb-1c803529bf9e req-7e5527ca-7e1e-448d-9626-2713627c5491 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Received unexpected event network-vif-plugged-78015c9f-5f8c-48f1-bba3-4159569e0613 for instance with vm_state building and task_state spawning.
Dec 05 12:43:45 user nova-compute[75071]: DEBUG nova.objects.instance [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'flavor' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:43:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-fbdf4376-8727-4958-aa47-64c19ecc5b93 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.854s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.634s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:45 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-02320253-c5df-43d9-83f8-c8093d69f7ca tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-02320253-c5df-43d9-83f8-c8093d69f7ca tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-02320253-c5df-43d9-83f8-c8093d69f7ca tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:43:46 user nova-compute[75071]: DEBUG nova.compute.manager [None req-02320253-c5df-43d9-83f8-c8093d69f7ca tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75071) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Dec 05 12:43:46 user nova-compute[75071]: DEBUG nova.objects.instance [None req-02320253-c5df-43d9-83f8-c8093d69f7ca tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'flavor' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:43:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-cab2a15a-32d9-44bc-84fd-cd0b82b70f68 req-cb3cbcd9-c766-421f-9653-5de7148cdab0 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received event network-vif-unplugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:43:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cab2a15a-32d9-44bc-84fd-cd0b82b70f68 req-cb3cbcd9-c766-421f-9653-5de7148cdab0 service nova] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cab2a15a-32d9-44bc-84fd-cd0b82b70f68 req-cb3cbcd9-c766-421f-9653-5de7148cdab0 service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cab2a15a-32d9-44bc-84fd-cd0b82b70f68 req-cb3cbcd9-c766-421f-9653-5de7148cdab0 service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-cab2a15a-32d9-44bc-84fd-cd0b82b70f68 req-cb3cbcd9-c766-421f-9653-5de7148cdab0 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] No waiting events found dispatching network-vif-unplugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:43:46 user nova-compute[75071]: WARNING nova.compute.manager [req-cab2a15a-32d9-44bc-84fd-cd0b82b70f68 req-cb3cbcd9-c766-421f-9653-5de7148cdab0 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received unexpected event network-vif-unplugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 for instance with vm_state active and task_state powering-off.
Dec 05 12:43:47 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:43:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:43:47 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Instance spawned successfully.
Dec 05 12:43:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:43:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:43:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:43:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:43:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:43:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:43:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:43:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-8d92a605-f0d4-4774-be18-56c09594bdcd req-1bfc0393-fc89-4b85-864d-ce4d58086f25 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Received event network-vif-plugged-78015c9f-5f8c-48f1-bba3-4159569e0613 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:43:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8d92a605-f0d4-4774-be18-56c09594bdcd req-1bfc0393-fc89-4b85-864d-ce4d58086f25 service nova] Acquiring lock "52ff4123-828f-43d1-b152-e791c5246fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8d92a605-f0d4-4774-be18-56c09594bdcd req-1bfc0393-fc89-4b85-864d-ce4d58086f25 service nova] Lock "52ff4123-828f-43d1-b152-e791c5246fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8d92a605-f0d4-4774-be18-56c09594bdcd req-1bfc0393-fc89-4b85-864d-ce4d58086f25 service nova] Lock "52ff4123-828f-43d1-b152-e791c5246fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-8d92a605-f0d4-4774-be18-56c09594bdcd req-1bfc0393-fc89-4b85-864d-ce4d58086f25 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] No waiting events found dispatching network-vif-plugged-78015c9f-5f8c-48f1-bba3-4159569e0613 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:43:47 user nova-compute[75071]: WARNING nova.compute.manager [req-8d92a605-f0d4-4774-be18-56c09594bdcd req-1bfc0393-fc89-4b85-864d-ce4d58086f25 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Received unexpected event network-vif-plugged-78015c9f-5f8c-48f1-bba3-4159569e0613 for instance with vm_state building and task_state spawning.
Dec 05 12:43:47 user nova-compute[75071]: INFO nova.compute.manager [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Took 5.46 seconds to spawn the instance on the hypervisor.
Dec 05 12:43:47 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:43:47 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Instance destroyed successfully.
Dec 05 12:43:47 user nova-compute[75071]: DEBUG nova.compute.manager [None req-02320253-c5df-43d9-83f8-c8093d69f7ca tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:43:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-02320253-c5df-43d9-83f8-c8093d69f7ca tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.878s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:47 user nova-compute[75071]: INFO nova.compute.manager [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Took 6.16 seconds to build instance.
Dec 05 12:43:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7ea4f597-93ed-418c-ac78-726e519f5c3e tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "52ff4123-828f-43d1-b152-e791c5246fa8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.265s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-be67ffa0-8b1e-4519-80fe-dbd526966b63 req-c1ddb098-6f4a-43b2-b0c3-8be471bf6a74 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received event network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:43:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-be67ffa0-8b1e-4519-80fe-dbd526966b63 req-c1ddb098-6f4a-43b2-b0c3-8be471bf6a74 service nova] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-be67ffa0-8b1e-4519-80fe-dbd526966b63 req-c1ddb098-6f4a-43b2-b0c3-8be471bf6a74 service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-be67ffa0-8b1e-4519-80fe-dbd526966b63 req-c1ddb098-6f4a-43b2-b0c3-8be471bf6a74 service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-be67ffa0-8b1e-4519-80fe-dbd526966b63 req-c1ddb098-6f4a-43b2-b0c3-8be471bf6a74 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] No waiting events found dispatching network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:43:48 user nova-compute[75071]: WARNING nova.compute.manager [req-be67ffa0-8b1e-4519-80fe-dbd526966b63 req-c1ddb098-6f4a-43b2-b0c3-8be471bf6a74 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received unexpected event network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 for instance with vm_state stopped and task_state None.
Dec 05 12:43:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJcxTYqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:43:49 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:43:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:43:49 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:43:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:43:49 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d5fda0-34fc-4970-bd8e-28d1fb3c50f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:43:49 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[13be6116-1ecb-4e52-b522-9e2db61f767b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b] added
Dec 05 12:43:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e91a0c-e58e-4d71-abb7-e0d1f489a4da]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a278025-e902-4dd9-80c0-ac551d7905f0]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJcxTYqN {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QJcxTYqN" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[03958992-5a6c-476a-af76-e16db7f62221]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QJcxTYqN'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[797ae78f-a648-4c15-85cc-6798fc294069]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4f0bda-293c-4ed3-8eae-f124b5bbc665]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:43:49 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:43:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:43:49 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:43:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[010eedd8-127e-4800-ad7d-795bae813105]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b, portal: 172.16.0.220,3260]
Dec 05 12:43:49 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b, portal: 172.16.0.220,3260] successful.
Dec 05 12:43:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd941788-f975-42f8-938a-aa437e1854a3]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:43:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89cb63f-e5ec-497e-bc92-2e7dc0822956]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:43:50 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:43:50 user nova-compute[75071]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b (non-flash)
Dec 05 12:43:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:43:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:43:50 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:43:50 user nova-compute[75071]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b (non-flash)
Dec 05 12:43:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:43:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:43:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:43:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:43:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:43:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:43:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:43:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e957ca-87a0-443d-8c32-0cc689ae23bc]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:43:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:43:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJcxTYqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:43:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:43:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23633633838366166', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:43:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633633838366166', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:43:51 user nova-compute[75071]: DEBUG nova.objects.instance [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lazy-loading 'flavor' on Instance uuid 72bb9c85-25b6-4a08-96bf-59881754adea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:43:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:43:51 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:43:51 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Dec 05 12:43:51 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:43:51 user nova-compute[75071]:   <serial>9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b</serial>
Dec 05 12:43:51 user nova-compute[75071]: </disk>
Dec 05 12:43:51 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:43:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:43:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:43:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] No VIF found with MAC fa:16:3e:b6:47:30, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:43:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-3e7f6bfd-a921-482a-8627-9424f5276069 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.738s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:43:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:43:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:43:53 user nova-compute[75071]: INFO nova.compute.manager [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Detaching volume 9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b
Dec 05 12:43:53 user nova-compute[75071]: INFO nova.virt.block_device [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Attempting to driver detach volume 9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b from mountpoint /dev/vdb
Dec 05 12:43:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Attempting to detach device vdb from instance 72bb9c85-25b6-4a08-96bf-59881754adea from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:43:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:43:53 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:43:53 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Dec 05 12:43:53 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:43:53 user nova-compute[75071]:   <serial>9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b</serial>
Dec 05 12:43:53 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:43:53 user nova-compute[75071]: </disk>
Dec 05 12:43:53 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:43:53 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Successfully detached device vdb from instance 72bb9c85-25b6-4a08-96bf-59881754adea from the persistent domain config.
Dec 05 12:43:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72bb9c85-25b6-4a08-96bf-59881754adea from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:43:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:43:53 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:43:53 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Dec 05 12:43:53 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:43:53 user nova-compute[75071]:   <serial>9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b</serial>
Dec 05 12:43:53 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:43:53 user nova-compute[75071]: </disk>
Dec 05 12:43:53 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:43:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:53 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72bb9c85-25b6-4a08-96bf-59881754adea {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:43:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:43:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:00 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:44:02 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:44:02 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:44:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:44:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:44:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:44:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:44:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:44:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:44:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:44:05 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:44:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:44:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:44:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:08 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:44:08 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:44:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8204MB free_disk=24.729084014892578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:44:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:44:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:44:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:44:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 42776e73-1ef0-4c57-a50a-942f6f4881de actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:44:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9f492779-584e-4a21-9991-78de01f6670c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:44:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance f6b3497d-2998-48ba-9604-4332afa95c29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:44:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:44:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 48774298-024b-4c96-a72f-74195ef8b5be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:44:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 72bb9c85-25b6-4a08-96bf-59881754adea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:44:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 52ff4123-828f-43d1-b152-e791c5246fa8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:44:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:44:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:44:08 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Refreshing inventories for resource provider 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 12:44:08 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Updating ProviderTree inventory for provider 25beb694-9dd7-475f-9657-74a5f0368417 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 12:44:08 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Updating inventory in ProviderTree for provider 25beb694-9dd7-475f-9657-74a5f0368417 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 12:44:08 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Refreshing aggregate associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 12:44:08 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Refreshing trait associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 12:44:09 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:44:09 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:44:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:44:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:44:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:12 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:44:12 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-42776e73-1ef0-4c57-a50a-942f6f4881de" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-42776e73-1ef0-4c57-a50a-942f6f4881de" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:44:13 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 72bb9c85-25b6-4a08-96bf-59881754adea is timed out.
Dec 05 12:44:13 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Successfully detached device vdb from instance 72bb9c85-25b6-4a08-96bf-59881754adea from the live domain config.
Dec 05 12:44:13 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QJcxTYqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:44:13 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:44:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adfa3be-5fac-4a77-8f60-728fe3d55e1c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:44:13 user nova-compute[75071]: No targets found.
Dec 05 12:44:13 user nova-compute[75071]: iSNS:
Dec 05 12:44:13 user nova-compute[75071]: No targets found.
Dec 05 12:44:13 user nova-compute[75071]: STATIC:
Dec 05 12:44:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c
Dec 05 12:44:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:44:13 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:44:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b
Dec 05 12:44:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:44:13 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:44:13 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75
Dec 05 12:44:13 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:44:13 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:44:13 user nova-compute[75071]: FIRMWARE:
Dec 05 12:44:13 user nova-compute[75071]: No targets found.
Dec 05 12:44:13 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:44:13 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:44:13 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3438a3f-1b3d-4947-8c27-1a0697770faa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[429c23a4-03ae-40cb-ae69-8c9f76941c1a]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:44:13 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:44:13 user nova-compute[75071]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b (non-flash)
Dec 05 12:44:13 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:44:13 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:44:13 user nova-compute[75071]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b (non-flash)
Dec 05 12:44:13 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8240679990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3092245f-4ec8-495e-aefc-7c203fd5747c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad06fd43-9f35-4307-8303-04579b86ca3d]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c773792-0943-4ea2-a0e0-82c89596f4c6]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[59036d26-262a-49b2-ac48-1f9d36cf6423]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7103b55f-0bd8-4d62-b6ab-b82a29341b60]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:44:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[587e4b1d-e472-468c-b123-5cb4241f4c2f]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b, portal: 172.16.0.220,3260]
Dec 05 12:44:14 user nova-compute[75071]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b, portal: 172.16.0.220,3260] successful.
Dec 05 12:44:14 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:44:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e3ad4ec-3ae3-4b23-a4bf-f76b8393df0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:14 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[99728eb0-5ee2-4d8e-8647-dded1369b9e3]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:44:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:44:14 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] <== disconnect_volume: return (300ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:44:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:44:14 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Updating instance_info_cache with network_info: [{"id": "3774446d-0014-4060-b722-f3480e92a274", "address": "fa:16:3e:c9:ac:48", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3774446d-00", "ovs_interfaceid": "3774446d-0014-4060-b722-f3480e92a274", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:44:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-42776e73-1ef0-4c57-a50a-942f6f4881de" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:44:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:44:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:15 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lazy-loading 'flavor' on Instance uuid 72bb9c85-25b6-4a08-96bf-59881754adea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:44:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f1341722-0564-4747-9637-10326952480f tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.829s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:44:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "48774298-024b-4c96-a72f-74195ef8b5be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:44:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "48774298-024b-4c96-a72f-74195ef8b5be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:44:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "48774298-024b-4c96-a72f-74195ef8b5be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:44:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:44:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:44:25 user nova-compute[75071]: INFO nova.compute.manager [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Terminating instance
Dec 05 12:44:25 user nova-compute[75071]: DEBUG nova.compute.manager [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:44:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-866f8e16-45b0-4430-a2f0-b2e05fb13d66 req-756ccb7e-0858-4152-b828-984863d6742f service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received event network-vif-unplugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-866f8e16-45b0-4430-a2f0-b2e05fb13d66 req-756ccb7e-0858-4152-b828-984863d6742f service nova] Acquiring lock "48774298-024b-4c96-a72f-74195ef8b5be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-866f8e16-45b0-4430-a2f0-b2e05fb13d66 req-756ccb7e-0858-4152-b828-984863d6742f service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-866f8e16-45b0-4430-a2f0-b2e05fb13d66 req-756ccb7e-0858-4152-b828-984863d6742f service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-866f8e16-45b0-4430-a2f0-b2e05fb13d66 req-756ccb7e-0858-4152-b828-984863d6742f service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] No waiting events found dispatching network-vif-unplugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-866f8e16-45b0-4430-a2f0-b2e05fb13d66 req-756ccb7e-0858-4152-b828-984863d6742f service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received event network-vif-unplugged-0d784760-630f-44d4-8ad1-1d965951b90a for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:26 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Instance destroyed successfully.
Dec 05 12:44:26 user nova-compute[75071]: DEBUG nova.objects.instance [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'resources' on Instance uuid 48774298-024b-4c96-a72f-74195ef8b5be {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:38:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1043281140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1043281140',id=41,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:40:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b77a4b1baadd43e1be69eecb1f5370bd',ramdisk_id='',reservation_id='r-r39akty7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86909184',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:42:39Z,user_data=None,user_id='201cbbb8b3dc4a3aa8164d69c1257489',uuid=48774298-024b-4c96-a72f-74195ef8b5be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d784760-630f-44d4-8ad1-1d965951b90a", "address": "fa:16:3e:e2:66:18", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d784760-63", "ovs_interfaceid": "0d784760-630f-44d4-8ad1-1d965951b90a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converting VIF {"id": "0d784760-630f-44d4-8ad1-1d965951b90a", "address": "fa:16:3e:e2:66:18", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d784760-63", "ovs_interfaceid": "0d784760-630f-44d4-8ad1-1d965951b90a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:66:18,bridge_name='br-int',has_traffic_filtering=True,id=0d784760-630f-44d4-8ad1-1d965951b90a,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d784760-63') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_vif [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:66:18,bridge_name='br-int',has_traffic_filtering=True,id=0d784760-630f-44d4-8ad1-1d965951b90a,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d784760-63') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d784760-63, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3516507e-f2d6-4866-926f-c1fd2de62c31) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:26 user nova-compute[75071]: INFO os_vif [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:66:18,bridge_name='br-int',has_traffic_filtering=True,id=0d784760-630f-44d4-8ad1-1d965951b90a,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d784760-63')
Dec 05 12:44:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HvTCSUVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:44:26 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3ef615-488f-48b8-977c-139ac3e0d54c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:44:26 user nova-compute[75071]: No targets found.
Dec 05 12:44:26 user nova-compute[75071]: iSNS:
Dec 05 12:44:26 user nova-compute[75071]: No targets found.
Dec 05 12:44:26 user nova-compute[75071]: STATIC:
Dec 05 12:44:26 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c
Dec 05 12:44:26 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:44:26 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:44:26 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75
Dec 05 12:44:26 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:44:26 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:44:26 user nova-compute[75071]: FIRMWARE:
Dec 05 12:44:26 user nova-compute[75071]: No targets found.
Dec 05 12:44:26 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:44:26 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:44:26 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b068ffcc-cde0-4412-8d89-af6097bfb37a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb96ef4-bf46-41c1-bd21-b1a1a86f5083]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:44:26 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:44:26 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:44:26 user nova-compute[75071]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 (non-flash)
Dec 05 12:44:26 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82643769e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64e5b00-4051-4c5c-9e3c-668ebc6c3fa9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c937f54b-da0f-4f18-827e-a9a4eb0c0237]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3adc52-1336-4c70-9279-53f43062ae73]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.070s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1135a25d-7f07-4e28-b97d-777026db1133]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f606228b-7c19-4336-8ad5-c349f7a7e2e4]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e0ca3c-1fcc-4cb3-8515-972a0dd65280]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75, portal: 172.16.0.220,3260]
Dec 05 12:44:26 user nova-compute[75071]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75, portal: 172.16.0.220,3260] successful.
Dec 05 12:44:26 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:814f5874-1607-4eee-ad82-cc04df760f75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f9cd7b-8c26-4f9a-89b5-3d18c3955b49]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] <== disconnect_volume: return (326ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:44:26 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Deleting instance files /opt/stack/data/nova/instances/48774298-024b-4c96-a72f-74195ef8b5be_del
Dec 05 12:44:26 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Deletion of /opt/stack/data/nova/instances/48774298-024b-4c96-a72f-74195ef8b5be_del complete
Dec 05 12:44:26 user nova-compute[75071]: INFO nova.compute.manager [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Took 1.19 seconds to destroy the instance on the hypervisor.
Dec 05 12:44:26 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:44:26 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:44:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:27 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:44:27 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Took 0.43 seconds to deallocate network for instance.
Dec 05 12:44:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-ab873089-141e-471f-8ad2-e77085b867e2 req-f15b5ef3-afb0-4c0e-9b69-28220e17797e service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received event network-vif-deleted-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:44:27 user nova-compute[75071]: INFO nova.compute.manager [req-ab873089-141e-471f-8ad2-e77085b867e2 req-f15b5ef3-afb0-4c0e-9b69-28220e17797e service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Neutron deleted interface 0d784760-630f-44d4-8ad1-1d965951b90a; detaching it from the instance and deleting it from the info cache
Dec 05 12:44:27 user nova-compute[75071]: DEBUG nova.network.neutron [req-ab873089-141e-471f-8ad2-e77085b867e2 req-f15b5ef3-afb0-4c0e-9b69-28220e17797e service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:44:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-ab873089-141e-471f-8ad2-e77085b867e2 req-f15b5ef3-afb0-4c0e-9b69-28220e17797e service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Detach interface failed, port_id=0d784760-630f-44d4-8ad1-1d965951b90a, reason: Instance 48774298-024b-4c96-a72f-74195ef8b5be could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:44:28 user nova-compute[75071]: INFO nova.compute.manager [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Took 0.76 seconds to detach 1 volumes for instance.
Dec 05 12:44:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-cca54afe-49f1-4dc7-9749-99fe9256514f req-0221016c-73b2-42f6-beb0-6383f9197993 service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received event network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:44:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cca54afe-49f1-4dc7-9749-99fe9256514f req-0221016c-73b2-42f6-beb0-6383f9197993 service nova] Acquiring lock "48774298-024b-4c96-a72f-74195ef8b5be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:44:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cca54afe-49f1-4dc7-9749-99fe9256514f req-0221016c-73b2-42f6-beb0-6383f9197993 service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:44:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cca54afe-49f1-4dc7-9749-99fe9256514f req-0221016c-73b2-42f6-beb0-6383f9197993 service nova] Lock "48774298-024b-4c96-a72f-74195ef8b5be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:44:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-cca54afe-49f1-4dc7-9749-99fe9256514f req-0221016c-73b2-42f6-beb0-6383f9197993 service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] No waiting events found dispatching network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:44:28 user nova-compute[75071]: WARNING nova.compute.manager [req-cca54afe-49f1-4dc7-9749-99fe9256514f req-0221016c-73b2-42f6-beb0-6383f9197993 service nova] [instance: 48774298-024b-4c96-a72f-74195ef8b5be] Received unexpected event network-vif-plugged-0d784760-630f-44d4-8ad1-1d965951b90a for instance with vm_state active and task_state deleting.
Dec 05 12:44:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:44:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:44:28 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:44:28 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:44:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:44:28 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Deleted allocations for instance 48774298-024b-4c96-a72f-74195ef8b5be
Dec 05 12:44:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-15c13a65-82e0-40b9-89d7-75f899e4629c tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "48774298-024b-4c96-a72f-74195ef8b5be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.803s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:44:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:44:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lazy-loading 'flavor' on Instance uuid 72bb9c85-25b6-4a08-96bf-59881754adea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:44:46 user nova-compute[75071]: INFO nova.compute.manager [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Attaching volume 4314a905-828a-4e8e-b213-2f9374f104d0 to /dev/vdb
Dec 05 12:44:46 user nova-compute[75071]: DEBUG os_brick.utils [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[28db6e3d-d472-4d75-8bbb-fdbb2a596d6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2389fdb-a23a-4e18-8e74-c6b3a4617bbc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c35d6cf-6978-4e5e-bd1c-19f401064ec6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae2a3f5-70ff-44d1-b468-49f327cd3d12]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:44:46 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:44:46 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec2d06d-0b8e-4be4-b600-143fa8412412]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG os_brick.utils [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:44:46 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Updating existing volume attachment record: c14160bb-6a1d-4eb5-9823-6c7274214abd {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:44:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ODWNgeMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:44:55 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:44:55 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:44:55 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f7ffd5-97a4-4789-bb8d-981d946c61ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:44:55 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb949f43-5504-4bd9-8cb3-fce324cb9b30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0] added
Dec 05 12:44:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35fa7a5-fdc8-46ca-9dba-f4c2b53c627a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[780615b8-e9d9-4dbe-be22-ae3343922e97]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ODWNgeMZ {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ODWNgeMZ" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[39933e0b-dc83-4aa0-a99a-921e947a46e5]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ODWNgeMZ'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[948c19fb-897a-48e1-aacc-5dc7bc0d88bd]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac32f6a-eb67-4b86-aa8c-8e935f04502b]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:44:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:44:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[794caebd-89e2-4851-b7e1-af82727f01e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0, portal: 172.16.0.220,3260]
Dec 05 12:44:55 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0, portal: 172.16.0.220,3260] successful.
Dec 05 12:44:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce48b65d-85e9-4ba0-ad30-fbef5b1ebc1c]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff23bf2e-1137-4605-96b7-69ba45bbc795]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:44:55 user nova-compute[75071]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 (non-flash)
Dec 05 12:44:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:44:55 user nova-compute[75071]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 (non-flash)
Dec 05 12:44:55 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed901c46-db23-4060-b373-2d2c2665dc97]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:44:55 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:44:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:44:56 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:44:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ODWNgeMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:44:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:44:56 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26433663038356639', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:44:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433663038356639', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:44:56 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lazy-loading 'flavor' on Instance uuid 72bb9c85-25b6-4a08-96bf-59881754adea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:44:56 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:44:56 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:44:56 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:44:56 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:44:56 user nova-compute[75071]:   <serial>4314a905-828a-4e8e-b213-2f9374f104d0</serial>
Dec 05 12:44:56 user nova-compute[75071]: </disk>
Dec 05 12:44:56 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:44:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:44:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:44:57 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] No VIF found with MAC fa:16:3e:b6:47:30, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:44:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2971d1ce-390b-4102-b1c9-0e1e4d215383 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.800s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:44:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:45:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:45:00 user nova-compute[75071]: INFO nova.compute.manager [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Detaching volume 4314a905-828a-4e8e-b213-2f9374f104d0
Dec 05 12:45:00 user nova-compute[75071]: INFO nova.virt.block_device [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Attempting to driver detach volume 4314a905-828a-4e8e-b213-2f9374f104d0 from mountpoint /dev/vdb
Dec 05 12:45:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Attempting to detach device vdb from instance 72bb9c85-25b6-4a08-96bf-59881754adea from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:45:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:45:00 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:45:00 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:45:00 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:45:00 user nova-compute[75071]:   <serial>4314a905-828a-4e8e-b213-2f9374f104d0</serial>
Dec 05 12:45:00 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:45:00 user nova-compute[75071]: </disk>
Dec 05 12:45:00 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:45:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Successfully detached device vdb from instance 72bb9c85-25b6-4a08-96bf-59881754adea from the persistent domain config.
Dec 05 12:45:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72bb9c85-25b6-4a08-96bf-59881754adea from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:45:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:45:00 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:45:00 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:45:00 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:45:00 user nova-compute[75071]:   <serial>4314a905-828a-4e8e-b213-2f9374f104d0</serial>
Dec 05 12:45:00 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:45:00 user nova-compute[75071]: </disk>
Dec 05 12:45:00 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:45:00 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:45:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72bb9c85-25b6-4a08-96bf-59881754adea {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:45:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:45:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:04 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:45:04 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:45:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:45:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:45:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:45:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:45:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:45:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:45:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:45:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:45:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquiring lock "f6b3497d-2998-48ba-9604-4332afa95c29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "f6b3497d-2998-48ba-9604-4332afa95c29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquiring lock "f6b3497d-2998-48ba-9604-4332afa95c29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "f6b3497d-2998-48ba-9604-4332afa95c29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "f6b3497d-2998-48ba-9604-4332afa95c29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:45:07 user nova-compute[75071]: INFO nova.compute.manager [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Terminating instance
Dec 05 12:45:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:45:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-b1dd6563-45c3-4650-b252-1177d6c2ba7b req-8a965278-9c3c-46b9-8305-1851524097cf service nova] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Received event network-vif-unplugged-91e29c88-544e-4637-b12a-3fd62802f1cf {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b1dd6563-45c3-4650-b252-1177d6c2ba7b req-8a965278-9c3c-46b9-8305-1851524097cf service nova] Acquiring lock "f6b3497d-2998-48ba-9604-4332afa95c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b1dd6563-45c3-4650-b252-1177d6c2ba7b req-8a965278-9c3c-46b9-8305-1851524097cf service nova] Lock "f6b3497d-2998-48ba-9604-4332afa95c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b1dd6563-45c3-4650-b252-1177d6c2ba7b req-8a965278-9c3c-46b9-8305-1851524097cf service nova] Lock "f6b3497d-2998-48ba-9604-4332afa95c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-b1dd6563-45c3-4650-b252-1177d6c2ba7b req-8a965278-9c3c-46b9-8305-1851524097cf service nova] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] No waiting events found dispatching network-vif-unplugged-91e29c88-544e-4637-b12a-3fd62802f1cf {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-b1dd6563-45c3-4650-b252-1177d6c2ba7b req-8a965278-9c3c-46b9-8305-1851524097cf service nova] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Received event network-vif-unplugged-91e29c88-544e-4637-b12a-3fd62802f1cf for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:08 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Instance destroyed successfully.
Dec 05 12:45:08 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lazy-loading 'resources' on Instance uuid f6b3497d-2998-48ba-9604-4332afa95c29 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:36:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1959430990',display_name='tempest-ServersNegativeTestJSON-server-1959430990',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1959430990',id=38,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:36:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c9933b6650941d58025487be8dedc17',ramdisk_id='',reservation_id='r-sf4icequ',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-508219572',owner_user_name='tempest-ServersNegativeTestJSON-508219572-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:36:28Z,user_data=None,user_id='3f07cde1f0ad4139ade7efe260ad7545',uuid=f6b3497d-2998-48ba-9604-4332afa95c29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91e29c88-544e-4637-b12a-3fd62802f1cf", "address": "fa:16:3e:92:b9:46", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e29c88-54", "ovs_interfaceid": "91e29c88-544e-4637-b12a-3fd62802f1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Converting VIF {"id": "91e29c88-544e-4637-b12a-3fd62802f1cf", "address": "fa:16:3e:92:b9:46", "network": {"id": "7558883d-4135-4f8d-ac25-dccea82839e2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2036632975-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c9933b6650941d58025487be8dedc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91e29c88-54", "ovs_interfaceid": "91e29c88-544e-4637-b12a-3fd62802f1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:b9:46,bridge_name='br-int',has_traffic_filtering=True,id=91e29c88-544e-4637-b12a-3fd62802f1cf,network=Network(7558883d-4135-4f8d-ac25-dccea82839e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e29c88-54') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG os_vif [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:b9:46,bridge_name='br-int',has_traffic_filtering=True,id=91e29c88-544e-4637-b12a-3fd62802f1cf,network=Network(7558883d-4135-4f8d-ac25-dccea82839e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e29c88-54') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91e29c88-54, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed6b97c5-7cff-444a-b095-293ed0364166) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:08 user nova-compute[75071]: INFO os_vif [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:b9:46,bridge_name='br-int',has_traffic_filtering=True,id=91e29c88-544e-4637-b12a-3fd62802f1cf,network=Network(7558883d-4135-4f8d-ac25-dccea82839e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91e29c88-54')
Dec 05 12:45:08 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Deleting instance files /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29_del
Dec 05 12:45:08 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Deletion of /opt/stack/data/nova/instances/f6b3497d-2998-48ba-9604-4332afa95c29_del complete
Dec 05 12:45:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:08 user nova-compute[75071]: INFO nova.compute.manager [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Took 0.95 seconds to destroy the instance on the hypervisor.
Dec 05 12:45:08 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:45:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:08 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Error from libvirt while getting description of instance-00000026: [Error Code 42] Domain not found: no domain with matching uuid 'f6b3497d-2998-48ba-9604-4332afa95c29' (instance-00000026): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f6b3497d-2998-48ba-9604-4332afa95c29' (instance-00000026)
Dec 05 12:45:09 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:45:09 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:45:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8396MB free_disk=24.725818634033203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 42776e73-1ef0-4c57-a50a-942f6f4881de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 9f492779-584e-4a21-9991-78de01f6670c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance f6b3497d-2998-48ba-9604-4332afa95c29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 72bb9c85-25b6-4a08-96bf-59881754adea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 52ff4123-828f-43d1-b152-e791c5246fa8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:45:09 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Took 0.85 seconds to deallocate network for instance.
Dec 05 12:45:09 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-56f43589-3c89-4f8a-8d0c-1c29f8cf6058 req-17d7fd11-649e-4d71-893b-5d2cb597289e service nova] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Received event network-vif-deleted-91e29c88-544e-4637-b12a-3fd62802f1cf {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:45:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:45:09 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Deleted allocations for instance f6b3497d-2998-48ba-9604-4332afa95c29
Dec 05 12:45:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d652726f-d592-4e57-8f9f-d4b74a59387a tempest-ServersNegativeTestJSON-508219572 tempest-ServersNegativeTestJSON-508219572-project-member] Lock "f6b3497d-2998-48ba-9604-4332afa95c29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.256s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:45:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-4ba82323-6d70-45a2-bd7d-98c694d29f5f req-ab7af44c-60a5-4782-9442-a72a77dad9d9 service nova] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Received event network-vif-plugged-91e29c88-544e-4637-b12a-3fd62802f1cf {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:45:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4ba82323-6d70-45a2-bd7d-98c694d29f5f req-ab7af44c-60a5-4782-9442-a72a77dad9d9 service nova] Acquiring lock "f6b3497d-2998-48ba-9604-4332afa95c29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:45:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4ba82323-6d70-45a2-bd7d-98c694d29f5f req-ab7af44c-60a5-4782-9442-a72a77dad9d9 service nova] Lock "f6b3497d-2998-48ba-9604-4332afa95c29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:45:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4ba82323-6d70-45a2-bd7d-98c694d29f5f req-ab7af44c-60a5-4782-9442-a72a77dad9d9 service nova] Lock "f6b3497d-2998-48ba-9604-4332afa95c29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:45:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-4ba82323-6d70-45a2-bd7d-98c694d29f5f req-ab7af44c-60a5-4782-9442-a72a77dad9d9 service nova] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] No waiting events found dispatching network-vif-plugged-91e29c88-544e-4637-b12a-3fd62802f1cf {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:45:10 user nova-compute[75071]: WARNING nova.compute.manager [req-4ba82323-6d70-45a2-bd7d-98c694d29f5f req-ab7af44c-60a5-4782-9442-a72a77dad9d9 service nova] [instance: f6b3497d-2998-48ba-9604-4332afa95c29] Received unexpected event network-vif-plugged-91e29c88-544e-4637-b12a-3fd62802f1cf for instance with vm_state deleted and task_state None.
Dec 05 12:45:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:45:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:45:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:45:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:45:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-9f492779-584e-4a21-9991-78de01f6670c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:45:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-9f492779-584e-4a21-9991-78de01f6670c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:45:14 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:45:15 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Updating instance_info_cache with network_info: [{"id": "5c69855c-e879-4e6a-800c-d78be52ba433", "address": "fa:16:3e:6a:3f:fe", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c69855c-e8", "ovs_interfaceid": "5c69855c-e879-4e6a-800c-d78be52ba433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:45:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-9f492779-584e-4a21-9991-78de01f6670c" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:45:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "9f492779-584e-4a21-9991-78de01f6670c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "9f492779-584e-4a21-9991-78de01f6670c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "9f492779-584e-4a21-9991-78de01f6670c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "9f492779-584e-4a21-9991-78de01f6670c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "9f492779-584e-4a21-9991-78de01f6670c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:45:16 user nova-compute[75071]: INFO nova.compute.manager [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Terminating instance
Dec 05 12:45:16 user nova-compute[75071]: DEBUG nova.compute.manager [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-b709ef00-a422-4a70-934d-c5b30dac236d req-642d7726-c0f5-41ac-8013-c8b86fc70f5b service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Received event network-vif-unplugged-5c69855c-e879-4e6a-800c-d78be52ba433 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b709ef00-a422-4a70-934d-c5b30dac236d req-642d7726-c0f5-41ac-8013-c8b86fc70f5b service nova] Acquiring lock "9f492779-584e-4a21-9991-78de01f6670c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b709ef00-a422-4a70-934d-c5b30dac236d req-642d7726-c0f5-41ac-8013-c8b86fc70f5b service nova] Lock "9f492779-584e-4a21-9991-78de01f6670c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-b709ef00-a422-4a70-934d-c5b30dac236d req-642d7726-c0f5-41ac-8013-c8b86fc70f5b service nova] Lock "9f492779-584e-4a21-9991-78de01f6670c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-b709ef00-a422-4a70-934d-c5b30dac236d req-642d7726-c0f5-41ac-8013-c8b86fc70f5b service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] No waiting events found dispatching network-vif-unplugged-5c69855c-e879-4e6a-800c-d78be52ba433 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG nova.compute.manager [req-b709ef00-a422-4a70-934d-c5b30dac236d req-642d7726-c0f5-41ac-8013-c8b86fc70f5b service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Received event network-vif-unplugged-5c69855c-e879-4e6a-800c-d78be52ba433 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:16 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Instance destroyed successfully.
Dec 05 12:45:16 user nova-compute[75071]: DEBUG nova.objects.instance [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'resources' on Instance uuid 9f492779-584e-4a21-9991-78de01f6670c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:35:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-868553320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-868553320',id=37,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:36:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b77a4b1baadd43e1be69eecb1f5370bd',ramdisk_id='',reservation_id='r-fgggtcfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86909184',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:37:51Z,user_data=None,user_id='201cbbb8b3dc4a3aa8164d69c1257489',uuid=9f492779-584e-4a21-9991-78de01f6670c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c69855c-e879-4e6a-800c-d78be52ba433", "address": "fa:16:3e:6a:3f:fe", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c69855c-e8", "ovs_interfaceid": "5c69855c-e879-4e6a-800c-d78be52ba433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converting VIF {"id": "5c69855c-e879-4e6a-800c-d78be52ba433", "address": "fa:16:3e:6a:3f:fe", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c69855c-e8", "ovs_interfaceid": "5c69855c-e879-4e6a-800c-d78be52ba433", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:3f:fe,bridge_name='br-int',has_traffic_filtering=True,id=5c69855c-e879-4e6a-800c-d78be52ba433,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c69855c-e8') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG os_vif [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:3f:fe,bridge_name='br-int',has_traffic_filtering=True,id=5c69855c-e879-4e6a-800c-d78be52ba433,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c69855c-e8') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c69855c-e8, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:45:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54f09095-be8a-4fad-b5de-fbd4b1197325) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:45:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:45:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:17 user nova-compute[75071]: INFO os_vif [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:3f:fe,bridge_name='br-int',has_traffic_filtering=True,id=5c69855c-e879-4e6a-800c-d78be52ba433,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c69855c-e8')
Dec 05 12:45:17 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Deleting instance files /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c_del
Dec 05 12:45:17 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Deletion of /opt/stack/data/nova/instances/9f492779-584e-4a21-9991-78de01f6670c_del complete
Dec 05 12:45:17 user nova-compute[75071]: INFO nova.compute.manager [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Took 0.67 seconds to destroy the instance on the hypervisor.
Dec 05 12:45:17 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:45:17 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:45:17 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 9f492779-584e-4a21-9991-78de01f6670c] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:45:17 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:45:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-ef31e24f-26c8-48c2-bf61-b1a8e838a6e5 req-a906c3b3-1b22-4e66-8f48-b160d29c80fe service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Received event network-vif-deleted-5c69855c-e879-4e6a-800c-d78be52ba433 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:45:17 user nova-compute[75071]: INFO nova.compute.manager [req-ef31e24f-26c8-48c2-bf61-b1a8e838a6e5 req-a906c3b3-1b22-4e66-8f48-b160d29c80fe service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Neutron deleted interface 5c69855c-e879-4e6a-800c-d78be52ba433; detaching it from the instance and deleting it from the info cache
Dec 05 12:45:17 user nova-compute[75071]: DEBUG nova.network.neutron [req-ef31e24f-26c8-48c2-bf61-b1a8e838a6e5 req-a906c3b3-1b22-4e66-8f48-b160d29c80fe service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:45:17 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Took 0.45 seconds to deallocate network for instance.
Dec 05 12:45:17 user nova-compute[75071]: DEBUG nova.compute.manager [req-ef31e24f-26c8-48c2-bf61-b1a8e838a6e5 req-a906c3b3-1b22-4e66-8f48-b160d29c80fe service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Detach interface failed, port_id=5c69855c-e879-4e6a-800c-d78be52ba433, reason: Instance 9f492779-584e-4a21-9991-78de01f6670c could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:45:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:45:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:45:17 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:45:17 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:45:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:45:17 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Deleted allocations for instance 9f492779-584e-4a21-9991-78de01f6670c
Dec 05 12:45:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-13ceec80-6d33-44b6-810c-0e11e3b9269e tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "9f492779-584e-4a21-9991-78de01f6670c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.594s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:45:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-5c7e37cc-70e2-41a6-880b-62f4dcd5b82c req-c81b2cf8-f46b-443a-bf06-abf20bd95580 service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Received event network-vif-plugged-5c69855c-e879-4e6a-800c-d78be52ba433 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:45:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5c7e37cc-70e2-41a6-880b-62f4dcd5b82c req-c81b2cf8-f46b-443a-bf06-abf20bd95580 service nova] Acquiring lock "9f492779-584e-4a21-9991-78de01f6670c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:45:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5c7e37cc-70e2-41a6-880b-62f4dcd5b82c req-c81b2cf8-f46b-443a-bf06-abf20bd95580 service nova] Lock "9f492779-584e-4a21-9991-78de01f6670c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:45:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5c7e37cc-70e2-41a6-880b-62f4dcd5b82c req-c81b2cf8-f46b-443a-bf06-abf20bd95580 service nova] Lock "9f492779-584e-4a21-9991-78de01f6670c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:45:18 user nova-compute[75071]: DEBUG nova.compute.manager [req-5c7e37cc-70e2-41a6-880b-62f4dcd5b82c req-c81b2cf8-f46b-443a-bf06-abf20bd95580 service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] No waiting events found dispatching network-vif-plugged-5c69855c-e879-4e6a-800c-d78be52ba433 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:45:18 user nova-compute[75071]: WARNING nova.compute.manager [req-5c7e37cc-70e2-41a6-880b-62f4dcd5b82c req-c81b2cf8-f46b-443a-bf06-abf20bd95580 service nova] [instance: 9f492779-584e-4a21-9991-78de01f6670c] Received unexpected event network-vif-plugged-5c69855c-e879-4e6a-800c-d78be52ba433 for instance with vm_state deleted and task_state None.
Dec 05 12:45:20 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 72bb9c85-25b6-4a08-96bf-59881754adea is timed out.
Dec 05 12:45:20 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Successfully detached device vdb from instance 72bb9c85-25b6-4a08-96bf-59881754adea from the live domain config.
Dec 05 12:45:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ODWNgeMZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:45:20 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ee0db5-3793-4842-8b75-b892be1a9da3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:45:20 user nova-compute[75071]: No targets found.
Dec 05 12:45:20 user nova-compute[75071]: iSNS:
Dec 05 12:45:20 user nova-compute[75071]: No targets found.
Dec 05 12:45:20 user nova-compute[75071]: STATIC:
Dec 05 12:45:20 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c
Dec 05 12:45:20 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:45:20 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:45:20 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0
Dec 05 12:45:20 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:45:20 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:45:20 user nova-compute[75071]: FIRMWARE:
Dec 05 12:45:20 user nova-compute[75071]: No targets found.
Dec 05 12:45:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:45:20 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:45:20 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c62f06f-97e2-48d5-bbc9-149ca0c5683a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[283b9120-9faa-4ac3-9d14-7340f7e24f43]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:45:20 user nova-compute[75071]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 (non-flash)
Dec 05 12:45:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:45:20 user nova-compute[75071]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 (non-flash)
Dec 05 12:45:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f824067a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c363c3d-b221-4ef2-9041-375088cdd963]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43f2316-3da8-4b61-8fe7-3eec83bbc122]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4790d336-3700-450b-9d67-d135209e1c59]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc3f25c-df2c-4d24-a208-995b88c03c7c]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0452b70-2622-4869-af5e-bf208425d4d9]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6999f602-1c0c-4905-ae47-ea287ac04427]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0, portal: 172.16.0.220,3260]
Dec 05 12:45:20 user nova-compute[75071]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0, portal: 172.16.0.220,3260] successful.
Dec 05 12:45:20 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4314a905-828a-4e8e-b213-2f9374f104d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f899ceb6-bbe9-4c58-b01b-57129ea3b624]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] <== disconnect_volume: return (286ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:45:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:45:21 user nova-compute[75071]: DEBUG nova.objects.instance [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lazy-loading 'flavor' on Instance uuid 72bb9c85-25b6-4a08-96bf-59881754adea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:45:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-1bae695d-1b19-42eb-8c39-103c74b5b3d4 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.779s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:45:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:45:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-d5d37ea8-1d66-4d5f-970b-252741362840 req-aa8f1dc9-e8ac-4ffc-b1be-2cb598128a50 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Received event network-changed-78015c9f-5f8c-48f1-bba3-4159569e0613 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:45:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-d5d37ea8-1d66-4d5f-970b-252741362840 req-aa8f1dc9-e8ac-4ffc-b1be-2cb598128a50 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Refreshing instance network info cache due to event network-changed-78015c9f-5f8c-48f1-bba3-4159569e0613. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:45:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d5d37ea8-1d66-4d5f-970b-252741362840 req-aa8f1dc9-e8ac-4ffc-b1be-2cb598128a50 service nova] Acquiring lock "refresh_cache-52ff4123-828f-43d1-b152-e791c5246fa8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:45:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d5d37ea8-1d66-4d5f-970b-252741362840 req-aa8f1dc9-e8ac-4ffc-b1be-2cb598128a50 service nova] Acquired lock "refresh_cache-52ff4123-828f-43d1-b152-e791c5246fa8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:45:31 user nova-compute[75071]: DEBUG nova.network.neutron [req-d5d37ea8-1d66-4d5f-970b-252741362840 req-aa8f1dc9-e8ac-4ffc-b1be-2cb598128a50 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Refreshing network info cache for port 78015c9f-5f8c-48f1-bba3-4159569e0613 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:45:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:45:32 user nova-compute[75071]: DEBUG nova.network.neutron [req-d5d37ea8-1d66-4d5f-970b-252741362840 req-aa8f1dc9-e8ac-4ffc-b1be-2cb598128a50 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Updated VIF entry in instance network info cache for port 78015c9f-5f8c-48f1-bba3-4159569e0613. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:45:32 user nova-compute[75071]: DEBUG nova.network.neutron [req-d5d37ea8-1d66-4d5f-970b-252741362840 req-aa8f1dc9-e8ac-4ffc-b1be-2cb598128a50 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Updating instance_info_cache with network_info: [{"id": "78015c9f-5f8c-48f1-bba3-4159569e0613", "address": "fa:16:3e:30:43:31", "network": {"id": "f55368ee-ff6e-48a6-8464-24657f475faf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-806121992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a80672aa2240ac92bd2778cf23dcac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78015c9f-5f", "ovs_interfaceid": "78015c9f-5f8c-48f1-bba3-4159569e0613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:45:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d5d37ea8-1d66-4d5f-970b-252741362840 req-aa8f1dc9-e8ac-4ffc-b1be-2cb598128a50 service nova] Releasing lock "refresh_cache-52ff4123-828f-43d1-b152-e791c5246fa8" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:45:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Acquiring lock "52ff4123-828f-43d1-b152-e791c5246fa8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:45:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "52ff4123-828f-43d1-b152-e791c5246fa8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:45:34 user nova-compute[75071]: DEBUG nova.objects.instance [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lazy-loading 'flavor' on Instance uuid 52ff4123-828f-43d1-b152-e791c5246fa8 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:45:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "52ff4123-828f-43d1-b152-e791c5246fa8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Acquiring lock "52ff4123-828f-43d1-b152-e791c5246fa8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "52ff4123-828f-43d1-b152-e791c5246fa8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:45:35 user nova-compute[75071]: INFO nova.compute.manager [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Attaching volume e60d22d8-9825-44b2-b1aa-bfb4ecf032ea to /dev/vdb
Dec 05 12:45:35 user nova-compute[75071]: DEBUG os_brick.utils [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[228b266d-872d-482e-ab83-a5ec300ddef2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbfac74-a8f3-471f-be17-4a2c3bafb97a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7d7c82-732a-4d98-9fdc-7756e84ba945]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c46106-39d7-4b04-b8f4-bf98e2445adc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:45:35 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:45:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf54ba9-db18-4a06-97e0-aaf0befa0674]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG os_brick.utils [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:45:35 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Updating existing volume attachment record: 5c11c608-9055-48a0-9114-cb6ac7c6b5eb {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.objects.instance [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'flavor' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "refresh_cache-1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquired lock "refresh_cache-1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.objects.instance [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'info_cache' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.objects.base [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Object Instance<1c4abc24-1295-4dd3-9fc4-8e8ac304fabf> lazy-loaded attributes: flavor,info_cache {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Updating instance_info_cache with network_info: [{"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Releasing lock "refresh_cache-1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:45:37 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Instance destroyed successfully.
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.objects.instance [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'resources' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.objects.base [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Object Instance<1c4abc24-1295-4dd3-9fc4-8e8ac304fabf> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2023774332',display_name='tempest-AttachVolumeTestJSON-server-2023774332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2023774332',id=39,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOMX/EZQmXhh7SdXzCFyRhmWDCDnYUHKgoB5uNuCbmikXutEQOOyGZ4O4+WzrfJeqIXgNW/+y2MaSiDfRCdQEgi/HUIV4qPam6B1OlLSXl5XEVzQ3IxLyJkjekI/XzLYg==',key_name='tempest-keypair-1505168977',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:37:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9640f3ad175948f59ba184167e4bf5a9',ramdisk_id='',reservation_id='r-er01om00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-660715611',owner_user_name='tempest-AttachVolumeTestJSON-660715611-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:43:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b2ab4b19a9b4ce397ffa1cc279e26ac',uuid=1c4abc24-1295-4dd3-9fc4-8e8ac304fabf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converting VIF {"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG os_vif [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde4a3fbc-83, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11d9ccb7-0d5f-4e91-af09-7093ac58db93) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:45:37 user nova-compute[75071]: INFO os_vif [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83')
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Start _get_guest_xml network_info=[{"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.objects.instance [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'numa_topology' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.objects.base [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Object Instance<1c4abc24-1295-4dd3-9fc4-8e8ac304fabf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:45:37 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:45:37 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.objects.instance [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.objects.base [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Object Instance<1c4abc24-1295-4dd3-9fc4-8e8ac304fabf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2023774332',display_name='tempest-AttachVolumeTestJSON-server-2023774332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2023774332',id=39,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOMX/EZQmXhh7SdXzCFyRhmWDCDnYUHKgoB5uNuCbmikXutEQOOyGZ4O4+WzrfJeqIXgNW/+y2MaSiDfRCdQEgi/HUIV4qPam6B1OlLSXl5XEVzQ3IxLyJkjekI/XzLYg==',key_name='tempest-keypair-1505168977',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:37:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9640f3ad175948f59ba184167e4bf5a9',ramdisk_id='',reservation_id='r-er01om00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-660715611',owner_user_name='tempest-AttachVolumeTestJSON-660715611-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:43:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b2ab4b19a9b4ce397ffa1cc279e26ac',uuid=1c4abc24-1295-4dd3-9fc4-8e8ac304fabf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converting VIF {"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.objects.instance [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.objects.base [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Object Instance<1c4abc24-1295-4dd3-9fc4-8e8ac304fabf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:45:37 user nova-compute[75071]:   <uuid>1c4abc24-1295-4dd3-9fc4-8e8ac304fabf</uuid>
Dec 05 12:45:37 user nova-compute[75071]:   <name>instance-00000027</name>
Dec 05 12:45:37 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:45:37 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:45:37 user nova-compute[75071]:   <metadata>
Dec 05 12:45:37 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:45:37 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:45:37 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeTestJSON-server-2023774332</nova:name>
Dec 05 12:45:37 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:45:37</nova:creationTime>
Dec 05 12:45:37 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:45:37 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:45:37 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:45:37 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:45:37 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:45:37 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:45:37 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:45:37 user nova-compute[75071]:       <nova:owner>
Dec 05 12:45:37 user nova-compute[75071]:         <nova:user uuid="2b2ab4b19a9b4ce397ffa1cc279e26ac">tempest-AttachVolumeTestJSON-660715611-project-member</nova:user>
Dec 05 12:45:37 user nova-compute[75071]:         <nova:project uuid="9640f3ad175948f59ba184167e4bf5a9">tempest-AttachVolumeTestJSON-660715611</nova:project>
Dec 05 12:45:37 user nova-compute[75071]:       </nova:owner>
Dec 05 12:45:37 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:45:37 user nova-compute[75071]:       <nova:ports>
Dec 05 12:45:37 user nova-compute[75071]:         <nova:port uuid="de4a3fbc-8399-45f2-9027-ec80fbaa1077">
Dec 05 12:45:37 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 05 12:45:37 user nova-compute[75071]:         </nova:port>
Dec 05 12:45:37 user nova-compute[75071]:       </nova:ports>
Dec 05 12:45:37 user nova-compute[75071]:     </nova:instance>
Dec 05 12:45:37 user nova-compute[75071]:   </metadata>
Dec 05 12:45:37 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:45:37 user nova-compute[75071]:     <system>
Dec 05 12:45:37 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:45:37 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:45:37 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:45:37 user nova-compute[75071]:       <entry name="serial">1c4abc24-1295-4dd3-9fc4-8e8ac304fabf</entry>
Dec 05 12:45:37 user nova-compute[75071]:       <entry name="uuid">1c4abc24-1295-4dd3-9fc4-8e8ac304fabf</entry>
Dec 05 12:45:37 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:45:37 user nova-compute[75071]:     </system>
Dec 05 12:45:37 user nova-compute[75071]:   </sysinfo>
Dec 05 12:45:37 user nova-compute[75071]:   <os>
Dec 05 12:45:37 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:45:37 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:45:37 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:45:37 user nova-compute[75071]:   </os>
Dec 05 12:45:37 user nova-compute[75071]:   <features>
Dec 05 12:45:37 user nova-compute[75071]:     <acpi/>
Dec 05 12:45:37 user nova-compute[75071]:     <apic/>
Dec 05 12:45:37 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:45:37 user nova-compute[75071]:   </features>
Dec 05 12:45:37 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:45:37 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:45:37 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:45:37 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:45:37 user nova-compute[75071]:   </clock>
Dec 05 12:45:37 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:45:37 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:45:37 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:45:37 user nova-compute[75071]:   </cpu>
Dec 05 12:45:37 user nova-compute[75071]:   <devices>
Dec 05 12:45:37 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:45:37 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:45:37 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk"/>
Dec 05 12:45:37 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:45:37 user nova-compute[75071]:     </disk>
Dec 05 12:45:37 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:45:37 user nova-compute[75071]:       <mac address="fa:16:3e:3e:4e:da"/>
Dec 05 12:45:37 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:45:37 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:45:37 user nova-compute[75071]:       <target dev="tapde4a3fbc-83"/>
Dec 05 12:45:37 user nova-compute[75071]:     </interface>
Dec 05 12:45:37 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:45:37 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/console.log" append="off"/>
Dec 05 12:45:37 user nova-compute[75071]:     </serial>
Dec 05 12:45:37 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:45:37 user nova-compute[75071]:     <video>
Dec 05 12:45:37 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:45:37 user nova-compute[75071]:     </video>
Dec 05 12:45:37 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:45:37 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:45:37 user nova-compute[75071]:     </rng>
Dec 05 12:45:37 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:45:37 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:45:37 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:45:37 user nova-compute[75071]:     </memballoon>
Dec 05 12:45:37 user nova-compute[75071]:   </devices>
Dec 05 12:45:37 user nova-compute[75071]: </domain>
Dec 05 12:45:37 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:45:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG nova.objects.instance [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG nova.objects.base [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Object Instance<1c4abc24-1295-4dd3-9fc4-8e8ac304fabf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Cannot resize image /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG nova.objects.instance [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'migration_context' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG nova.objects.base [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Object Instance<1c4abc24-1295-4dd3-9fc4-8e8ac304fabf> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75071) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2023774332',display_name='tempest-AttachVolumeTestJSON-server-2023774332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2023774332',id=39,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOMX/EZQmXhh7SdXzCFyRhmWDCDnYUHKgoB5uNuCbmikXutEQOOyGZ4O4+WzrfJeqIXgNW/+y2MaSiDfRCdQEgi/HUIV4qPam6B1OlLSXl5XEVzQ3IxLyJkjekI/XzLYg==',key_name='tempest-keypair-1505168977',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:37:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='9640f3ad175948f59ba184167e4bf5a9',ramdisk_id='',reservation_id='r-er01om00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-660715611',owner_user_name='tempest-AttachVolumeTestJSON-660715611-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:43:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b2ab4b19a9b4ce397ffa1cc279e26ac',uuid=1c4abc24-1295-4dd3-9fc4-8e8ac304fabf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converting VIF {"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG os_vif [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa24488e-06b5-56b4-8ab6-f81fd6f9b97c', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde4a3fbc-83, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde4a3fbc-83, col_values=(('qos', UUID('a3e2c5b3-750d-4235-8cc6-b785b3f44c75')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde4a3fbc-83, col_values=(('external_ids', {'iface-id': 'de4a3fbc-8399-45f2-9027-ec80fbaa1077', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:4e:da', 'vm-uuid': '1c4abc24-1295-4dd3-9fc4-8e8ac304fabf'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:45:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:38 user nova-compute[75071]: INFO os_vif [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83')
Dec 05 12:45:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-f24dc56a-d238-4852-9903-12bbfeee9397 req-dae7f6f4-9be1-47ea-a854-0c3bb7ec94be service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received event network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:45:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f24dc56a-d238-4852-9903-12bbfeee9397 req-dae7f6f4-9be1-47ea-a854-0c3bb7ec94be service nova] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:45:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f24dc56a-d238-4852-9903-12bbfeee9397 req-dae7f6f4-9be1-47ea-a854-0c3bb7ec94be service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:45:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f24dc56a-d238-4852-9903-12bbfeee9397 req-dae7f6f4-9be1-47ea-a854-0c3bb7ec94be service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:45:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-f24dc56a-d238-4852-9903-12bbfeee9397 req-dae7f6f4-9be1-47ea-a854-0c3bb7ec94be service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] No waiting events found dispatching network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:45:40 user nova-compute[75071]: WARNING nova.compute.manager [req-f24dc56a-d238-4852-9903-12bbfeee9397 req-dae7f6f4-9be1-47ea-a854-0c3bb7ec94be service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received unexpected event network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 for instance with vm_state stopped and task_state powering-on.
Dec 05 12:45:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:45:42 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Instance rebooted successfully.
Dec 05 12:45:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-20c4eeb8-5c8b-433e-b24f-5943087e0857 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:45:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-1f95a6c2-3263-4230-930f-190694209aa2 req-828a7d28-3550-4bfa-9fa6-1aa4dac48a6a service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received event network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:45:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1f95a6c2-3263-4230-930f-190694209aa2 req-828a7d28-3550-4bfa-9fa6-1aa4dac48a6a service nova] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:45:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1f95a6c2-3263-4230-930f-190694209aa2 req-828a7d28-3550-4bfa-9fa6-1aa4dac48a6a service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:45:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1f95a6c2-3263-4230-930f-190694209aa2 req-828a7d28-3550-4bfa-9fa6-1aa4dac48a6a service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:45:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-1f95a6c2-3263-4230-930f-190694209aa2 req-828a7d28-3550-4bfa-9fa6-1aa4dac48a6a service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] No waiting events found dispatching network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:45:42 user nova-compute[75071]: WARNING nova.compute.manager [req-1f95a6c2-3263-4230-930f-190694209aa2 req-828a7d28-3550-4bfa-9fa6-1aa4dac48a6a service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received unexpected event network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 for instance with vm_state active and task_state None.
Dec 05 12:45:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PnNmYyXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:45:44 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:45:44 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:45:44 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b96706e-579d-472b-929a-2629e44bac45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:45:44 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd46d17f-f0a1-40fd-a09a-894770f0f34e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea] added
Dec 05 12:45:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2367b103-ab1c-4e5a-828e-305f23101a7d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[145e79e1-435c-4358-a124-8e8cba9b0355]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PnNmYyXG {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PnNmYyXG" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba87c45-dd39-42ee-b11b-8aaca78eb557]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PnNmYyXG'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3fe5fe-d7ce-464b-b73a-4cc8c174dd88]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3430f5e7-7e11-4c43-80d0-0d3f210c7155]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:45:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:45:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a5375a-446c-4374-af6e-1e68822f548e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea, portal: 172.16.0.220,3260]
Dec 05 12:45:44 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea, portal: 172.16.0.220,3260] successful.
Dec 05 12:45:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4c4ac7-a45a-46ba-bfba-59edaebf275a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5266e2e0-1186-40f5-a572-0c3d89d27f5a]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:45:44 user nova-compute[75071]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea (non-flash)
Dec 05 12:45:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:45:44 user nova-compute[75071]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea (non-flash)
Dec 05 12:45:44 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef6bfe4-9bdf-425d-9658-ed402554612b]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:45:44 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PnNmYyXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:45:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:45:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23938363838396464', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:45:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938363838396464', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:45:45 user nova-compute[75071]: DEBUG nova.objects.instance [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lazy-loading 'flavor' on Instance uuid 52ff4123-828f-43d1-b152-e791c5246fa8 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:45:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:45:45 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:45:45 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:45:45 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:45:45 user nova-compute[75071]:   <serial>e60d22d8-9825-44b2-b1aa-bfb4ecf032ea</serial>
Dec 05 12:45:45 user nova-compute[75071]: </disk>
Dec 05 12:45:45 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:45:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:45:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:45:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] No VIF found with MAC fa:16:3e:30:43:31, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:45:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ed1d28d8-cf62-45d4-a9e8-44dc664046f4 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "52ff4123-828f-43d1-b152-e791c5246fa8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.947s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:45:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Acquiring lock "52ff4123-828f-43d1-b152-e791c5246fa8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:45:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "52ff4123-828f-43d1-b152-e791c5246fa8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:45:47 user nova-compute[75071]: INFO nova.compute.manager [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Detaching volume e60d22d8-9825-44b2-b1aa-bfb4ecf032ea
Dec 05 12:45:47 user nova-compute[75071]: INFO nova.virt.block_device [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Attempting to driver detach volume e60d22d8-9825-44b2-b1aa-bfb4ecf032ea from mountpoint /dev/vdb
Dec 05 12:45:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Attempting to detach device vdb from instance 52ff4123-828f-43d1-b152-e791c5246fa8 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:45:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:45:47 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:45:47 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:45:47 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:45:47 user nova-compute[75071]:   <serial>e60d22d8-9825-44b2-b1aa-bfb4ecf032ea</serial>
Dec 05 12:45:47 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:45:47 user nova-compute[75071]: </disk>
Dec 05 12:45:47 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:45:47 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Successfully detached device vdb from instance 52ff4123-828f-43d1-b152-e791c5246fa8 from the persistent domain config.
Dec 05 12:45:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 52ff4123-828f-43d1-b152-e791c5246fa8 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:45:47 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:45:47 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:45:47 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:45:47 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:45:47 user nova-compute[75071]:   <serial>e60d22d8-9825-44b2-b1aa-bfb4ecf032ea</serial>
Dec 05 12:45:47 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:45:47 user nova-compute[75071]: </disk>
Dec 05 12:45:47 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:45:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 52ff4123-828f-43d1-b152-e791c5246fa8 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:45:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:45:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:02 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:46:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:04 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:46:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:46:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:46:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:46:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:46:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:46:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:06 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:46:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "42776e73-1ef0-4c57-a50a-942f6f4881de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:06 user nova-compute[75071]: INFO nova.compute.manager [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Terminating instance
Dec 05 12:46:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:46:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-d47ee63e-cb43-43d8-b1b1-a1462a716cdd req-0c496c14-311d-437f-b8c5-d3b750eb3c8c service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received event network-vif-unplugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d47ee63e-cb43-43d8-b1b1-a1462a716cdd req-0c496c14-311d-437f-b8c5-d3b750eb3c8c service nova] Acquiring lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d47ee63e-cb43-43d8-b1b1-a1462a716cdd req-0c496c14-311d-437f-b8c5-d3b750eb3c8c service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d47ee63e-cb43-43d8-b1b1-a1462a716cdd req-0c496c14-311d-437f-b8c5-d3b750eb3c8c service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-d47ee63e-cb43-43d8-b1b1-a1462a716cdd req-0c496c14-311d-437f-b8c5-d3b750eb3c8c service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] No waiting events found dispatching network-vif-unplugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-d47ee63e-cb43-43d8-b1b1-a1462a716cdd req-0c496c14-311d-437f-b8c5-d3b750eb3c8c service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received event network-vif-unplugged-3774446d-0014-4060-b722-f3480e92a274 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:07 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Instance destroyed successfully.
Dec 05 12:46:07 user nova-compute[75071]: DEBUG nova.objects.instance [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'resources' on Instance uuid 42776e73-1ef0-4c57-a50a-942f6f4881de {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:30:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-53509066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-53509066',id=32,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:32:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b77a4b1baadd43e1be69eecb1f5370bd',ramdisk_id='',reservation_id='r-jps7gm02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86909184',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:34:07Z,user_data=None,user_id='201cbbb8b3dc4a3aa8164d69c1257489',uuid=42776e73-1ef0-4c57-a50a-942f6f4881de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3774446d-0014-4060-b722-f3480e92a274", "address": "fa:16:3e:c9:ac:48", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3774446d-00", "ovs_interfaceid": "3774446d-0014-4060-b722-f3480e92a274", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converting VIF {"id": "3774446d-0014-4060-b722-f3480e92a274", "address": "fa:16:3e:c9:ac:48", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3774446d-00", "ovs_interfaceid": "3774446d-0014-4060-b722-f3480e92a274", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:ac:48,bridge_name='br-int',has_traffic_filtering=True,id=3774446d-0014-4060-b722-f3480e92a274,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3774446d-00') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG os_vif [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:ac:48,bridge_name='br-int',has_traffic_filtering=True,id=3774446d-0014-4060-b722-f3480e92a274,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3774446d-00') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3774446d-00, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8afc65b8-6b94-4ec5-aa02-f7760f740108) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:46:07 user nova-compute[75071]: INFO os_vif [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:ac:48,bridge_name='br-int',has_traffic_filtering=True,id=3774446d-0014-4060-b722-f3480e92a274,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3774446d-00')
Dec 05 12:46:07 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VbZmcXIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:46:07 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:46:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c848aa-54a2-486a-bb0b-87216f39110d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:46:08 user nova-compute[75071]: No targets found.
Dec 05 12:46:08 user nova-compute[75071]: iSNS:
Dec 05 12:46:08 user nova-compute[75071]: No targets found.
Dec 05 12:46:08 user nova-compute[75071]: STATIC:
Dec 05 12:46:08 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c
Dec 05 12:46:08 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:46:08 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:46:08 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea
Dec 05 12:46:08 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:46:08 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:46:08 user nova-compute[75071]: FIRMWARE:
Dec 05 12:46:08 user nova-compute[75071]: No targets found.
Dec 05 12:46:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:46:08 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:46:08 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e197875-3fdb-4077-996d-16e2ace24379]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cff843-b098-428e-b540-2bfa36eab193]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:46:08 user nova-compute[75071]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea (non-flash)
Dec 05 12:46:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c (non-flash)
Dec 05 12:46:08 user nova-compute[75071]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea (non-flash)
Dec 05 12:46:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f827438f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c'): ({'sdf'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Removing single pathed devices sdf {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaeb241-0411-4481-b089-2055446e198e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e2a041-7117-4339-868c-716c1f0a1be4]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Flushing IO for device /dev/sdf {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 52ff4123-828f-43d1-b152-e791c5246fa8 is timed out.
Dec 05 12:46:08 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Successfully detached device vdb from instance 52ff4123-828f-43d1-b152-e791c5246fa8 from the live domain config.
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed1ecf1-4574-4ad2-ba73-5451e2f8a05d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PnNmYyXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:46:08 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d83a2b-1c0a-46ec-9be6-8d84e5dfcf61]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] SCSI volumes sdf have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2b09b6-c11b-4042-8cd3-09b8437764c6]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab80ef32-0563-4252-bd76-f5a10c129352]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c, portal: 172.16.0.220,3260]
Dec 05 12:46:08 user nova-compute[75071]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c, portal: 172.16.0.220,3260] successful.
Dec 05 12:46:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cdde453-3bd7-4a4e-8e83-cd8a045d3c0c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31da8e3-b47e-48bd-b1b4-170d2515aed2]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] <== disconnect_volume: return (342ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:46:08 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Deleting instance files /opt/stack/data/nova/instances/42776e73-1ef0-4c57-a50a-942f6f4881de_del
Dec 05 12:46:08 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Deletion of /opt/stack/data/nova/instances/42776e73-1ef0-4c57-a50a-942f6f4881de_del complete
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.173s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee7c9d4-f775-41fd-baf7-800755342059]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:46:08 user nova-compute[75071]: No targets found.
Dec 05 12:46:08 user nova-compute[75071]: iSNS:
Dec 05 12:46:08 user nova-compute[75071]: No targets found.
Dec 05 12:46:08 user nova-compute[75071]: STATIC:
Dec 05 12:46:08 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea
Dec 05 12:46:08 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:46:08 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:46:08 user nova-compute[75071]: FIRMWARE:
Dec 05 12:46:08 user nova-compute[75071]: No targets found.
Dec 05 12:46:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:46:08 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:46:08 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbdf4b4-85c0-43bd-ba09-913c894f08f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: INFO nova.compute.manager [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Took 1.38 seconds to destroy the instance on the hypervisor.
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ca5c89-6a15-42b2-b3a1-d0c02bedd7ad]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea (non-flash)
Dec 05 12:46:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea (non-flash)
Dec 05 12:46:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82647760e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65b7354-2a0f-4cab-a5bd-a32c55b8b739]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fefb23f-8bb9-465f-aabd-902260becf37]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e699fed-bda3-4781-ada1-10d0058b66f9]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fa0f9c-7a70-46dd-8ff7-c2cf99e52839]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d69725-e794-41b8-812f-6ac27d13685d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b5a461-18a7-41d5-b7c2-e81a6cdd1f2d]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea, portal: 172.16.0.220,3260]
Dec 05 12:46:08 user nova-compute[75071]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea, portal: 172.16.0.220,3260] successful.
Dec 05 12:46:08 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-a14e5eca-477a-422b-a15b-1747357d1e04 req-7156c348-9f0d-4256-8be4-fd460e5f7553 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received event network-vif-deleted-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:46:08 user nova-compute[75071]: INFO nova.compute.manager [req-a14e5eca-477a-422b-a15b-1747357d1e04 req-7156c348-9f0d-4256-8be4-fd460e5f7553 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Neutron deleted interface 3774446d-0014-4060-b722-f3480e92a274; detaching it from the instance and deleting it from the info cache
Dec 05 12:46:08 user nova-compute[75071]: DEBUG nova.network.neutron [req-a14e5eca-477a-422b-a15b-1747357d1e04 req-7156c348-9f0d-4256-8be4-fd460e5f7553 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:46:08 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:46:08 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:46:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8430MB free_disk=24.860504150390625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e60d22d8-9825-44b2-b1aa-bfb4ecf032ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e809e365-0061-4f98-a9b8-73797455de87]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.681s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] <== disconnect_volume: return (854ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:46:08 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:46:08 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Took 0.63 seconds to deallocate network for instance.
Dec 05 12:46:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-a14e5eca-477a-422b-a15b-1747357d1e04 req-7156c348-9f0d-4256-8be4-fd460e5f7553 service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Detach interface failed, port_id=3774446d-0014-4060-b722-f3480e92a274, reason: Instance 42776e73-1ef0-4c57-a50a-942f6f4881de could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:46:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:46:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 42776e73-1ef0-4c57-a50a-942f6f4881de actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:46:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:46:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 72bb9c85-25b6-4a08-96bf-59881754adea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:46:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 52ff4123-828f-43d1-b152-e791c5246fa8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:46:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:46:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:46:09 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:46:09 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:46:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:46:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-f09960dc-2f54-4706-a9ea-22082a4f3185 req-35e4c4d1-57ed-4d06-b00f-a4f71b9a754b service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received event network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:46:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f09960dc-2f54-4706-a9ea-22082a4f3185 req-35e4c4d1-57ed-4d06-b00f-a4f71b9a754b service nova] Acquiring lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f09960dc-2f54-4706-a9ea-22082a4f3185 req-35e4c4d1-57ed-4d06-b00f-a4f71b9a754b service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f09960dc-2f54-4706-a9ea-22082a4f3185 req-35e4c4d1-57ed-4d06-b00f-a4f71b9a754b service nova] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-f09960dc-2f54-4706-a9ea-22082a4f3185 req-35e4c4d1-57ed-4d06-b00f-a4f71b9a754b service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] No waiting events found dispatching network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:46:09 user nova-compute[75071]: WARNING nova.compute.manager [req-f09960dc-2f54-4706-a9ea-22082a4f3185 req-35e4c4d1-57ed-4d06-b00f-a4f71b9a754b service nova] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Received unexpected event network-vif-plugged-3774446d-0014-4060-b722-f3480e92a274 for instance with vm_state active and task_state deleting.
Dec 05 12:46:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:46:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:46:12 user nova-compute[75071]: INFO nova.compute.manager [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 42776e73-1ef0-4c57-a50a-942f6f4881de] Took 3.53 seconds to detach 1 volumes for instance.
Dec 05 12:46:12 user nova-compute[75071]: DEBUG nova.objects.instance [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lazy-loading 'flavor' on Instance uuid 52ff4123-828f-43d1-b152-e791c5246fa8 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:46:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-bb10ea87-d7b4-49b6-b850-25908e801e51 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "52ff4123-828f-43d1-b152-e791c5246fa8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.011s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:12 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:46:12 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:46:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:12 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Deleted allocations for instance 42776e73-1ef0-4c57-a50a-942f6f4881de
Dec 05 12:46:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-68b05473-a935-4dd1-aa0c-ac9ebc71ddaf tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "42776e73-1ef0-4c57-a50a-942f6f4881de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.924s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:16 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:46:16 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:46:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:46:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:46:16 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:46:17 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Updating instance_info_cache with network_info: [{"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:46:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:46:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:46:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:24 user nova-compute[75071]: INFO nova.compute.manager [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Terminating instance
Dec 05 12:46:24 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-701b705a-53f1-472a-b492-c587d6513480 req-1c4fcb52-3184-4e4f-a4d6-b6fdfd37810d service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Received event network-vif-unplugged-7bb59ccd-77fa-411d-a777-05117b9bc509 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-701b705a-53f1-472a-b492-c587d6513480 req-1c4fcb52-3184-4e4f-a4d6-b6fdfd37810d service nova] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-701b705a-53f1-472a-b492-c587d6513480 req-1c4fcb52-3184-4e4f-a4d6-b6fdfd37810d service nova] Lock "72bb9c85-25b6-4a08-96bf-59881754adea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-701b705a-53f1-472a-b492-c587d6513480 req-1c4fcb52-3184-4e4f-a4d6-b6fdfd37810d service nova] Lock "72bb9c85-25b6-4a08-96bf-59881754adea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-701b705a-53f1-472a-b492-c587d6513480 req-1c4fcb52-3184-4e4f-a4d6-b6fdfd37810d service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] No waiting events found dispatching network-vif-unplugged-7bb59ccd-77fa-411d-a777-05117b9bc509 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG nova.compute.manager [req-701b705a-53f1-472a-b492-c587d6513480 req-1c4fcb52-3184-4e4f-a4d6-b6fdfd37810d service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Received event network-vif-unplugged-7bb59ccd-77fa-411d-a777-05117b9bc509 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:46:24 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Instance destroyed successfully.
Dec 05 12:46:24 user nova-compute[75071]: DEBUG nova.objects.instance [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lazy-loading 'resources' on Instance uuid 72bb9c85-25b6-4a08-96bf-59881754adea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:39:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-265891495',display_name='tempest-SnapshotDataIntegrityTests-server-265891495',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-265891495',id=42,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAIdk45xKiV3UXoHNqLtilGBlZthWf4fYGGTJSKxDm1ljOk55sR7jfkcnBul3pBL97KDLn51Pwhuqy/ocBjWXOdjF8U5N5/NmCiHGakoL6rQleu1tSsFKagBoMoNtTGYlQ==',key_name='tempest-keypair-539634521',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:39:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9aa06b8affa40c483794bb096c9fdeb',ramdisk_id='',reservation_id='r-fcyc67n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1051142258',owner_user_name='tempest-SnapshotDataIntegrityTests-1051142258-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4450515c258b48b585fd4d6ac0d46987',uuid=72bb9c85-25b6-4a08-96bf-59881754adea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bb59ccd-77fa-411d-a777-05117b9bc509", "address": "fa:16:3e:b6:47:30", "network": {"id": "d81e562f-84e3-4bb7-ac06-dbed56646c43", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206547008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9aa06b8affa40c483794bb096c9fdeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb59ccd-77", "ovs_interfaceid": "7bb59ccd-77fa-411d-a777-05117b9bc509", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Converting VIF {"id": "7bb59ccd-77fa-411d-a777-05117b9bc509", "address": "fa:16:3e:b6:47:30", "network": {"id": "d81e562f-84e3-4bb7-ac06-dbed56646c43", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-206547008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9aa06b8affa40c483794bb096c9fdeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bb59ccd-77", "ovs_interfaceid": "7bb59ccd-77fa-411d-a777-05117b9bc509", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:47:30,bridge_name='br-int',has_traffic_filtering=True,id=7bb59ccd-77fa-411d-a777-05117b9bc509,network=Network(d81e562f-84e3-4bb7-ac06-dbed56646c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb59ccd-77') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG os_vif [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:47:30,bridge_name='br-int',has_traffic_filtering=True,id=7bb59ccd-77fa-411d-a777-05117b9bc509,network=Network(d81e562f-84e3-4bb7-ac06-dbed56646c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb59ccd-77') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bb59ccd-77, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e1fe8d5-4d6b-43a1-8abf-e3b92cdeb2b0) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:46:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:46:24 user nova-compute[75071]: INFO os_vif [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:47:30,bridge_name='br-int',has_traffic_filtering=True,id=7bb59ccd-77fa-411d-a777-05117b9bc509,network=Network(d81e562f-84e3-4bb7-ac06-dbed56646c43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bb59ccd-77')
Dec 05 12:46:24 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Deleting instance files /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea_del
Dec 05 12:46:24 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Deletion of /opt/stack/data/nova/instances/72bb9c85-25b6-4a08-96bf-59881754adea_del complete
Dec 05 12:46:25 user nova-compute[75071]: INFO nova.compute.manager [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Took 0.89 seconds to destroy the instance on the hypervisor.
Dec 05 12:46:25 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:46:25 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:46:25 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:46:25 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:46:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-8033bf73-217f-4280-8d5a-c5168028a0a5 req-9113e496-eb8c-4a2e-8d44-bbfd9dbcfde4 service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Received event network-vif-deleted-7bb59ccd-77fa-411d-a777-05117b9bc509 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:46:25 user nova-compute[75071]: INFO nova.compute.manager [req-8033bf73-217f-4280-8d5a-c5168028a0a5 req-9113e496-eb8c-4a2e-8d44-bbfd9dbcfde4 service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Neutron deleted interface 7bb59ccd-77fa-411d-a777-05117b9bc509; detaching it from the instance and deleting it from the info cache
Dec 05 12:46:25 user nova-compute[75071]: DEBUG nova.network.neutron [req-8033bf73-217f-4280-8d5a-c5168028a0a5 req-9113e496-eb8c-4a2e-8d44-bbfd9dbcfde4 service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:46:25 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Took 0.71 seconds to deallocate network for instance.
Dec 05 12:46:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-8033bf73-217f-4280-8d5a-c5168028a0a5 req-9113e496-eb8c-4a2e-8d44-bbfd9dbcfde4 service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Detach interface failed, port_id=7bb59ccd-77fa-411d-a777-05117b9bc509, reason: Instance 72bb9c85-25b6-4a08-96bf-59881754adea could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:46:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:25 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:46:26 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:46:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:26 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Deleted allocations for instance 72bb9c85-25b6-4a08-96bf-59881754adea
Dec 05 12:46:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9839f2ad-d7af-4a0b-8580-5d391b7ccf43 tempest-SnapshotDataIntegrityTests-1051142258 tempest-SnapshotDataIntegrityTests-1051142258-project-member] Lock "72bb9c85-25b6-4a08-96bf-59881754adea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.044s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-3235a143-5ded-40d4-b0a4-e3eee1324748 req-a392c9c2-c344-4d1f-96d0-0634e391d6f9 service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Received event network-vif-plugged-7bb59ccd-77fa-411d-a777-05117b9bc509 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:46:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3235a143-5ded-40d4-b0a4-e3eee1324748 req-a392c9c2-c344-4d1f-96d0-0634e391d6f9 service nova] Acquiring lock "72bb9c85-25b6-4a08-96bf-59881754adea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3235a143-5ded-40d4-b0a4-e3eee1324748 req-a392c9c2-c344-4d1f-96d0-0634e391d6f9 service nova] Lock "72bb9c85-25b6-4a08-96bf-59881754adea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3235a143-5ded-40d4-b0a4-e3eee1324748 req-a392c9c2-c344-4d1f-96d0-0634e391d6f9 service nova] Lock "72bb9c85-25b6-4a08-96bf-59881754adea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:26 user nova-compute[75071]: DEBUG nova.compute.manager [req-3235a143-5ded-40d4-b0a4-e3eee1324748 req-a392c9c2-c344-4d1f-96d0-0634e391d6f9 service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] No waiting events found dispatching network-vif-plugged-7bb59ccd-77fa-411d-a777-05117b9bc509 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:46:26 user nova-compute[75071]: WARNING nova.compute.manager [req-3235a143-5ded-40d4-b0a4-e3eee1324748 req-a392c9c2-c344-4d1f-96d0-0634e391d6f9 service nova] [instance: 72bb9c85-25b6-4a08-96bf-59881754adea] Received unexpected event network-vif-plugged-7bb59ccd-77fa-411d-a777-05117b9bc509 for instance with vm_state deleted and task_state None.
Dec 05 12:46:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:46:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:46:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Acquiring lock "52ff4123-828f-43d1-b152-e791c5246fa8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "52ff4123-828f-43d1-b152-e791c5246fa8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Acquiring lock "52ff4123-828f-43d1-b152-e791c5246fa8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "52ff4123-828f-43d1-b152-e791c5246fa8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "52ff4123-828f-43d1-b152-e791c5246fa8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:42 user nova-compute[75071]: INFO nova.compute.manager [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Terminating instance
Dec 05 12:46:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:46:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-13d57b65-67af-45b7-8f18-e9dfe1b746a3 req-b6a97c43-315f-4ed6-a66e-d90b1ab7ea71 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Received event network-vif-unplugged-78015c9f-5f8c-48f1-bba3-4159569e0613 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:46:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-13d57b65-67af-45b7-8f18-e9dfe1b746a3 req-b6a97c43-315f-4ed6-a66e-d90b1ab7ea71 service nova] Acquiring lock "52ff4123-828f-43d1-b152-e791c5246fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-13d57b65-67af-45b7-8f18-e9dfe1b746a3 req-b6a97c43-315f-4ed6-a66e-d90b1ab7ea71 service nova] Lock "52ff4123-828f-43d1-b152-e791c5246fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-13d57b65-67af-45b7-8f18-e9dfe1b746a3 req-b6a97c43-315f-4ed6-a66e-d90b1ab7ea71 service nova] Lock "52ff4123-828f-43d1-b152-e791c5246fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-13d57b65-67af-45b7-8f18-e9dfe1b746a3 req-b6a97c43-315f-4ed6-a66e-d90b1ab7ea71 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] No waiting events found dispatching network-vif-unplugged-78015c9f-5f8c-48f1-bba3-4159569e0613 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:46:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-13d57b65-67af-45b7-8f18-e9dfe1b746a3 req-b6a97c43-315f-4ed6-a66e-d90b1ab7ea71 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Received event network-vif-unplugged-78015c9f-5f8c-48f1-bba3-4159569e0613 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:46:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Instance destroyed successfully.
Dec 05 12:46:43 user nova-compute[75071]: DEBUG nova.objects.instance [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lazy-loading 'resources' on Instance uuid 52ff4123-828f-43d1-b152-e791c5246fa8 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:46:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-766389935',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-766389935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7663899',id=43,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOVDE7Oi95BSa3dALH8Hcq9jf1c8hL0zu6uQpPOehyPM8f45LnY9+GyRcH9iG8KSLx/2SYNDSlrWPk351ZUAaHCoR0h9JhjPpUy+HNXpNGXOKBml74MdNP7BqH4NOQM69A==',key_name='tempest-keypair-1431934925',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:43:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0a80672aa2240ac92bd2778cf23dcac',ramdisk_id='',reservation_id='r-fui1sy8l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1284190924',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:43:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='62aa364a59b14c97a8ef58a1e019b496',uuid=52ff4123-828f-43d1-b152-e791c5246fa8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78015c9f-5f8c-48f1-bba3-4159569e0613", "address": "fa:16:3e:30:43:31", "network": {"id": "f55368ee-ff6e-48a6-8464-24657f475faf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-806121992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a80672aa2240ac92bd2778cf23dcac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78015c9f-5f", "ovs_interfaceid": "78015c9f-5f8c-48f1-bba3-4159569e0613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:46:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Converting VIF {"id": "78015c9f-5f8c-48f1-bba3-4159569e0613", "address": "fa:16:3e:30:43:31", "network": {"id": "f55368ee-ff6e-48a6-8464-24657f475faf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-806121992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0a80672aa2240ac92bd2778cf23dcac", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78015c9f-5f", "ovs_interfaceid": "78015c9f-5f8c-48f1-bba3-4159569e0613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:46:43 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:43:31,bridge_name='br-int',has_traffic_filtering=True,id=78015c9f-5f8c-48f1-bba3-4159569e0613,network=Network(f55368ee-ff6e-48a6-8464-24657f475faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78015c9f-5f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:46:43 user nova-compute[75071]: DEBUG os_vif [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:43:31,bridge_name='br-int',has_traffic_filtering=True,id=78015c9f-5f8c-48f1-bba3-4159569e0613,network=Network(f55368ee-ff6e-48a6-8464-24657f475faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78015c9f-5f') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:46:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78015c9f-5f, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:46:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9edccd9f-9985-4fc1-a236-eb45e7a52ae0) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:46:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:46:43 user nova-compute[75071]: INFO os_vif [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:43:31,bridge_name='br-int',has_traffic_filtering=True,id=78015c9f-5f8c-48f1-bba3-4159569e0613,network=Network(f55368ee-ff6e-48a6-8464-24657f475faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78015c9f-5f')
Dec 05 12:46:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Deleting instance files /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8_del
Dec 05 12:46:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Deletion of /opt/stack/data/nova/instances/52ff4123-828f-43d1-b152-e791c5246fa8_del complete
Dec 05 12:46:43 user nova-compute[75071]: INFO nova.compute.manager [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 05 12:46:43 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:46:43 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:46:43 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:46:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:43 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:46:43 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Took 0.77 seconds to deallocate network for instance.
Dec 05 12:46:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-9fff8bce-08c2-4270-b852-5d2ae7c5a933 req-2a15b816-00ec-4210-a110-03caf47139c6 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Received event network-vif-deleted-78015c9f-5f8c-48f1-bba3-4159569e0613 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:46:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:44 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:46:44 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:46:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:44 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Deleted allocations for instance 52ff4123-828f-43d1-b152-e791c5246fa8
Dec 05 12:46:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8563f2d7-5451-4fdc-97e4-c7f595d48bc9 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924 tempest-TestServerVolumeAttachScenarioOldVersion-1284190924-project-member] Lock "52ff4123-828f-43d1-b152-e791c5246fa8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.042s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-4a054437-653f-4164-8a51-2902e5622289 req-5d7acaf7-ea43-4419-a3d8-b17fe65aa279 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Received event network-vif-plugged-78015c9f-5f8c-48f1-bba3-4159569e0613 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:46:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4a054437-653f-4164-8a51-2902e5622289 req-5d7acaf7-ea43-4419-a3d8-b17fe65aa279 service nova] Acquiring lock "52ff4123-828f-43d1-b152-e791c5246fa8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4a054437-653f-4164-8a51-2902e5622289 req-5d7acaf7-ea43-4419-a3d8-b17fe65aa279 service nova] Lock "52ff4123-828f-43d1-b152-e791c5246fa8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-4a054437-653f-4164-8a51-2902e5622289 req-5d7acaf7-ea43-4419-a3d8-b17fe65aa279 service nova] Lock "52ff4123-828f-43d1-b152-e791c5246fa8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-4a054437-653f-4164-8a51-2902e5622289 req-5d7acaf7-ea43-4419-a3d8-b17fe65aa279 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] No waiting events found dispatching network-vif-plugged-78015c9f-5f8c-48f1-bba3-4159569e0613 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:46:44 user nova-compute[75071]: WARNING nova.compute.manager [req-4a054437-653f-4164-8a51-2902e5622289 req-5d7acaf7-ea43-4419-a3d8-b17fe65aa279 service nova] [instance: 52ff4123-828f-43d1-b152-e791c5246fa8] Received unexpected event network-vif-plugged-78015c9f-5f8c-48f1-bba3-4159569e0613 for instance with vm_state deleted and task_state None.
Dec 05 12:46:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:46:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:46:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:46:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:46:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:57 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:57 user nova-compute[75071]: INFO nova.compute.manager [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Terminating instance
Dec 05 12:46:57 user nova-compute[75071]: DEBUG nova.compute.manager [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:46:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-dde8248d-f2fa-4f08-a44d-8c3d74596834 req-4b894d97-93c0-494a-ae4d-8cb14a4e2a76 service nova] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Received event network-vif-unplugged-cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dde8248d-f2fa-4f08-a44d-8c3d74596834 req-4b894d97-93c0-494a-ae4d-8cb14a4e2a76 service nova] Acquiring lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dde8248d-f2fa-4f08-a44d-8c3d74596834 req-4b894d97-93c0-494a-ae4d-8cb14a4e2a76 service nova] Lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dde8248d-f2fa-4f08-a44d-8c3d74596834 req-4b894d97-93c0-494a-ae4d-8cb14a4e2a76 service nova] Lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-dde8248d-f2fa-4f08-a44d-8c3d74596834 req-4b894d97-93c0-494a-ae4d-8cb14a4e2a76 service nova] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] No waiting events found dispatching network-vif-unplugged-cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG nova.compute.manager [req-dde8248d-f2fa-4f08-a44d-8c3d74596834 req-4b894d97-93c0-494a-ae4d-8cb14a4e2a76 service nova] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Received event network-vif-unplugged-cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Instance destroyed successfully.
Dec 05 12:46:58 user nova-compute[75071]: DEBUG nova.objects.instance [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lazy-loading 'resources' on Instance uuid 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:27:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-179947841',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-179947841',id=26,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:27:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b77a4b1baadd43e1be69eecb1f5370bd',ramdisk_id='',reservation_id='r-x7rdhfor',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-86909184',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:29:18Z,user_data=None,user_id='201cbbb8b3dc4a3aa8164d69c1257489',uuid=30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "address": "fa:16:3e:ee:3d:ba", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfb6b0b-8b", "ovs_interfaceid": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converting VIF {"id": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "address": "fa:16:3e:ee:3d:ba", "network": {"id": "11b54168-9256-42f5-8ee1-69ee75df93bb", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1675177922-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b77a4b1baadd43e1be69eecb1f5370bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdfb6b0b-8b", "ovs_interfaceid": "cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:3d:ba,bridge_name='br-int',has_traffic_filtering=True,id=cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfb6b0b-8b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG os_vif [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:3d:ba,bridge_name='br-int',has_traffic_filtering=True,id=cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfb6b0b-8b') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcdfb6b0b-8b, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=165670b8-7c77-484e-84ea-af15363476dc) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:58 user nova-compute[75071]: INFO os_vif [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:3d:ba,bridge_name='br-int',has_traffic_filtering=True,id=cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c,network=Network(11b54168-9256-42f5-8ee1-69ee75df93bb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdfb6b0b-8b')
Dec 05 12:46:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Deleting instance files /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c_del
Dec 05 12:46:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Deletion of /opt/stack/data/nova/instances/30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c_del complete
Dec 05 12:46:58 user nova-compute[75071]: INFO nova.compute.manager [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Took 0.85 seconds to destroy the instance on the hypervisor.
Dec 05 12:46:58 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:46:58 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:46:59 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:46:59 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Took 0.77 seconds to deallocate network for instance.
Dec 05 12:46:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:46:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:46:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:46:59 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:46:59 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:46:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:46:59 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Deleted allocations for instance 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c
Dec 05 12:46:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-f62eabfd-9134-4b00-aec8-129b496d63a2 tempest-ServerBootFromVolumeStableRescueTest-86909184 tempest-ServerBootFromVolumeStableRescueTest-86909184-project-member] Lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.961s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:47:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-2efabb52-87b8-447c-9885-89bd3972dd91 req-1a1744d7-3742-438c-a0ca-3174f10a0931 service nova] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Received event network-vif-plugged-cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:47:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2efabb52-87b8-447c-9885-89bd3972dd91 req-1a1744d7-3742-438c-a0ca-3174f10a0931 service nova] Acquiring lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:47:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2efabb52-87b8-447c-9885-89bd3972dd91 req-1a1744d7-3742-438c-a0ca-3174f10a0931 service nova] Lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:47:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2efabb52-87b8-447c-9885-89bd3972dd91 req-1a1744d7-3742-438c-a0ca-3174f10a0931 service nova] Lock "30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:47:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-2efabb52-87b8-447c-9885-89bd3972dd91 req-1a1744d7-3742-438c-a0ca-3174f10a0931 service nova] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] No waiting events found dispatching network-vif-plugged-cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:47:00 user nova-compute[75071]: WARNING nova.compute.manager [req-2efabb52-87b8-447c-9885-89bd3972dd91 req-1a1744d7-3742-438c-a0ca-3174f10a0931 service nova] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Received unexpected event network-vif-plugged-cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c for instance with vm_state deleted and task_state None.
Dec 05 12:47:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-2efabb52-87b8-447c-9885-89bd3972dd91 req-1a1744d7-3742-438c-a0ca-3174f10a0931 service nova] [instance: 30d0ab89-4d36-4c0d-9e3e-f0b5a8b41d9c] Received event network-vif-deleted-cdfb6b0b-8bf6-4e94-bbf0-d264c9f4013c {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:47:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:02 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:47:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:04 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:47:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:47:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:47:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:47:06 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:07 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:47:07 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:47:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:08 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:47:08 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:47:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:47:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:47:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:47:08 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:47:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:47:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:47:08 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:47:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:47:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:09 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:47:09 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:47:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8811MB free_disk=25.030067443847656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:47:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:47:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:47:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:47:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:47:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:47:09 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:47:09 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:47:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:47:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:47:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:47:17 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:47:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:47:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 12:47:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "51d61988-adc9-41d1-a674-5e77d6f7f407" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:47:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "51d61988-adc9-41d1-a674-5e77d6f7f407" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:47:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:47:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:47:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:47:18 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:47:18 user nova-compute[75071]: INFO nova.compute.claims [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Claim successful on node user
Dec 05 12:47:18 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:47:18 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:47:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:47:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:47:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:47:18 user nova-compute[75071]: DEBUG nova.network.neutron [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:47:18 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:47:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:47:19 user nova-compute[75071]: INFO nova.virt.block_device [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Booting with volume snapshot dec096f2-758f-4f88-9231-04d612b2f406 at /dev/vda
Dec 05 12:47:19 user nova-compute[75071]: DEBUG nova.policy [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c40b4872327a40968c5e7a5f89cd137a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87e18fa15d84a858a5e6c8306589285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:47:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Successfully created port: 0d9d7661-13cf-42bd-b712-d6c12e5a3675 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:47:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Successfully updated port: 0d9d7661-13cf-42bd-b712-d6c12e5a3675 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:47:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "refresh_cache-51d61988-adc9-41d1-a674-5e77d6f7f407" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:47:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquired lock "refresh_cache-51d61988-adc9-41d1-a674-5e77d6f7f407" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:47:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:47:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-6f6c0539-857e-47c7-8ac8-d75ec5d77738 req-beb05399-0925-4dc0-a6ff-b9309bee4688 service nova] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Received event network-changed-0d9d7661-13cf-42bd-b712-d6c12e5a3675 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:47:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-6f6c0539-857e-47c7-8ac8-d75ec5d77738 req-beb05399-0925-4dc0-a6ff-b9309bee4688 service nova] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Refreshing instance network info cache due to event network-changed-0d9d7661-13cf-42bd-b712-d6c12e5a3675. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:47:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6f6c0539-857e-47c7-8ac8-d75ec5d77738 req-beb05399-0925-4dc0-a6ff-b9309bee4688 service nova] Acquiring lock "refresh_cache-51d61988-adc9-41d1-a674-5e77d6f7f407" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:47:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:47:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Updating instance_info_cache with network_info: [{"id": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "address": "fa:16:3e:97:0c:8c", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d7661-13", "ovs_interfaceid": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:47:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Releasing lock "refresh_cache-51d61988-adc9-41d1-a674-5e77d6f7f407" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:47:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Instance network_info: |[{"id": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "address": "fa:16:3e:97:0c:8c", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d7661-13", "ovs_interfaceid": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:47:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6f6c0539-857e-47c7-8ac8-d75ec5d77738 req-beb05399-0925-4dc0-a6ff-b9309bee4688 service nova] Acquired lock "refresh_cache-51d61988-adc9-41d1-a674-5e77d6f7f407" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:47:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-6f6c0539-857e-47c7-8ac8-d75ec5d77738 req-beb05399-0925-4dc0-a6ff-b9309bee4688 service nova] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Refreshing network info cache for port 0d9d7661-13cf-42bd-b712-d6c12e5a3675 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:47:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-6f6c0539-857e-47c7-8ac8-d75ec5d77738 req-beb05399-0925-4dc0-a6ff-b9309bee4688 service nova] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Updated VIF entry in instance network info cache for port 0d9d7661-13cf-42bd-b712-d6c12e5a3675. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:47:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-6f6c0539-857e-47c7-8ac8-d75ec5d77738 req-beb05399-0925-4dc0-a6ff-b9309bee4688 service nova] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Updating instance_info_cache with network_info: [{"id": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "address": "fa:16:3e:97:0c:8c", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d7661-13", "ovs_interfaceid": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:47:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-6f6c0539-857e-47c7-8ac8-d75ec5d77738 req-beb05399-0925-4dc0-a6ff-b9309bee4688 service nova] Releasing lock "refresh_cache-51d61988-adc9-41d1-a674-5e77d6f7f407" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:47:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG os_brick.utils [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb8047e-200c-4133-9cad-dfbbf6f0115e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e36144-b3b4-4242-9765-4931fb019d67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0343ed83-4af0-4c4f-b5f2-a00a15877a86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[87366d13-428a-4616-b947-66b46fae54a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:47:24 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:47:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[57371bc9-33c1-403c-a382-eac2e7655bdb]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG os_brick.utils [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:47:24 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Updating existing volume attachment record: 4c2e5099-e2e4-4357-b9b4-65be2dfdd7ee {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:47:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:47:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:47:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:47:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:47:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:47:28 user nova-compute[75071]: INFO nova.compute.manager [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Terminating instance
Dec 05 12:47:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:47:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-d4b6d15e-172c-44f0-88b7-aa83b29779c1 req-4bb60a9e-eb6a-4e19-a227-5e1d173e9b72 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received event network-vif-unplugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:47:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d4b6d15e-172c-44f0-88b7-aa83b29779c1 req-4bb60a9e-eb6a-4e19-a227-5e1d173e9b72 service nova] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:47:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d4b6d15e-172c-44f0-88b7-aa83b29779c1 req-4bb60a9e-eb6a-4e19-a227-5e1d173e9b72 service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:47:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d4b6d15e-172c-44f0-88b7-aa83b29779c1 req-4bb60a9e-eb6a-4e19-a227-5e1d173e9b72 service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:47:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-d4b6d15e-172c-44f0-88b7-aa83b29779c1 req-4bb60a9e-eb6a-4e19-a227-5e1d173e9b72 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] No waiting events found dispatching network-vif-unplugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:47:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-d4b6d15e-172c-44f0-88b7-aa83b29779c1 req-4bb60a9e-eb6a-4e19-a227-5e1d173e9b72 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received event network-vif-unplugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:47:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Instance destroyed successfully.
Dec 05 12:47:29 user nova-compute[75071]: DEBUG nova.objects.instance [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'resources' on Instance uuid 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:47:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2023774332',display_name='tempest-AttachVolumeTestJSON-server-2023774332',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2023774332',id=39,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOMX/EZQmXhh7SdXzCFyRhmWDCDnYUHKgoB5uNuCbmikXutEQOOyGZ4O4+WzrfJeqIXgNW/+y2MaSiDfRCdQEgi/HUIV4qPam6B1OlLSXl5XEVzQ3IxLyJkjekI/XzLYg==',key_name='tempest-keypair-1505168977',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:37:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9640f3ad175948f59ba184167e4bf5a9',ramdisk_id='',reservation_id='r-er01om00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-660715611',owner_user_name='tempest-AttachVolumeTestJSON-660715611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:45:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b2ab4b19a9b4ce397ffa1cc279e26ac',uuid=1c4abc24-1295-4dd3-9fc4-8e8ac304fabf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:47:29 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converting VIF {"id": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "address": "fa:16:3e:3e:4e:da", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde4a3fbc-83", "ovs_interfaceid": "de4a3fbc-8399-45f2-9027-ec80fbaa1077", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:47:29 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:47:29 user nova-compute[75071]: DEBUG os_vif [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:47:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde4a3fbc-83, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:47:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:47:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3e2c5b3-750d-4235-8cc6-b785b3f44c75) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:47:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:47:29 user nova-compute[75071]: INFO os_vif [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:4e:da,bridge_name='br-int',has_traffic_filtering=True,id=de4a3fbc-8399-45f2-9027-ec80fbaa1077,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde4a3fbc-83')
Dec 05 12:47:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Deleting instance files /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf_del
Dec 05 12:47:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Deletion of /opt/stack/data/nova/instances/1c4abc24-1295-4dd3-9fc4-8e8ac304fabf_del complete
Dec 05 12:47:29 user nova-compute[75071]: INFO nova.compute.manager [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 05 12:47:29 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:47:29 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:47:29 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:47:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:30 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:47:30 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Took 0.79 seconds to deallocate network for instance.
Dec 05 12:47:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:47:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:47:30 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:47:30 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:47:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:47:30 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Deleted allocations for instance 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf
Dec 05 12:47:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9b21688a-51e3-4ac7-8cdb-3d9f884ff930 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.024s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:47:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-76c5af91-f0cd-42c2-8bab-f74fc47f9371 req-92f923c2-f645-4bb1-9dd6-ba4f7b502231 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received event network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:47:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-76c5af91-f0cd-42c2-8bab-f74fc47f9371 req-92f923c2-f645-4bb1-9dd6-ba4f7b502231 service nova] Acquiring lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:47:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-76c5af91-f0cd-42c2-8bab-f74fc47f9371 req-92f923c2-f645-4bb1-9dd6-ba4f7b502231 service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:47:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-76c5af91-f0cd-42c2-8bab-f74fc47f9371 req-92f923c2-f645-4bb1-9dd6-ba4f7b502231 service nova] Lock "1c4abc24-1295-4dd3-9fc4-8e8ac304fabf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:47:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-76c5af91-f0cd-42c2-8bab-f74fc47f9371 req-92f923c2-f645-4bb1-9dd6-ba4f7b502231 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] No waiting events found dispatching network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:47:30 user nova-compute[75071]: WARNING nova.compute.manager [req-76c5af91-f0cd-42c2-8bab-f74fc47f9371 req-92f923c2-f645-4bb1-9dd6-ba4f7b502231 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received unexpected event network-vif-plugged-de4a3fbc-8399-45f2-9027-ec80fbaa1077 for instance with vm_state deleted and task_state None.
Dec 05 12:47:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-76c5af91-f0cd-42c2-8bab-f74fc47f9371 req-92f923c2-f645-4bb1-9dd6-ba4f7b502231 service nova] [instance: 1c4abc24-1295-4dd3-9fc4-8e8ac304fabf] Received event network-vif-deleted-de4a3fbc-8399-45f2-9027-ec80fbaa1077 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:47:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:47:37 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Creating image(s)
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Ensure instance console log exists: /opt/stack/data/nova/instances/51d61988-adc9-41d1-a674-5e77d6f7f407/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Start _get_guest_xml network_info=[{"id": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "address": "fa:16:3e:97:0c:8c", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d7661-13", "ovs_interfaceid": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '4c2e5099-e2e4-4357-b9b4-65be2dfdd7ee', 'device_type': 'disk', 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwbWdYpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '51d61988-adc9-41d1-a674-5e77d6f7f407', 'attached_at': '', 'detached_at': '', 'volume_id': '9f2541c1-794b-4c89-91f7-e0dfb3a3317c', 'serial': '9f2541c1-794b-4c89-91f7-e0dfb3a3317c'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:47:37 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:47:37 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwbWdYpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:47:37 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:47:37 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:47:37 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d18481-5987-46ab-b36b-ce7919b99886]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:47:37 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddfe9d7-ad92-43cf-b8d4-9c85aec36623]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c] added
Dec 05 12:47:37 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[827fa2ed-7672-4994-a7d6-1a2267d9ef8a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecd31f9-16e4-49cb-af19-52c694472370]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FwbWdYpq {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FwbWdYpq" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[853ccd05-84a8-48d5-bf09-5df83248cc7d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FwbWdYpq'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ef8b37-e039-4fc9-ba8b-5c6cc21fb03f]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5092a96-056d-4e27-828e-e75d34f66c74]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 12:47:37 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 12:47:37 user nova-compute[75071]:  {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:47:37 user nova-compute[75071]: WARNING os_brick.initiator.connectors.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 12:47:37 user nova-compute[75071]: 
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0906e65b-e521-44b9-a4fb-1e0d9712301f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c, portal: 172.16.0.220,3260]
Dec 05 12:47:37 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c, portal: 172.16.0.220,3260] successful.
Dec 05 12:47:37 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adb9c90-4be0-41bf-9f59-a70e8625a86c]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3277d5-6289-4958-903c-338d0caeabdd]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c (non-flash)
Dec 05 12:47:37 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c (non-flash)
Dec 05 12:47:37 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc60ba95-77c2-4710-89e0-23a604649f08]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:47:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwbWdYpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23730653465383037', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730653465383037', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-845852471',display_name='tempest-TestVolumeBootPattern-server-845852471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-845852471',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e87e18fa15d84a858a5e6c8306589285',ramdisk_id='',reservation_id='r-3kwei0f8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2021686022',owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:47:19Z,user_data=None,user_id='c40b4872327a40968c5e7a5f89cd137a',uuid=51d61988-adc9-41d1-a674-5e77d6f7f407,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "address": "fa:16:3e:97:0c:8c", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d7661-13", "ovs_interfaceid": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converting VIF {"id": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "address": "fa:16:3e:97:0c:8c", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d7661-13", "ovs_interfaceid": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:0c:8c,bridge_name='br-int',has_traffic_filtering=True,id=0d9d7661-13cf-42bd-b712-d6c12e5a3675,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9d7661-13') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG nova.objects.instance [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lazy-loading 'pci_devices' on Instance uuid 51d61988-adc9-41d1-a674-5e77d6f7f407 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:47:38 user nova-compute[75071]:   <uuid>51d61988-adc9-41d1-a674-5e77d6f7f407</uuid>
Dec 05 12:47:38 user nova-compute[75071]:   <name>instance-0000002c</name>
Dec 05 12:47:38 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:47:38 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:47:38 user nova-compute[75071]:   <metadata>
Dec 05 12:47:38 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:47:38 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:47:38 user nova-compute[75071]:       <nova:name>tempest-TestVolumeBootPattern-server-845852471</nova:name>
Dec 05 12:47:38 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:47:37</nova:creationTime>
Dec 05 12:47:38 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:47:38 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:47:38 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:47:38 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:47:38 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:47:38 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:47:38 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:47:38 user nova-compute[75071]:       <nova:owner>
Dec 05 12:47:38 user nova-compute[75071]:         <nova:user uuid="c40b4872327a40968c5e7a5f89cd137a">tempest-TestVolumeBootPattern-2021686022-project-member</nova:user>
Dec 05 12:47:38 user nova-compute[75071]:         <nova:project uuid="e87e18fa15d84a858a5e6c8306589285">tempest-TestVolumeBootPattern-2021686022</nova:project>
Dec 05 12:47:38 user nova-compute[75071]:       </nova:owner>
Dec 05 12:47:38 user nova-compute[75071]:       <nova:ports>
Dec 05 12:47:38 user nova-compute[75071]:         <nova:port uuid="0d9d7661-13cf-42bd-b712-d6c12e5a3675">
Dec 05 12:47:38 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 12:47:38 user nova-compute[75071]:         </nova:port>
Dec 05 12:47:38 user nova-compute[75071]:       </nova:ports>
Dec 05 12:47:38 user nova-compute[75071]:     </nova:instance>
Dec 05 12:47:38 user nova-compute[75071]:   </metadata>
Dec 05 12:47:38 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:47:38 user nova-compute[75071]:     <system>
Dec 05 12:47:38 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:47:38 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:47:38 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:47:38 user nova-compute[75071]:       <entry name="serial">51d61988-adc9-41d1-a674-5e77d6f7f407</entry>
Dec 05 12:47:38 user nova-compute[75071]:       <entry name="uuid">51d61988-adc9-41d1-a674-5e77d6f7f407</entry>
Dec 05 12:47:38 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:47:38 user nova-compute[75071]:     </system>
Dec 05 12:47:38 user nova-compute[75071]:   </sysinfo>
Dec 05 12:47:38 user nova-compute[75071]:   <os>
Dec 05 12:47:38 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:47:38 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:47:38 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:47:38 user nova-compute[75071]:   </os>
Dec 05 12:47:38 user nova-compute[75071]:   <features>
Dec 05 12:47:38 user nova-compute[75071]:     <acpi/>
Dec 05 12:47:38 user nova-compute[75071]:     <apic/>
Dec 05 12:47:38 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:47:38 user nova-compute[75071]:   </features>
Dec 05 12:47:38 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:47:38 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:47:38 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:47:38 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:47:38 user nova-compute[75071]:   </clock>
Dec 05 12:47:38 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:47:38 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:47:38 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:47:38 user nova-compute[75071]:   </cpu>
Dec 05 12:47:38 user nova-compute[75071]:   <devices>
Dec 05 12:47:38 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:47:38 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:47:38 user nova-compute[75071]:       <source dev="/dev/sdb"/>
Dec 05 12:47:38 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:47:38 user nova-compute[75071]:       <serial>9f2541c1-794b-4c89-91f7-e0dfb3a3317c</serial>
Dec 05 12:47:38 user nova-compute[75071]:     </disk>
Dec 05 12:47:38 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:47:38 user nova-compute[75071]:       <mac address="fa:16:3e:97:0c:8c"/>
Dec 05 12:47:38 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:47:38 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:47:38 user nova-compute[75071]:       <target dev="tap0d9d7661-13"/>
Dec 05 12:47:38 user nova-compute[75071]:     </interface>
Dec 05 12:47:38 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:47:38 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/51d61988-adc9-41d1-a674-5e77d6f7f407/console.log" append="off"/>
Dec 05 12:47:38 user nova-compute[75071]:     </serial>
Dec 05 12:47:38 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:47:38 user nova-compute[75071]:     <video>
Dec 05 12:47:38 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:47:38 user nova-compute[75071]:     </video>
Dec 05 12:47:38 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:47:38 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:47:38 user nova-compute[75071]:     </rng>
Dec 05 12:47:38 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:47:38 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:47:38 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:47:38 user nova-compute[75071]:     </memballoon>
Dec 05 12:47:38 user nova-compute[75071]:   </devices>
Dec 05 12:47:38 user nova-compute[75071]: </domain>
Dec 05 12:47:38 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-845852471',display_name='tempest-TestVolumeBootPattern-server-845852471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-845852471',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e87e18fa15d84a858a5e6c8306589285',ramdisk_id='',reservation_id='r-3kwei0f8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2021686022',owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:47:19Z,user_data=None,user_id='c40b4872327a40968c5e7a5f89cd137a',uuid=51d61988-adc9-41d1-a674-5e77d6f7f407,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "address": "fa:16:3e:97:0c:8c", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d7661-13", "ovs_interfaceid": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converting VIF {"id": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "address": "fa:16:3e:97:0c:8c", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d7661-13", "ovs_interfaceid": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:0c:8c,bridge_name='br-int',has_traffic_filtering=True,id=0d9d7661-13cf-42bd-b712-d6c12e5a3675,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9d7661-13') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG os_vif [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:0c:8c,bridge_name='br-int',has_traffic_filtering=True,id=0d9d7661-13cf-42bd-b712-d6c12e5a3675,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9d7661-13') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c6d6e96-eccd-59b9-b5ff-84740ca2121f', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d9d7661-13, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d9d7661-13, col_values=(('qos', UUID('1e6ad4d3-7b6d-4fb1-8e7e-6e99dc3d135e')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d9d7661-13, col_values=(('external_ids', {'iface-id': '0d9d7661-13cf-42bd-b712-d6c12e5a3675', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:0c:8c', 'vm-uuid': '51d61988-adc9-41d1-a674-5e77d6f7f407'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:38 user nova-compute[75071]: INFO os_vif [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:0c:8c,bridge_name='br-int',has_traffic_filtering=True,id=0d9d7661-13cf-42bd-b712-d6c12e5a3675,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9d7661-13')
Dec 05 12:47:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:47:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] No VIF found with MAC fa:16:3e:97:0c:8c, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:47:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-44a1e224-48cd-44ec-9a9f-d1751992e7a7 req-8d7fec7a-e696-4484-9541-cd8764c5c864 service nova] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Received event network-vif-plugged-0d9d7661-13cf-42bd-b712-d6c12e5a3675 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:47:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44a1e224-48cd-44ec-9a9f-d1751992e7a7 req-8d7fec7a-e696-4484-9541-cd8764c5c864 service nova] Acquiring lock "51d61988-adc9-41d1-a674-5e77d6f7f407-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:47:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44a1e224-48cd-44ec-9a9f-d1751992e7a7 req-8d7fec7a-e696-4484-9541-cd8764c5c864 service nova] Lock "51d61988-adc9-41d1-a674-5e77d6f7f407-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:47:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44a1e224-48cd-44ec-9a9f-d1751992e7a7 req-8d7fec7a-e696-4484-9541-cd8764c5c864 service nova] Lock "51d61988-adc9-41d1-a674-5e77d6f7f407-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:47:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-44a1e224-48cd-44ec-9a9f-d1751992e7a7 req-8d7fec7a-e696-4484-9541-cd8764c5c864 service nova] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] No waiting events found dispatching network-vif-plugged-0d9d7661-13cf-42bd-b712-d6c12e5a3675 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:47:40 user nova-compute[75071]: WARNING nova.compute.manager [req-44a1e224-48cd-44ec-9a9f-d1751992e7a7 req-8d7fec7a-e696-4484-9541-cd8764c5c864 service nova] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Received unexpected event network-vif-plugged-0d9d7661-13cf-42bd-b712-d6c12e5a3675 for instance with vm_state building and task_state spawning.
Dec 05 12:47:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:47:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:47:42 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Instance spawned successfully.
Dec 05 12:47:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:47:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:47:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:47:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:47:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:47:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:47:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:47:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-308e6bf8-03da-4d35-ae64-d402e46771f3 req-8c8b9c02-d087-41e6-9b46-57b846ebc53e service nova] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Received event network-vif-plugged-0d9d7661-13cf-42bd-b712-d6c12e5a3675 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:47:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-308e6bf8-03da-4d35-ae64-d402e46771f3 req-8c8b9c02-d087-41e6-9b46-57b846ebc53e service nova] Acquiring lock "51d61988-adc9-41d1-a674-5e77d6f7f407-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:47:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-308e6bf8-03da-4d35-ae64-d402e46771f3 req-8c8b9c02-d087-41e6-9b46-57b846ebc53e service nova] Lock "51d61988-adc9-41d1-a674-5e77d6f7f407-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:47:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-308e6bf8-03da-4d35-ae64-d402e46771f3 req-8c8b9c02-d087-41e6-9b46-57b846ebc53e service nova] Lock "51d61988-adc9-41d1-a674-5e77d6f7f407-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:47:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-308e6bf8-03da-4d35-ae64-d402e46771f3 req-8c8b9c02-d087-41e6-9b46-57b846ebc53e service nova] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] No waiting events found dispatching network-vif-plugged-0d9d7661-13cf-42bd-b712-d6c12e5a3675 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:47:42 user nova-compute[75071]: WARNING nova.compute.manager [req-308e6bf8-03da-4d35-ae64-d402e46771f3 req-8c8b9c02-d087-41e6-9b46-57b846ebc53e service nova] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Received unexpected event network-vif-plugged-0d9d7661-13cf-42bd-b712-d6c12e5a3675 for instance with vm_state building and task_state spawning.
Dec 05 12:47:42 user nova-compute[75071]: INFO nova.compute.manager [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Took 5.06 seconds to spawn the instance on the hypervisor.
Dec 05 12:47:42 user nova-compute[75071]: DEBUG nova.compute.manager [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:47:42 user nova-compute[75071]: INFO nova.compute.manager [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Took 23.81 seconds to build instance.
Dec 05 12:47:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-155a271c-063d-4b73-bd3d-4c88305a87b3 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "51d61988-adc9-41d1-a674-5e77d6f7f407" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.917s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:47:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:47:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:47:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:02 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:48:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:48:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:06 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:48:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:48:07 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:48:07 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:48:07 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:48:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:09 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:48:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:48:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:48:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:48:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:48:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:48:10 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:48:10 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:48:10 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8818MB free_disk=25.04599380493164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:48:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:48:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:48:10 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 51d61988-adc9-41d1-a674-5e77d6f7f407 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:48:10 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:48:10 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:48:10 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:48:10 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:48:10 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:48:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.324s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:48:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:48:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:48:18 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:48:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:48:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 12:48:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-51d61988-adc9-41d1-a674-5e77d6f7f407" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:48:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-51d61988-adc9-41d1-a674-5e77d6f7f407" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:48:18 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:48:18 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lazy-loading 'info_cache' on Instance uuid 51d61988-adc9-41d1-a674-5e77d6f7f407 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:48:19 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Updating instance_info_cache with network_info: [{"id": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "address": "fa:16:3e:97:0c:8c", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d7661-13", "ovs_interfaceid": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:48:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-51d61988-adc9-41d1-a674-5e77d6f7f407" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:48:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:48:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:48:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:48:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:48:21 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:48:21 user nova-compute[75071]: INFO nova.compute.claims [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Claim successful on node user
Dec 05 12:48:22 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:48:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:48:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG nova.policy [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b2ab4b19a9b4ce397ffa1cc279e26ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9640f3ad175948f59ba184167e4bf5a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:48:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Creating image(s)
Dec 05 12:48:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "/opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "/opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "/opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.191s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk 1073741824" returned: 0 in 0.066s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:48:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Successfully created port: 16f6b150-0148-4642-aa5b-d4074ff3800a {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.192s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Cannot resize image /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Ensure instance console log exists: /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.network.neutron [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Successfully updated port: 16f6b150-0148-4642-aa5b-d4074ff3800a {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "refresh_cache-62e2d4c2-14c2-41c4-bab0-3131622918ea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquired lock "refresh_cache-62e2d4c2-14c2-41c4-bab0-3131622918ea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.network.neutron [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-5860bd76-2392-48f7-806b-9389d112cc7a req-14eba798-d39f-484b-a799-95bb2cdb49af service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Received event network-changed-16f6b150-0148-4642-aa5b-d4074ff3800a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-5860bd76-2392-48f7-806b-9389d112cc7a req-14eba798-d39f-484b-a799-95bb2cdb49af service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Refreshing instance network info cache due to event network-changed-16f6b150-0148-4642-aa5b-d4074ff3800a. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5860bd76-2392-48f7-806b-9389d112cc7a req-14eba798-d39f-484b-a799-95bb2cdb49af service nova] Acquiring lock "refresh_cache-62e2d4c2-14c2-41c4-bab0-3131622918ea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.network.neutron [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.network.neutron [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Updating instance_info_cache with network_info: [{"id": "16f6b150-0148-4642-aa5b-d4074ff3800a", "address": "fa:16:3e:2c:27:7b", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f6b150-01", "ovs_interfaceid": "16f6b150-0148-4642-aa5b-d4074ff3800a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Releasing lock "refresh_cache-62e2d4c2-14c2-41c4-bab0-3131622918ea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Instance network_info: |[{"id": "16f6b150-0148-4642-aa5b-d4074ff3800a", "address": "fa:16:3e:2c:27:7b", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f6b150-01", "ovs_interfaceid": "16f6b150-0148-4642-aa5b-d4074ff3800a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5860bd76-2392-48f7-806b-9389d112cc7a req-14eba798-d39f-484b-a799-95bb2cdb49af service nova] Acquired lock "refresh_cache-62e2d4c2-14c2-41c4-bab0-3131622918ea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.network.neutron [req-5860bd76-2392-48f7-806b-9389d112cc7a req-14eba798-d39f-484b-a799-95bb2cdb49af service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Refreshing network info cache for port 16f6b150-0148-4642-aa5b-d4074ff3800a {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Start _get_guest_xml network_info=[{"id": "16f6b150-0148-4642-aa5b-d4074ff3800a", "address": "fa:16:3e:2c:27:7b", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f6b150-01", "ovs_interfaceid": "16f6b150-0148-4642-aa5b-d4074ff3800a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:48:23 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:48:23 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1315178069',display_name='tempest-AttachVolumeTestJSON-server-1315178069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1315178069',id=45,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL583pZ8lCo9C8z0aETmRs8Bd94jQAvqteKXlE9SYHCWFMh1HwLf2FDvuCMewkDpyVjFxepUQbDw10yShgalC9Lq1SF4QrcOgZUV6myncyvxtRF62IHSnbdOt7vBI3GEHw==',key_name='tempest-keypair-1704924917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9640f3ad175948f59ba184167e4bf5a9',ramdisk_id='',reservation_id='r-5a16dgrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-660715611',owner_user_name='tempest-AttachVolumeTestJSON-660715611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:48:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b2ab4b19a9b4ce397ffa1cc279e26ac',uuid=62e2d4c2-14c2-41c4-bab0-3131622918ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16f6b150-0148-4642-aa5b-d4074ff3800a", "address": "fa:16:3e:2c:27:7b", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f6b150-01", "ovs_interfaceid": "16f6b150-0148-4642-aa5b-d4074ff3800a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converting VIF {"id": "16f6b150-0148-4642-aa5b-d4074ff3800a", "address": "fa:16:3e:2c:27:7b", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f6b150-01", "ovs_interfaceid": "16f6b150-0148-4642-aa5b-d4074ff3800a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=16f6b150-0148-4642-aa5b-d4074ff3800a,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16f6b150-01') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.objects.instance [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'pci_devices' on Instance uuid 62e2d4c2-14c2-41c4-bab0-3131622918ea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:48:23 user nova-compute[75071]:   <uuid>62e2d4c2-14c2-41c4-bab0-3131622918ea</uuid>
Dec 05 12:48:23 user nova-compute[75071]:   <name>instance-0000002d</name>
Dec 05 12:48:23 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:48:23 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:48:23 user nova-compute[75071]:   <metadata>
Dec 05 12:48:23 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:48:23 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:48:23 user nova-compute[75071]:       <nova:name>tempest-AttachVolumeTestJSON-server-1315178069</nova:name>
Dec 05 12:48:23 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:48:23</nova:creationTime>
Dec 05 12:48:23 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:48:23 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:48:23 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:48:23 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:48:23 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:48:23 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:48:23 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:48:23 user nova-compute[75071]:       <nova:owner>
Dec 05 12:48:23 user nova-compute[75071]:         <nova:user uuid="2b2ab4b19a9b4ce397ffa1cc279e26ac">tempest-AttachVolumeTestJSON-660715611-project-member</nova:user>
Dec 05 12:48:23 user nova-compute[75071]:         <nova:project uuid="9640f3ad175948f59ba184167e4bf5a9">tempest-AttachVolumeTestJSON-660715611</nova:project>
Dec 05 12:48:23 user nova-compute[75071]:       </nova:owner>
Dec 05 12:48:23 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:48:23 user nova-compute[75071]:       <nova:ports>
Dec 05 12:48:23 user nova-compute[75071]:         <nova:port uuid="16f6b150-0148-4642-aa5b-d4074ff3800a">
Dec 05 12:48:23 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 12:48:23 user nova-compute[75071]:         </nova:port>
Dec 05 12:48:23 user nova-compute[75071]:       </nova:ports>
Dec 05 12:48:23 user nova-compute[75071]:     </nova:instance>
Dec 05 12:48:23 user nova-compute[75071]:   </metadata>
Dec 05 12:48:23 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:48:23 user nova-compute[75071]:     <system>
Dec 05 12:48:23 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:48:23 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:48:23 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:48:23 user nova-compute[75071]:       <entry name="serial">62e2d4c2-14c2-41c4-bab0-3131622918ea</entry>
Dec 05 12:48:23 user nova-compute[75071]:       <entry name="uuid">62e2d4c2-14c2-41c4-bab0-3131622918ea</entry>
Dec 05 12:48:23 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:48:23 user nova-compute[75071]:     </system>
Dec 05 12:48:23 user nova-compute[75071]:   </sysinfo>
Dec 05 12:48:23 user nova-compute[75071]:   <os>
Dec 05 12:48:23 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:48:23 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:48:23 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:48:23 user nova-compute[75071]:   </os>
Dec 05 12:48:23 user nova-compute[75071]:   <features>
Dec 05 12:48:23 user nova-compute[75071]:     <acpi/>
Dec 05 12:48:23 user nova-compute[75071]:     <apic/>
Dec 05 12:48:23 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:48:23 user nova-compute[75071]:   </features>
Dec 05 12:48:23 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:48:23 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:48:23 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:48:23 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:48:23 user nova-compute[75071]:   </clock>
Dec 05 12:48:23 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:48:23 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:48:23 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:48:23 user nova-compute[75071]:   </cpu>
Dec 05 12:48:23 user nova-compute[75071]:   <devices>
Dec 05 12:48:23 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:48:23 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:48:23 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk"/>
Dec 05 12:48:23 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:48:23 user nova-compute[75071]:     </disk>
Dec 05 12:48:23 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:48:23 user nova-compute[75071]:       <mac address="fa:16:3e:2c:27:7b"/>
Dec 05 12:48:23 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:48:23 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:48:23 user nova-compute[75071]:       <target dev="tap16f6b150-01"/>
Dec 05 12:48:23 user nova-compute[75071]:     </interface>
Dec 05 12:48:23 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:48:23 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/console.log" append="off"/>
Dec 05 12:48:23 user nova-compute[75071]:     </serial>
Dec 05 12:48:23 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:48:23 user nova-compute[75071]:     <video>
Dec 05 12:48:23 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:48:23 user nova-compute[75071]:     </video>
Dec 05 12:48:23 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:48:23 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:48:23 user nova-compute[75071]:     </rng>
Dec 05 12:48:23 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:48:23 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:48:23 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:48:23 user nova-compute[75071]:     </memballoon>
Dec 05 12:48:23 user nova-compute[75071]:   </devices>
Dec 05 12:48:23 user nova-compute[75071]: </domain>
Dec 05 12:48:23 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1315178069',display_name='tempest-AttachVolumeTestJSON-server-1315178069',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1315178069',id=45,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL583pZ8lCo9C8z0aETmRs8Bd94jQAvqteKXlE9SYHCWFMh1HwLf2FDvuCMewkDpyVjFxepUQbDw10yShgalC9Lq1SF4QrcOgZUV6myncyvxtRF62IHSnbdOt7vBI3GEHw==',key_name='tempest-keypair-1704924917',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9640f3ad175948f59ba184167e4bf5a9',ramdisk_id='',reservation_id='r-5a16dgrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-660715611',owner_user_name='tempest-AttachVolumeTestJSON-660715611-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:48:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b2ab4b19a9b4ce397ffa1cc279e26ac',uuid=62e2d4c2-14c2-41c4-bab0-3131622918ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16f6b150-0148-4642-aa5b-d4074ff3800a", "address": "fa:16:3e:2c:27:7b", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f6b150-01", "ovs_interfaceid": "16f6b150-0148-4642-aa5b-d4074ff3800a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converting VIF {"id": "16f6b150-0148-4642-aa5b-d4074ff3800a", "address": "fa:16:3e:2c:27:7b", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f6b150-01", "ovs_interfaceid": "16f6b150-0148-4642-aa5b-d4074ff3800a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=16f6b150-0148-4642-aa5b-d4074ff3800a,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16f6b150-01') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG os_vif [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=16f6b150-0148-4642-aa5b-d4074ff3800a,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16f6b150-01') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00680cbe-481e-5c20-a7e9-cbb1d109add2', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:48:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap16f6b150-01, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:48:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap16f6b150-01, col_values=(('qos', UUID('2a490788-9099-4e04-a7c9-6241487a8b18')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:48:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap16f6b150-01, col_values=(('external_ids', {'iface-id': '16f6b150-0148-4642-aa5b-d4074ff3800a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:27:7b', 'vm-uuid': '62e2d4c2-14c2-41c4-bab0-3131622918ea'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:48:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:48:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:24 user nova-compute[75071]: INFO os_vif [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=16f6b150-0148-4642-aa5b-d4074ff3800a,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16f6b150-01')
Dec 05 12:48:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:48:24 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] No VIF found with MAC fa:16:3e:2c:27:7b, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:48:24 user nova-compute[75071]: DEBUG nova.network.neutron [req-5860bd76-2392-48f7-806b-9389d112cc7a req-14eba798-d39f-484b-a799-95bb2cdb49af service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Updated VIF entry in instance network info cache for port 16f6b150-0148-4642-aa5b-d4074ff3800a. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:48:24 user nova-compute[75071]: DEBUG nova.network.neutron [req-5860bd76-2392-48f7-806b-9389d112cc7a req-14eba798-d39f-484b-a799-95bb2cdb49af service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Updating instance_info_cache with network_info: [{"id": "16f6b150-0148-4642-aa5b-d4074ff3800a", "address": "fa:16:3e:2c:27:7b", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f6b150-01", "ovs_interfaceid": "16f6b150-0148-4642-aa5b-d4074ff3800a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:48:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5860bd76-2392-48f7-806b-9389d112cc7a req-14eba798-d39f-484b-a799-95bb2cdb49af service nova] Releasing lock "refresh_cache-62e2d4c2-14c2-41c4-bab0-3131622918ea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:48:24 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:48:24 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 12:48:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-433e7ccd-371d-439e-823d-558e56355cc5 req-fd5adf6a-b8c7-4dde-8c08-90d85fb03e0f service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Received event network-vif-plugged-16f6b150-0148-4642-aa5b-d4074ff3800a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:48:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-433e7ccd-371d-439e-823d-558e56355cc5 req-fd5adf6a-b8c7-4dde-8c08-90d85fb03e0f service nova] Acquiring lock "62e2d4c2-14c2-41c4-bab0-3131622918ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:48:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-433e7ccd-371d-439e-823d-558e56355cc5 req-fd5adf6a-b8c7-4dde-8c08-90d85fb03e0f service nova] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:48:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-433e7ccd-371d-439e-823d-558e56355cc5 req-fd5adf6a-b8c7-4dde-8c08-90d85fb03e0f service nova] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:48:25 user nova-compute[75071]: DEBUG nova.compute.manager [req-433e7ccd-371d-439e-823d-558e56355cc5 req-fd5adf6a-b8c7-4dde-8c08-90d85fb03e0f service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] No waiting events found dispatching network-vif-plugged-16f6b150-0148-4642-aa5b-d4074ff3800a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:48:25 user nova-compute[75071]: WARNING nova.compute.manager [req-433e7ccd-371d-439e-823d-558e56355cc5 req-fd5adf6a-b8c7-4dde-8c08-90d85fb03e0f service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Received unexpected event network-vif-plugged-16f6b150-0148-4642-aa5b-d4074ff3800a for instance with vm_state building and task_state spawning.
Dec 05 12:48:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:48:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:48:27 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Instance spawned successfully.
Dec 05 12:48:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:48:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:48:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:48:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:48:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:48:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:48:27 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:48:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-708c0d34-6531-43dd-abd2-23006f576eb3 req-042c3a3d-7532-4ed8-a285-6bac46dc4ac5 service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Received event network-vif-plugged-16f6b150-0148-4642-aa5b-d4074ff3800a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:48:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-708c0d34-6531-43dd-abd2-23006f576eb3 req-042c3a3d-7532-4ed8-a285-6bac46dc4ac5 service nova] Acquiring lock "62e2d4c2-14c2-41c4-bab0-3131622918ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:48:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-708c0d34-6531-43dd-abd2-23006f576eb3 req-042c3a3d-7532-4ed8-a285-6bac46dc4ac5 service nova] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:48:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-708c0d34-6531-43dd-abd2-23006f576eb3 req-042c3a3d-7532-4ed8-a285-6bac46dc4ac5 service nova] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:48:27 user nova-compute[75071]: DEBUG nova.compute.manager [req-708c0d34-6531-43dd-abd2-23006f576eb3 req-042c3a3d-7532-4ed8-a285-6bac46dc4ac5 service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] No waiting events found dispatching network-vif-plugged-16f6b150-0148-4642-aa5b-d4074ff3800a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:48:27 user nova-compute[75071]: WARNING nova.compute.manager [req-708c0d34-6531-43dd-abd2-23006f576eb3 req-042c3a3d-7532-4ed8-a285-6bac46dc4ac5 service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Received unexpected event network-vif-plugged-16f6b150-0148-4642-aa5b-d4074ff3800a for instance with vm_state building and task_state spawning.
Dec 05 12:48:27 user nova-compute[75071]: INFO nova.compute.manager [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Took 5.24 seconds to spawn the instance on the hypervisor.
Dec 05 12:48:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:48:27 user nova-compute[75071]: INFO nova.compute.manager [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Took 5.88 seconds to build instance.
Dec 05 12:48:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-df25c35b-744c-47d5-8da9-62277981db4d tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:48:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:48:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:48:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:02 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:49:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:07 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:49:08 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:49:08 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:49:08 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:49:08 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:49:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "51d61988-adc9-41d1-a674-5e77d6f7f407" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "51d61988-adc9-41d1-a674-5e77d6f7f407" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "51d61988-adc9-41d1-a674-5e77d6f7f407-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "51d61988-adc9-41d1-a674-5e77d6f7f407-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "51d61988-adc9-41d1-a674-5e77d6f7f407-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:49:09 user nova-compute[75071]: INFO nova.compute.manager [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Terminating instance
Dec 05 12:49:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-ecd0a2bf-5281-4bf6-a8de-497b86a3eb99 req-bc736311-3f4f-4e5f-80a6-b0d1d2d58f84 service nova] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Received event network-vif-unplugged-0d9d7661-13cf-42bd-b712-d6c12e5a3675 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ecd0a2bf-5281-4bf6-a8de-497b86a3eb99 req-bc736311-3f4f-4e5f-80a6-b0d1d2d58f84 service nova] Acquiring lock "51d61988-adc9-41d1-a674-5e77d6f7f407-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ecd0a2bf-5281-4bf6-a8de-497b86a3eb99 req-bc736311-3f4f-4e5f-80a6-b0d1d2d58f84 service nova] Lock "51d61988-adc9-41d1-a674-5e77d6f7f407-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ecd0a2bf-5281-4bf6-a8de-497b86a3eb99 req-bc736311-3f4f-4e5f-80a6-b0d1d2d58f84 service nova] Lock "51d61988-adc9-41d1-a674-5e77d6f7f407-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-ecd0a2bf-5281-4bf6-a8de-497b86a3eb99 req-bc736311-3f4f-4e5f-80a6-b0d1d2d58f84 service nova] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] No waiting events found dispatching network-vif-unplugged-0d9d7661-13cf-42bd-b712-d6c12e5a3675 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:49:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-ecd0a2bf-5281-4bf6-a8de-497b86a3eb99 req-bc736311-3f4f-4e5f-80a6-b0d1d2d58f84 service nova] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Received event network-vif-unplugged-0d9d7661-13cf-42bd-b712-d6c12e5a3675 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Instance destroyed successfully.
Dec 05 12:49:10 user nova-compute[75071]: DEBUG nova.objects.instance [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lazy-loading 'resources' on Instance uuid 51d61988-adc9-41d1-a674-5e77d6f7f407 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-845852471',display_name='tempest-TestVolumeBootPattern-server-845852471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-845852471',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:47:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e87e18fa15d84a858a5e6c8306589285',ramdisk_id='',reservation_id='r-3kwei0f8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2021686022',owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:47:42Z,user_data=None,user_id='c40b4872327a40968c5e7a5f89cd137a',uuid=51d61988-adc9-41d1-a674-5e77d6f7f407,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "address": "fa:16:3e:97:0c:8c", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d7661-13", "ovs_interfaceid": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converting VIF {"id": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "address": "fa:16:3e:97:0c:8c", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d9d7661-13", "ovs_interfaceid": "0d9d7661-13cf-42bd-b712-d6c12e5a3675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:0c:8c,bridge_name='br-int',has_traffic_filtering=True,id=0d9d7661-13cf-42bd-b712-d6c12e5a3675,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9d7661-13') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_vif [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:0c:8c,bridge_name='br-int',has_traffic_filtering=True,id=0d9d7661-13cf-42bd-b712-d6c12e5a3675,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9d7661-13') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d9d7661-13, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e6ad4d3-7b6d-4fb1-8e7e-6e99dc3d135e) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:49:10 user nova-compute[75071]: INFO os_vif [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:0c:8c,bridge_name='br-int',has_traffic_filtering=True,id=0d9d7661-13cf-42bd-b712-d6c12e5a3675,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d9d7661-13')
Dec 05 12:49:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FwbWdYpq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:49:10 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62eed48-3c1e-49d6-8b8f-ef810ce53e8e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:49:10 user nova-compute[75071]: No targets found.
Dec 05 12:49:10 user nova-compute[75071]: iSNS:
Dec 05 12:49:10 user nova-compute[75071]: No targets found.
Dec 05 12:49:10 user nova-compute[75071]: STATIC:
Dec 05 12:49:10 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c
Dec 05 12:49:10 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:49:10 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:49:10 user nova-compute[75071]: FIRMWARE:
Dec 05 12:49:10 user nova-compute[75071]: No targets found.
Dec 05 12:49:10 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:49:10 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:49:10 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[89868608-1a0f-4aa1-99df-6ae1e9a90eae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[504cd8f3-912b-4e16-8528-382686b7c881]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c (non-flash)
Dec 05 12:49:10 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c (non-flash)
Dec 05 12:49:10 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82406cc670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5ab76a-a5f3-49ae-b8cc-8163469fd967]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e101367-ad39-48e6-8e8f-e56d0fd19c98]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f755c0-a93a-481e-8e6e-a6605a295695]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cb515f-7ffd-41c1-8c0e-6cf2308eb014]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d488104-f5a6-4e79-a4f0-0da7ed508171]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[825d34b5-05b6-4358-8ebd-135189368a75]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c, portal: 172.16.0.220,3260]
Dec 05 12:49:10 user nova-compute[75071]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c, portal: 172.16.0.220,3260] successful.
Dec 05 12:49:10 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f2541c1-794b-4c89-91f7-e0dfb3a3317c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fab36e5-f7f4-4c9e-8200-e72733d96f56]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] <== disconnect_volume: return (374ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:49:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Deleting instance files /opt/stack/data/nova/instances/51d61988-adc9-41d1-a674-5e77d6f7f407_del
Dec 05 12:49:10 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Deletion of /opt/stack/data/nova/instances/51d61988-adc9-41d1-a674-5e77d6f7f407_del complete
Dec 05 12:49:10 user nova-compute[75071]: INFO nova.compute.manager [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Took 1.24 seconds to destroy the instance on the hypervisor.
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:49:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:49:11 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:49:11 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:49:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8908MB free_disk=25.013648986816406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:49:11 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Took 0.47 seconds to deallocate network for instance.
Dec 05 12:49:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 51d61988-adc9-41d1-a674-5e77d6f7f407 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 62e2d4c2-14c2-41c4-bab0-3131622918ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Refreshing inventories for resource provider 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Updating ProviderTree inventory for provider 25beb694-9dd7-475f-9657-74a5f0368417 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Updating inventory in ProviderTree for provider 25beb694-9dd7-475f-9657-74a5f0368417 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Refreshing aggregate associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Refreshing trait associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-2e738bce-29aa-4d21-b5f6-31f7cd0a627e req-3e1a556e-3164-4f6c-a8c3-d7fa2e25d212 service nova] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Received event network-vif-plugged-0d9d7661-13cf-42bd-b712-d6c12e5a3675 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2e738bce-29aa-4d21-b5f6-31f7cd0a627e req-3e1a556e-3164-4f6c-a8c3-d7fa2e25d212 service nova] Acquiring lock "51d61988-adc9-41d1-a674-5e77d6f7f407-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2e738bce-29aa-4d21-b5f6-31f7cd0a627e req-3e1a556e-3164-4f6c-a8c3-d7fa2e25d212 service nova] Lock "51d61988-adc9-41d1-a674-5e77d6f7f407-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2e738bce-29aa-4d21-b5f6-31f7cd0a627e req-3e1a556e-3164-4f6c-a8c3-d7fa2e25d212 service nova] Lock "51d61988-adc9-41d1-a674-5e77d6f7f407-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:49:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-2e738bce-29aa-4d21-b5f6-31f7cd0a627e req-3e1a556e-3164-4f6c-a8c3-d7fa2e25d212 service nova] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] No waiting events found dispatching network-vif-plugged-0d9d7661-13cf-42bd-b712-d6c12e5a3675 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:49:11 user nova-compute[75071]: WARNING nova.compute.manager [req-2e738bce-29aa-4d21-b5f6-31f7cd0a627e req-3e1a556e-3164-4f6c-a8c3-d7fa2e25d212 service nova] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Received unexpected event network-vif-plugged-0d9d7661-13cf-42bd-b712-d6c12e5a3675 for instance with vm_state active and task_state deleting.
Dec 05 12:49:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-2e738bce-29aa-4d21-b5f6-31f7cd0a627e req-3e1a556e-3164-4f6c-a8c3-d7fa2e25d212 service nova] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Received event network-vif-deleted-0d9d7661-13cf-42bd-b712-d6c12e5a3675 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:49:12 user nova-compute[75071]: INFO nova.compute.manager [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Took 0.86 seconds to detach 1 volumes for instance.
Dec 05 12:49:12 user nova-compute[75071]: DEBUG nova.compute.manager [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 51d61988-adc9-41d1-a674-5e77d6f7f407] Deleting volume: 9f2541c1-794b-4c89-91f7-e0dfb3a3317c {{(pid=75071) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 05 12:49:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:49:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:49:12 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:49:12 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:49:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:49:12 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Deleted allocations for instance 51d61988-adc9-41d1-a674-5e77d6f7f407
Dec 05 12:49:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-88ec36de-47a3-487d-bbe5-17ae9a566f65 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "51d61988-adc9-41d1-a674-5e77d6f7f407" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.960s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:49:12 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:49:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:16 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:49:18 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:49:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:49:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 12:49:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-62e2d4c2-14c2-41c4-bab0-3131622918ea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:49:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-62e2d4c2-14c2-41c4-bab0-3131622918ea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:49:18 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:49:18 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lazy-loading 'info_cache' on Instance uuid 62e2d4c2-14c2-41c4-bab0-3131622918ea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:49:19 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Updating instance_info_cache with network_info: [{"id": "16f6b150-0148-4642-aa5b-d4074ff3800a", "address": "fa:16:3e:2c:27:7b", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f6b150-01", "ovs_interfaceid": "16f6b150-0148-4642-aa5b-d4074ff3800a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:49:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-62e2d4c2-14c2-41c4-bab0-3131622918ea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:49:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:49:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:49:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:49:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:49:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:49:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:49:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:49:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:49:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:02 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:50:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:08 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:50:09 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:50:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:50:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:50:10 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:50:10 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:50:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:50:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:50:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:50:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:50:11 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:50:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:12 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:12 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:50:12 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:50:12 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8978MB free_disk=25.011974334716797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:50:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:50:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:50:12 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 62e2d4c2-14c2-41c4-bab0-3131622918ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:50:12 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:50:12 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:50:12 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:50:12 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:50:12 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:50:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.185s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:50:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-8932c97c-2831-410f-98f4-cd69070522b8 req-c8c64087-76d1-4adb-b64e-d0f415a0be4f service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Received event network-changed-16f6b150-0148-4642-aa5b-d4074ff3800a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:50:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-8932c97c-2831-410f-98f4-cd69070522b8 req-c8c64087-76d1-4adb-b64e-d0f415a0be4f service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Refreshing instance network info cache due to event network-changed-16f6b150-0148-4642-aa5b-d4074ff3800a. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:50:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8932c97c-2831-410f-98f4-cd69070522b8 req-c8c64087-76d1-4adb-b64e-d0f415a0be4f service nova] Acquiring lock "refresh_cache-62e2d4c2-14c2-41c4-bab0-3131622918ea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:50:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8932c97c-2831-410f-98f4-cd69070522b8 req-c8c64087-76d1-4adb-b64e-d0f415a0be4f service nova] Acquired lock "refresh_cache-62e2d4c2-14c2-41c4-bab0-3131622918ea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:50:13 user nova-compute[75071]: DEBUG nova.network.neutron [req-8932c97c-2831-410f-98f4-cd69070522b8 req-c8c64087-76d1-4adb-b64e-d0f415a0be4f service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Refreshing network info cache for port 16f6b150-0148-4642-aa5b-d4074ff3800a {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:50:13 user nova-compute[75071]: DEBUG nova.network.neutron [req-8932c97c-2831-410f-98f4-cd69070522b8 req-c8c64087-76d1-4adb-b64e-d0f415a0be4f service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Updated VIF entry in instance network info cache for port 16f6b150-0148-4642-aa5b-d4074ff3800a. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:50:13 user nova-compute[75071]: DEBUG nova.network.neutron [req-8932c97c-2831-410f-98f4-cd69070522b8 req-c8c64087-76d1-4adb-b64e-d0f415a0be4f service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Updating instance_info_cache with network_info: [{"id": "16f6b150-0148-4642-aa5b-d4074ff3800a", "address": "fa:16:3e:2c:27:7b", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f6b150-01", "ovs_interfaceid": "16f6b150-0148-4642-aa5b-d4074ff3800a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:50:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-8932c97c-2831-410f-98f4-cd69070522b8 req-c8c64087-76d1-4adb-b64e-d0f415a0be4f service nova] Releasing lock "refresh_cache-62e2d4c2-14c2-41c4-bab0-3131622918ea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:50:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:50:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:50:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:50:15 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'flavor' on Instance uuid 62e2d4c2-14c2-41c4-bab0-3131622918ea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:50:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:50:16 user nova-compute[75071]: INFO nova.compute.manager [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Attaching volume 351082ec-4952-4298-aba2-3a1c7e978385 to /dev/vdb
Dec 05 12:50:16 user nova-compute[75071]: DEBUG os_brick.utils [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cd97f9-7fca-4889-b96b-7d7f72fa5161]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0259b048-46e2-4ad5-a9e3-40de8f7d1885]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be2a0cc-4ce4-4492-a44a-96c8a14405b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7df8d8-6025-486a-89ec-ee31ed1c0ad2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:50:16 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:50:16 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74cc82c-0312-4f1d-8af4-d4e55eef064a]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG os_brick.utils [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:50:16 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Updating existing volume attachment record: de7a3ff9-22c6-49de-85fe-face0b5f1e58 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:50:17 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:50:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:50:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:50:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:50:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:50:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:50:18 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:50:18 user nova-compute[75071]: INFO nova.compute.claims [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Claim successful on node user
Dec 05 12:50:18 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:50:18 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:50:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:50:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:50:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:50:18 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:50:18 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:50:19 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:50:19 user nova-compute[75071]: INFO nova.virt.block_device [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Booting with volume a4e46048-9848-4dec-b5eb-33e0e32679d5 at /dev/vda
Dec 05 12:50:19 user nova-compute[75071]: DEBUG nova.policy [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c40b4872327a40968c5e7a5f89cd137a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87e18fa15d84a858a5e6c8306589285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG os_brick.utils [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[02def15b-4d87-4cfb-9d05-94d5a367f0d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72dce9e-3c0d-4a84-9fd1-8e3cc3d386ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b148e4-3b09-4d99-b4cf-06a9e23b6cac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec060b8c-25d5-40c4-989e-4aee7a454512]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:50:19 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:50:19 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[460113e5-8897-4024-ab03-12b3f72b07c2]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG os_brick.utils [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Updating existing volume attachment record: 796677d3-f618-4e0f-942f-7a13661938db {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:19 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Successfully created port: d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Successfully updated port: d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-cedc2705-0b79-4174-b04d-8473cb5bb2f5 req-7f2ab999-b0fe-4bae-9929-403dcf8f29cc service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Received event network-changed-d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-cedc2705-0b79-4174-b04d-8473cb5bb2f5 req-7f2ab999-b0fe-4bae-9929-403dcf8f29cc service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Refreshing instance network info cache due to event network-changed-d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cedc2705-0b79-4174-b04d-8473cb5bb2f5 req-7f2ab999-b0fe-4bae-9929-403dcf8f29cc service nova] Acquiring lock "refresh_cache-8e787b1f-b8ed-48f8-baba-e168fab8c07f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cedc2705-0b79-4174-b04d-8473cb5bb2f5 req-7f2ab999-b0fe-4bae-9929-403dcf8f29cc service nova] Acquired lock "refresh_cache-8e787b1f-b8ed-48f8-baba-e168fab8c07f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG nova.network.neutron [req-cedc2705-0b79-4174-b04d-8473cb5bb2f5 req-7f2ab999-b0fe-4bae-9929-403dcf8f29cc service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Refreshing network info cache for port d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "refresh_cache-8e787b1f-b8ed-48f8-baba-e168fab8c07f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG nova.network.neutron [req-cedc2705-0b79-4174-b04d-8473cb5bb2f5 req-7f2ab999-b0fe-4bae-9929-403dcf8f29cc service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG nova.network.neutron [req-cedc2705-0b79-4174-b04d-8473cb5bb2f5 req-7f2ab999-b0fe-4bae-9929-403dcf8f29cc service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-cedc2705-0b79-4174-b04d-8473cb5bb2f5 req-7f2ab999-b0fe-4bae-9929-403dcf8f29cc service nova] Releasing lock "refresh_cache-8e787b1f-b8ed-48f8-baba-e168fab8c07f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquired lock "refresh_cache-8e787b1f-b8ed-48f8-baba-e168fab8c07f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Skipping network cache update for instance because it is Building. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-62e2d4c2-14c2-41c4-bab0-3131622918ea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-62e2d4c2-14c2-41c4-bab0-3131622918ea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lazy-loading 'info_cache' on Instance uuid 62e2d4c2-14c2-41c4-bab0-3131622918ea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Updating instance_info_cache with network_info: [{"id": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "address": "fa:16:3e:44:c2:36", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d2b8bc-7b", "ovs_interfaceid": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Releasing lock "refresh_cache-8e787b1f-b8ed-48f8-baba-e168fab8c07f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:50:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Instance network_info: |[{"id": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "address": "fa:16:3e:44:c2:36", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d2b8bc-7b", "ovs_interfaceid": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:50:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Updating instance_info_cache with network_info: [{"id": "16f6b150-0148-4642-aa5b-d4074ff3800a", "address": "fa:16:3e:2c:27:7b", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f6b150-01", "ovs_interfaceid": "16f6b150-0148-4642-aa5b-d4074ff3800a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:50:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-62e2d4c2-14c2-41c4-bab0-3131622918ea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:50:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:50:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odwcvPqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:50:25 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:50:25 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:50:25 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1d6db2-4d95-4ed4-aa4c-9ad81361fdc6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:50:25 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1134037d-2bd1-45fd-a465-ad013a4014ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385] added
Dec 05 12:50:25 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[954f9f72-968f-40c1-8487-e87654d1158c]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec7777c-5fef-4614-afbf-0d537d8c2901]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v odwcvPqB {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v odwcvPqB" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1464369a-f53c-41fe-aaa4-c2ea56cad9f1]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'odwcvPqB'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe99c64-c78a-459e-a69f-32258271dc81]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af91ed4-1aef-40cf-a3a4-72fc52bb9ea8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 12:50:25 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 12:50:25 user nova-compute[75071]:  {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:50:25 user nova-compute[75071]: WARNING os_brick.initiator.connectors.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 12:50:25 user nova-compute[75071]: 
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a96086-09ac-4b5c-b9b5-5acd9c87836a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385, portal: 172.16.0.220,3260]
Dec 05 12:50:25 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385, portal: 172.16.0.220,3260] successful.
Dec 05 12:50:25 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e845998d-df91-4c63-b833-efaf445f2753]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b9112b-90a5-4310-887c-8c42c898bd5b]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 (non-flash)
Dec 05 12:50:25 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 (non-flash)
Dec 05 12:50:25 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d907197-2cdc-4a34-99ba-478e07c0ae0e]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:25 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:50:26 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:50:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odwcvPqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:50:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:50:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23965646662343333', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:50:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965646662343333', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:50:26 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'flavor' on Instance uuid 62e2d4c2-14c2-41c4-bab0-3131622918ea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:50:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:50:26 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:50:26 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:50:26 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:50:26 user nova-compute[75071]:   <serial>351082ec-4952-4298-aba2-3a1c7e978385</serial>
Dec 05 12:50:26 user nova-compute[75071]: </disk>
Dec 05 12:50:26 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:50:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:50:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:50:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] No VIF found with MAC fa:16:3e:2c:27:7b, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:50:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0a43b26f-a651-4156-bc7e-330d4a139885 tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.056s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:50:28 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Creating image(s)
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Ensure instance console log exists: /opt/stack/data/nova/instances/8e787b1f-b8ed-48f8-baba-e168fab8c07f/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Start _get_guest_xml network_info=[{"id": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "address": "fa:16:3e:44:c2:36", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d2b8bc-7b", "ovs_interfaceid": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '796677d3-f618-4e0f-942f-7a13661938db', 'device_type': 'disk', 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoabxQMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8e787b1f-b8ed-48f8-baba-e168fab8c07f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4e46048-9848-4dec-b5eb-33e0e32679d5', 'serial': 'a4e46048-9848-4dec-b5eb-33e0e32679d5'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:50:28 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:50:28 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoabxQMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:50:28 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:50:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:50:28 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:50:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:50:28 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3999f965-9000-4f15-bada-fbf928705a91]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:50:28 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[abea425a-9545-494d-9bc6-b517fdd083b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5] added
Dec 05 12:50:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a15427-531c-458d-8982-1602c9e7b74c]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de6d925-1835-485d-84fb-c5c9309ca5b7]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoabxQMJ {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoabxQMJ" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe6f9cd-375c-4737-ab99-6ca9546fceee]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XoabxQMJ'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22e36f2-bd7b-49d2-b662-aa74565fb2f6]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd72ec5-19c4-459b-8973-cf8c76a24802]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 (non-flash)
Dec 05 12:50:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 (non-flash)
Dec 05 12:50:28 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:50:28 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74dec55-74d3-4562-aa26-30ce8d13e5c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5, portal: 172.16.0.220,3260]
Dec 05 12:50:29 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5, portal: 172.16.0.220,3260] successful.
Dec 05 12:50:29 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e789785e-b382-4e93-8ecd-e205bb34587d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d14cd8-cc2e-4123-8656-f670d7145a6a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 (non-flash)
Dec 05 12:50:29 user nova-compute[75071]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)
Dec 05 12:50:29 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 (non-flash)
Dec 05 12:50:29 user nova-compute[75071]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)
Dec 05 12:50:29 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cb463a-55ff-4dde-97f0-7e065784b5d7]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoabxQMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:50:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23935356339643264', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935356339643264', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:50:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1193594049',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1193594049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1193594049',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf8k8uSQcY6ScqM/828QXg8i7LDjELyewo53grPDVvJxD5v1siPYLA6tZy6bzluInPbhGFfi9Tctfdb0IJBqfZuDKQwxgNpFRKpp4c+dLyEj+VmMJwK45eaqZYM6fEFCA==',key_name='tempest-keypair-2121985300',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e87e18fa15d84a858a5e6c8306589285',ramdisk_id='',reservation_id='r-c1cnt57a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2021686022',owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:50:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c40b4872327a40968c5e7a5f89cd137a',uuid=8e787b1f-b8ed-48f8-baba-e168fab8c07f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "address": "fa:16:3e:44:c2:36", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d2b8bc-7b", "ovs_interfaceid": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converting VIF {"id": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "address": "fa:16:3e:44:c2:36", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d2b8bc-7b", "ovs_interfaceid": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:c2:36,bridge_name='br-int',has_traffic_filtering=True,id=d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d2b8bc-7b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG nova.objects.instance [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e787b1f-b8ed-48f8-baba-e168fab8c07f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:50:30 user nova-compute[75071]:   <uuid>8e787b1f-b8ed-48f8-baba-e168fab8c07f</uuid>
Dec 05 12:50:30 user nova-compute[75071]:   <name>instance-0000002e</name>
Dec 05 12:50:30 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:50:30 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:50:30 user nova-compute[75071]:   <metadata>
Dec 05 12:50:30 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:50:30 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:50:30 user nova-compute[75071]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1193594049</nova:name>
Dec 05 12:50:30 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:50:28</nova:creationTime>
Dec 05 12:50:30 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:50:30 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:50:30 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:50:30 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:50:30 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:50:30 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:50:30 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:50:30 user nova-compute[75071]:       <nova:owner>
Dec 05 12:50:30 user nova-compute[75071]:         <nova:user uuid="c40b4872327a40968c5e7a5f89cd137a">tempest-TestVolumeBootPattern-2021686022-project-member</nova:user>
Dec 05 12:50:30 user nova-compute[75071]:         <nova:project uuid="e87e18fa15d84a858a5e6c8306589285">tempest-TestVolumeBootPattern-2021686022</nova:project>
Dec 05 12:50:30 user nova-compute[75071]:       </nova:owner>
Dec 05 12:50:30 user nova-compute[75071]:       <nova:ports>
Dec 05 12:50:30 user nova-compute[75071]:         <nova:port uuid="d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037">
Dec 05 12:50:30 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 05 12:50:30 user nova-compute[75071]:         </nova:port>
Dec 05 12:50:30 user nova-compute[75071]:       </nova:ports>
Dec 05 12:50:30 user nova-compute[75071]:     </nova:instance>
Dec 05 12:50:30 user nova-compute[75071]:   </metadata>
Dec 05 12:50:30 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:50:30 user nova-compute[75071]:     <system>
Dec 05 12:50:30 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:50:30 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:50:30 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:50:30 user nova-compute[75071]:       <entry name="serial">8e787b1f-b8ed-48f8-baba-e168fab8c07f</entry>
Dec 05 12:50:30 user nova-compute[75071]:       <entry name="uuid">8e787b1f-b8ed-48f8-baba-e168fab8c07f</entry>
Dec 05 12:50:30 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:50:30 user nova-compute[75071]:     </system>
Dec 05 12:50:30 user nova-compute[75071]:   </sysinfo>
Dec 05 12:50:30 user nova-compute[75071]:   <os>
Dec 05 12:50:30 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:50:30 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:50:30 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:50:30 user nova-compute[75071]:   </os>
Dec 05 12:50:30 user nova-compute[75071]:   <features>
Dec 05 12:50:30 user nova-compute[75071]:     <acpi/>
Dec 05 12:50:30 user nova-compute[75071]:     <apic/>
Dec 05 12:50:30 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:50:30 user nova-compute[75071]:   </features>
Dec 05 12:50:30 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:50:30 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:50:30 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:50:30 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:50:30 user nova-compute[75071]:   </clock>
Dec 05 12:50:30 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:50:30 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:50:30 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:50:30 user nova-compute[75071]:   </cpu>
Dec 05 12:50:30 user nova-compute[75071]:   <devices>
Dec 05 12:50:30 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:50:30 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:50:30 user nova-compute[75071]:       <source dev="/dev/sdc"/>
Dec 05 12:50:30 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:50:30 user nova-compute[75071]:       <serial>a4e46048-9848-4dec-b5eb-33e0e32679d5</serial>
Dec 05 12:50:30 user nova-compute[75071]:     </disk>
Dec 05 12:50:30 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:50:30 user nova-compute[75071]:       <mac address="fa:16:3e:44:c2:36"/>
Dec 05 12:50:30 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:50:30 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:50:30 user nova-compute[75071]:       <target dev="tapd9d2b8bc-7b"/>
Dec 05 12:50:30 user nova-compute[75071]:     </interface>
Dec 05 12:50:30 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:50:30 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/8e787b1f-b8ed-48f8-baba-e168fab8c07f/console.log" append="off"/>
Dec 05 12:50:30 user nova-compute[75071]:     </serial>
Dec 05 12:50:30 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:50:30 user nova-compute[75071]:     <video>
Dec 05 12:50:30 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:50:30 user nova-compute[75071]:     </video>
Dec 05 12:50:30 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:50:30 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:50:30 user nova-compute[75071]:     </rng>
Dec 05 12:50:30 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:50:30 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:50:30 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:50:30 user nova-compute[75071]:     </memballoon>
Dec 05 12:50:30 user nova-compute[75071]:   </devices>
Dec 05 12:50:30 user nova-compute[75071]: </domain>
Dec 05 12:50:30 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:50:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1193594049',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1193594049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1193594049',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf8k8uSQcY6ScqM/828QXg8i7LDjELyewo53grPDVvJxD5v1siPYLA6tZy6bzluInPbhGFfi9Tctfdb0IJBqfZuDKQwxgNpFRKpp4c+dLyEj+VmMJwK45eaqZYM6fEFCA==',key_name='tempest-keypair-2121985300',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e87e18fa15d84a858a5e6c8306589285',ramdisk_id='',reservation_id='r-c1cnt57a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2021686022',owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:50:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c40b4872327a40968c5e7a5f89cd137a',uuid=8e787b1f-b8ed-48f8-baba-e168fab8c07f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "address": "fa:16:3e:44:c2:36", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d2b8bc-7b", "ovs_interfaceid": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converting VIF {"id": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "address": "fa:16:3e:44:c2:36", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d2b8bc-7b", "ovs_interfaceid": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:c2:36,bridge_name='br-int',has_traffic_filtering=True,id=d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d2b8bc-7b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG os_vif [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:c2:36,bridge_name='br-int',has_traffic_filtering=True,id=d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d2b8bc-7b') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6cd1cd8d-cd9b-553c-a22d-946504a853fa', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9d2b8bc-7b, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9d2b8bc-7b, col_values=(('qos', UUID('b8871332-45f6-4e87-a9c4-81e1c49c9b52')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9d2b8bc-7b, col_values=(('external_ids', {'iface-id': 'd9d2b8bc-7bc0-451b-ba28-73d1ab7f7037', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:c2:36', 'vm-uuid': '8e787b1f-b8ed-48f8-baba-e168fab8c07f'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:30 user nova-compute[75071]: INFO os_vif [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:c2:36,bridge_name='br-int',has_traffic_filtering=True,id=d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d2b8bc-7b')
Dec 05 12:50:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] No VIF found with MAC fa:16:3e:44:c2:36, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG nova.objects.instance [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'flavor' on Instance uuid 62e2d4c2-14c2-41c4-bab0-3131622918ea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:50:30 user nova-compute[75071]: INFO nova.compute.manager [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Attaching volume 1b4337b8-ade4-47d3-9932-504cf5c11b43 to /dev/vdc
Dec 05 12:50:30 user nova-compute[75071]: DEBUG os_brick.utils [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a313001-bd7b-494d-bfe1-e713191a1506]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[64255e17-013e-4000-883e-e3168179b622]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc08ba8-20c2-4f40-879c-d87cc2ffda7e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde2d4ae-045f-4205-a722-59ec0007142b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:50:30 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:50:30 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c190b94f-fc0d-4d98-821b-858fd5c6f1fe]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG os_brick.utils [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:50:30 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Updating existing volume attachment record: 16761d7b-f8d5-4a63-98dd-601af8176619 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:50:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-0c516848-062e-4579-a5d6-8a86360e0624 req-ed1e1a5d-07bc-4c90-8d11-7b3a58da356f service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Received event network-vif-plugged-d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:50:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0c516848-062e-4579-a5d6-8a86360e0624 req-ed1e1a5d-07bc-4c90-8d11-7b3a58da356f service nova] Acquiring lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:50:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0c516848-062e-4579-a5d6-8a86360e0624 req-ed1e1a5d-07bc-4c90-8d11-7b3a58da356f service nova] Lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:50:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0c516848-062e-4579-a5d6-8a86360e0624 req-ed1e1a5d-07bc-4c90-8d11-7b3a58da356f service nova] Lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:50:31 user nova-compute[75071]: DEBUG nova.compute.manager [req-0c516848-062e-4579-a5d6-8a86360e0624 req-ed1e1a5d-07bc-4c90-8d11-7b3a58da356f service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] No waiting events found dispatching network-vif-plugged-d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:50:31 user nova-compute[75071]: WARNING nova.compute.manager [req-0c516848-062e-4579-a5d6-8a86360e0624 req-ed1e1a5d-07bc-4c90-8d11-7b3a58da356f service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Received unexpected event network-vif-plugged-d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037 for instance with vm_state building and task_state spawning.
Dec 05 12:50:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:50:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:50:33 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Instance spawned successfully.
Dec 05 12:50:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:50:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:50:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:50:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:50:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:50:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:50:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:50:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-0b67a847-6092-46b3-8c50-508ecd373713 req-832ca07b-384f-49ff-8ac2-4abc7b5ff573 service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Received event network-vif-plugged-d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:50:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b67a847-6092-46b3-8c50-508ecd373713 req-832ca07b-384f-49ff-8ac2-4abc7b5ff573 service nova] Acquiring lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:50:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b67a847-6092-46b3-8c50-508ecd373713 req-832ca07b-384f-49ff-8ac2-4abc7b5ff573 service nova] Lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:50:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0b67a847-6092-46b3-8c50-508ecd373713 req-832ca07b-384f-49ff-8ac2-4abc7b5ff573 service nova] Lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:50:33 user nova-compute[75071]: DEBUG nova.compute.manager [req-0b67a847-6092-46b3-8c50-508ecd373713 req-832ca07b-384f-49ff-8ac2-4abc7b5ff573 service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] No waiting events found dispatching network-vif-plugged-d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:50:33 user nova-compute[75071]: WARNING nova.compute.manager [req-0b67a847-6092-46b3-8c50-508ecd373713 req-832ca07b-384f-49ff-8ac2-4abc7b5ff573 service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Received unexpected event network-vif-plugged-d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037 for instance with vm_state building and task_state spawning.
Dec 05 12:50:33 user nova-compute[75071]: INFO nova.compute.manager [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Took 5.06 seconds to spawn the instance on the hypervisor.
Dec 05 12:50:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:50:33 user nova-compute[75071]: INFO nova.compute.manager [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Took 15.25 seconds to build instance.
Dec 05 12:50:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-c9dc3738-5922-4ca6-9f2b-6abd9c75e05f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.394s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:50:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HQMleuyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:50:40 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:50:40 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:50:40 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1175dd92-97e2-412d-9ed2-e6dcc88012d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:50:40 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4958d73f-7d7e-4c02-8255-c92fe4ba9eea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43] added
Dec 05 12:50:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b48172-dedb-4e3d-8543-7970ba93e6cb]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff4fa45-df85-42a4-a39e-12257bd2cd74]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HQMleuyx {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HQMleuyx" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0fff5a-2c79-42bf-beed-f3b9781f9437]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HQMleuyx'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa74712c-cca8-4336-a875-77b7250936a8]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0e345e-e894-485f-8a7a-03b165f3b343]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 (non-flash)
Dec 05 12:50:40 user nova-compute[75071]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)
Dec 05 12:50:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 (non-flash)
Dec 05 12:50:40 user nova-compute[75071]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)
Dec 05 12:50:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4964076f-ad8b-4958-a425-409503763c5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43, portal: 172.16.0.220,3260]
Dec 05 12:50:40 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43, portal: 172.16.0.220,3260] successful.
Dec 05 12:50:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aad647c-07b3-4253-bfb8-fb7b172d3875]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f185ef7b-b260-4f86-9ac9-eabe41b8b24d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 (non-flash)
Dec 05 12:50:40 user nova-compute[75071]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)
Dec 05 12:50:40 user nova-compute[75071]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 (non-flash)
Dec 05 12:50:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 (non-flash)
Dec 05 12:50:40 user nova-compute[75071]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)
Dec 05 12:50:40 user nova-compute[75071]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 (non-flash)
Dec 05 12:50:40 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f739ed-4468-404d-946e-c36b6f2dcdda]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:50:40 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HQMleuyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:50:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:50:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23330306637323532', 'path': '/dev/sdd'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:50:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330306637323532', 'path': '/dev/sdd'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:50:41 user nova-compute[75071]: DEBUG nova.objects.instance [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'flavor' on Instance uuid 62e2d4c2-14c2-41c4-bab0-3131622918ea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:50:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:50:41 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:50:41 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Dec 05 12:50:41 user nova-compute[75071]:   <target dev="vdc" bus="virtio"/>
Dec 05 12:50:41 user nova-compute[75071]:   <serial>1b4337b8-ade4-47d3-9932-504cf5c11b43</serial>
Dec 05 12:50:41 user nova-compute[75071]: </disk>
Dec 05 12:50:41 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:50:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:50:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:50:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:50:41 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] No VIF found with MAC fa:16:3e:2c:27:7b, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:50:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8dc73cb4-ac73-428f-81d1-38ae71496e2c tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.359s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:50:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:50:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:50:42 user nova-compute[75071]: INFO nova.compute.manager [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Detaching volume 351082ec-4952-4298-aba2-3a1c7e978385
Dec 05 12:50:42 user nova-compute[75071]: INFO nova.virt.block_device [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Attempting to driver detach volume 351082ec-4952-4298-aba2-3a1c7e978385 from mountpoint /dev/vdb
Dec 05 12:50:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Attempting to detach device vdb from instance 62e2d4c2-14c2-41c4-bab0-3131622918ea from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:50:42 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:50:42 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:50:42 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:50:42 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:50:42 user nova-compute[75071]:   <serial>351082ec-4952-4298-aba2-3a1c7e978385</serial>
Dec 05 12:50:42 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:50:42 user nova-compute[75071]: </disk>
Dec 05 12:50:42 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:50:43 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Successfully detached device vdb from instance 62e2d4c2-14c2-41c4-bab0-3131622918ea from the persistent domain config.
Dec 05 12:50:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 62e2d4c2-14c2-41c4-bab0-3131622918ea from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:50:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:50:43 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:50:43 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:50:43 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:50:43 user nova-compute[75071]:   <serial>351082ec-4952-4298-aba2-3a1c7e978385</serial>
Dec 05 12:50:43 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:50:43 user nova-compute[75071]: </disk>
Dec 05 12:50:43 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:50:43 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 62e2d4c2-14c2-41c4-bab0-3131622918ea {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:50:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:50:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:51:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:51:03 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 62e2d4c2-14c2-41c4-bab0-3131622918ea is timed out.
Dec 05 12:51:03 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Successfully detached device vdb from instance 62e2d4c2-14c2-41c4-bab0-3131622918ea from the live domain config.
Dec 05 12:51:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'odwcvPqB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:51:03 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[add081e7-7149-4d3a-bd56-c4acd22e0eda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:51:03 user nova-compute[75071]: No targets found.
Dec 05 12:51:03 user nova-compute[75071]: iSNS:
Dec 05 12:51:03 user nova-compute[75071]: No targets found.
Dec 05 12:51:03 user nova-compute[75071]: STATIC:
Dec 05 12:51:03 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5
Dec 05 12:51:03 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:51:03 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:51:03 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385
Dec 05 12:51:03 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:51:03 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:51:03 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43
Dec 05 12:51:03 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:51:03 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:51:03 user nova-compute[75071]: FIRMWARE:
Dec 05 12:51:03 user nova-compute[75071]: No targets found.
Dec 05 12:51:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:51:03 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:51:03 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f355d4d-278b-4f67-94b2-bcd388f956a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c942e9c4-d655-44b7-be94-43923503b660]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 (non-flash)
Dec 05 12:51:03 user nova-compute[75071]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)
Dec 05 12:51:03 user nova-compute[75071]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 (non-flash)
Dec 05 12:51:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 (non-flash)
Dec 05 12:51:03 user nova-compute[75071]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)
Dec 05 12:51:03 user nova-compute[75071]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 (non-flash)
Dec 05 12:51:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8264609cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af4b379-65be-425a-856c-f61775267eaa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee98dca-cab5-472d-9cda-f52fa0cda45a]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[432d9655-024a-4365-9743-ab91326e8045]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[792474d9-2459-4012-ac51-57c4acc5518b]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38b5dbf-72ec-40d0-890c-fa5f91c08022]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[da425bb2-1a62-44ea-ada4-9cd3078ecea8]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385, portal: 172.16.0.220,3260]
Dec 05 12:51:03 user nova-compute[75071]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385, portal: 172.16.0.220,3260] successful.
Dec 05 12:51:03 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:351082ec-4952-4298-aba2-3a1c7e978385 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[894edb0c-45aa-4939-8220-b7491a583837]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] <== disconnect_volume: return (330ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:51:03 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:51:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:51:04 user nova-compute[75071]: DEBUG nova.objects.instance [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'flavor' on Instance uuid 62e2d4c2-14c2-41c4-bab0-3131622918ea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:51:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-786c490f-5f70-487d-bb28-a9d8300c556e tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.772s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:51:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:51:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:51:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:51:05 user nova-compute[75071]: INFO nova.compute.manager [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Detaching volume 1b4337b8-ade4-47d3-9932-504cf5c11b43
Dec 05 12:51:05 user nova-compute[75071]: INFO nova.virt.block_device [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Attempting to driver detach volume 1b4337b8-ade4-47d3-9932-504cf5c11b43 from mountpoint /dev/vdc
Dec 05 12:51:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Attempting to detach device vdc from instance 62e2d4c2-14c2-41c4-bab0-3131622918ea from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:51:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:51:05 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:51:05 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Dec 05 12:51:05 user nova-compute[75071]:   <target dev="vdc" bus="virtio"/>
Dec 05 12:51:05 user nova-compute[75071]:   <serial>1b4337b8-ade4-47d3-9932-504cf5c11b43</serial>
Dec 05 12:51:05 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 05 12:51:05 user nova-compute[75071]: </disk>
Dec 05 12:51:05 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:51:05 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Successfully detached device vdc from instance 62e2d4c2-14c2-41c4-bab0-3131622918ea from the persistent domain config.
Dec 05 12:51:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 62e2d4c2-14c2-41c4-bab0-3131622918ea from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:51:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:51:05 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:51:05 user nova-compute[75071]:   <source dev="/dev/sdd"/>
Dec 05 12:51:05 user nova-compute[75071]:   <target dev="vdc" bus="virtio"/>
Dec 05 12:51:05 user nova-compute[75071]:   <serial>1b4337b8-ade4-47d3-9932-504cf5c11b43</serial>
Dec 05 12:51:05 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 05 12:51:05 user nova-compute[75071]: </disk>
Dec 05 12:51:05 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:51:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 62e2d4c2-14c2-41c4-bab0-3131622918ea {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:51:09 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:51:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:51:10 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:51:10 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:51:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:51:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:51:12 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:51:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:51:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:51:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:51:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:51:13 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:51:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:13 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:14 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:51:14 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:51:14 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:51:14 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8825MB free_disk=25.001312255859375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:51:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:51:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:51:14 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 62e2d4c2-14c2-41c4-bab0-3131622918ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:51:14 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 8e787b1f-b8ed-48f8-baba-e168fab8c07f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:51:14 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:51:14 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:51:14 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:51:14 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:51:14 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:51:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:51:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:51:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:51:17 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:51:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:51:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:51:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:51:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 12:51:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-62e2d4c2-14c2-41c4-bab0-3131622918ea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:51:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-62e2d4c2-14c2-41c4-bab0-3131622918ea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:51:21 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:51:21 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lazy-loading 'info_cache' on Instance uuid 62e2d4c2-14c2-41c4-bab0-3131622918ea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:51:22 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Updating instance_info_cache with network_info: [{"id": "16f6b150-0148-4642-aa5b-d4074ff3800a", "address": "fa:16:3e:2c:27:7b", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f6b150-01", "ovs_interfaceid": "16f6b150-0148-4642-aa5b-d4074ff3800a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:51:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-62e2d4c2-14c2-41c4-bab0-3131622918ea" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:51:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:51:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:51:26 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 62e2d4c2-14c2-41c4-bab0-3131622918ea is timed out.
Dec 05 12:51:26 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Successfully detached device vdc from instance 62e2d4c2-14c2-41c4-bab0-3131622918ea from the live domain config.
Dec 05 12:51:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HQMleuyx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:51:26 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[11789023-f670-4f64-9f40-1793b22e5aa0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:51:26 user nova-compute[75071]: No targets found.
Dec 05 12:51:26 user nova-compute[75071]: iSNS:
Dec 05 12:51:26 user nova-compute[75071]: No targets found.
Dec 05 12:51:26 user nova-compute[75071]: STATIC:
Dec 05 12:51:26 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5
Dec 05 12:51:26 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:51:26 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:51:26 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43
Dec 05 12:51:26 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:51:26 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:51:26 user nova-compute[75071]: FIRMWARE:
Dec 05 12:51:26 user nova-compute[75071]: No targets found.
Dec 05 12:51:26 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:51:26 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:51:26 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa53cda-c3f7-4400-ba5c-9bc97a44c2a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfac9b11-fa48-4f81-be4d-8e0902e168d3]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)
Dec 05 12:51:26 user nova-compute[75071]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 (non-flash)
Dec 05 12:51:26 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)
Dec 05 12:51:26 user nova-compute[75071]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 (non-flash)
Dec 05 12:51:26 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f827410d2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43'): ({'sdd'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Removing single pathed devices sdd {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50b093d-6cee-43ca-9485-62730c20d545]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65cd647-6de2-4494-9fd2-0d1aa897bfc6]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Flushing IO for device /dev/sdd {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e79b37-a185-4fff-b8bf-8bbf5fcd10ff]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c86d76-e2e9-4d44-a57e-a6929c2e5cd0]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] SCSI volumes sdd have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ffd174-3065-4221-8314-d5e64f00846f]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ef29e4-e7ce-48ed-b58b-d9c1553e1861]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43, portal: 172.16.0.220,3260]
Dec 05 12:51:26 user nova-compute[75071]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43, portal: 172.16.0.220,3260] successful.
Dec 05 12:51:26 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b4337b8-ade4-47d3-9932-504cf5c11b43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[214faee3-2e15-486d-9145-f9e720f7d8e0]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] <== disconnect_volume: return (296ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:51:26 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:51:27 user nova-compute[75071]: DEBUG nova.objects.instance [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'flavor' on Instance uuid 62e2d4c2-14c2-41c4-bab0-3131622918ea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:51:27 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-e6f4d5db-3948-472e-8655-43ea91fad5da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.855s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:51:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:51:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:51:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "62e2d4c2-14c2-41c4-bab0-3131622918ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:51:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:51:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:51:28 user nova-compute[75071]: INFO nova.compute.manager [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Terminating instance
Dec 05 12:51:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:51:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:51:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:51:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:51:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:51:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-7a5adf62-791e-4e06-8926-c4e671232f63 req-18840a4d-602b-4bd8-954b-bdaa8175f38c service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Received event network-vif-unplugged-16f6b150-0148-4642-aa5b-d4074ff3800a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:51:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7a5adf62-791e-4e06-8926-c4e671232f63 req-18840a4d-602b-4bd8-954b-bdaa8175f38c service nova] Acquiring lock "62e2d4c2-14c2-41c4-bab0-3131622918ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:51:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7a5adf62-791e-4e06-8926-c4e671232f63 req-18840a4d-602b-4bd8-954b-bdaa8175f38c service nova] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:51:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7a5adf62-791e-4e06-8926-c4e671232f63 req-18840a4d-602b-4bd8-954b-bdaa8175f38c service nova] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:51:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-7a5adf62-791e-4e06-8926-c4e671232f63 req-18840a4d-602b-4bd8-954b-bdaa8175f38c service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] No waiting events found dispatching network-vif-unplugged-16f6b150-0148-4642-aa5b-d4074ff3800a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:51:28 user nova-compute[75071]: DEBUG nova.compute.manager [req-7a5adf62-791e-4e06-8926-c4e671232f63 req-18840a4d-602b-4bd8-954b-bdaa8175f38c service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Received event network-vif-unplugged-16f6b150-0148-4642-aa5b-d4074ff3800a for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:51:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:51:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Instance destroyed successfully.
Dec 05 12:51:29 user nova-compute[75071]: DEBUG nova.objects.instance [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lazy-loading 'resources' on Instance uuid 62e2d4c2-14c2-41c4-bab0-3131622918ea {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:51:29 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:48:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1315178069',display_name='tempest-AttachVolumeTestJSON-server-1315178069',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1315178069',id=45,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL583pZ8lCo9C8z0aETmRs8Bd94jQAvqteKXlE9SYHCWFMh1HwLf2FDvuCMewkDpyVjFxepUQbDw10yShgalC9Lq1SF4QrcOgZUV6myncyvxtRF62IHSnbdOt7vBI3GEHw==',key_name='tempest-keypair-1704924917',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:48:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9640f3ad175948f59ba184167e4bf5a9',ramdisk_id='',reservation_id='r-5a16dgrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-660715611',owner_user_name='tempest-AttachVolumeTestJSON-660715611-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:48:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b2ab4b19a9b4ce397ffa1cc279e26ac',uuid=62e2d4c2-14c2-41c4-bab0-3131622918ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "16f6b150-0148-4642-aa5b-d4074ff3800a", "address": "fa:16:3e:2c:27:7b", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f6b150-01", "ovs_interfaceid": "16f6b150-0148-4642-aa5b-d4074ff3800a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:51:29 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converting VIF {"id": "16f6b150-0148-4642-aa5b-d4074ff3800a", "address": "fa:16:3e:2c:27:7b", "network": {"id": "e33383e0-8123-4584-9e13-efb9ca6e501e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1418561524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9640f3ad175948f59ba184167e4bf5a9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16f6b150-01", "ovs_interfaceid": "16f6b150-0148-4642-aa5b-d4074ff3800a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:51:29 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=16f6b150-0148-4642-aa5b-d4074ff3800a,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16f6b150-01') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:51:29 user nova-compute[75071]: DEBUG os_vif [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=16f6b150-0148-4642-aa5b-d4074ff3800a,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16f6b150-01') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:51:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:51:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16f6b150-01, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:51:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:51:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:51:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a490788-9099-4e04-a7c9-6241487a8b18) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:51:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:51:29 user nova-compute[75071]: INFO os_vif [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:27:7b,bridge_name='br-int',has_traffic_filtering=True,id=16f6b150-0148-4642-aa5b-d4074ff3800a,network=Network(e33383e0-8123-4584-9e13-efb9ca6e501e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16f6b150-01')
Dec 05 12:51:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Deleting instance files /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea_del
Dec 05 12:51:29 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Deletion of /opt/stack/data/nova/instances/62e2d4c2-14c2-41c4-bab0-3131622918ea_del complete
Dec 05 12:51:29 user nova-compute[75071]: INFO nova.compute.manager [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Took 0.87 seconds to destroy the instance on the hypervisor.
Dec 05 12:51:29 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:51:29 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:51:29 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:51:29 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:51:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-2d00ae1c-0e82-475f-aa32-cfa479b7a182 req-ca854bdf-4b59-45a8-bbfe-1054cdc475c8 service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Received event network-vif-deleted-16f6b150-0148-4642-aa5b-d4074ff3800a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:51:29 user nova-compute[75071]: INFO nova.compute.manager [req-2d00ae1c-0e82-475f-aa32-cfa479b7a182 req-ca854bdf-4b59-45a8-bbfe-1054cdc475c8 service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Neutron deleted interface 16f6b150-0148-4642-aa5b-d4074ff3800a; detaching it from the instance and deleting it from the info cache
Dec 05 12:51:29 user nova-compute[75071]: DEBUG nova.network.neutron [req-2d00ae1c-0e82-475f-aa32-cfa479b7a182 req-ca854bdf-4b59-45a8-bbfe-1054cdc475c8 service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:51:29 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Took 0.69 seconds to deallocate network for instance.
Dec 05 12:51:29 user nova-compute[75071]: DEBUG nova.compute.manager [req-2d00ae1c-0e82-475f-aa32-cfa479b7a182 req-ca854bdf-4b59-45a8-bbfe-1054cdc475c8 service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Detach interface failed, port_id=16f6b150-0148-4642-aa5b-d4074ff3800a, reason: Instance 62e2d4c2-14c2-41c4-bab0-3131622918ea could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:51:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:51:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:51:30 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:51:30 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:51:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:51:30 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Deleted allocations for instance 62e2d4c2-14c2-41c4-bab0-3131622918ea
Dec 05 12:51:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9183d4d0-09c6-4279-919f-ca4be9ac92da tempest-AttachVolumeTestJSON-660715611 tempest-AttachVolumeTestJSON-660715611-project-member] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.958s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:51:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-06b86c42-a955-4ed9-9a27-edf0e5ddc04b req-e2ad7bc6-1b5d-46f4-a4ba-a08112b60ed8 service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Received event network-vif-plugged-16f6b150-0148-4642-aa5b-d4074ff3800a {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:51:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-06b86c42-a955-4ed9-9a27-edf0e5ddc04b req-e2ad7bc6-1b5d-46f4-a4ba-a08112b60ed8 service nova] Acquiring lock "62e2d4c2-14c2-41c4-bab0-3131622918ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:51:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-06b86c42-a955-4ed9-9a27-edf0e5ddc04b req-e2ad7bc6-1b5d-46f4-a4ba-a08112b60ed8 service nova] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:51:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-06b86c42-a955-4ed9-9a27-edf0e5ddc04b req-e2ad7bc6-1b5d-46f4-a4ba-a08112b60ed8 service nova] Lock "62e2d4c2-14c2-41c4-bab0-3131622918ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:51:30 user nova-compute[75071]: DEBUG nova.compute.manager [req-06b86c42-a955-4ed9-9a27-edf0e5ddc04b req-e2ad7bc6-1b5d-46f4-a4ba-a08112b60ed8 service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] No waiting events found dispatching network-vif-plugged-16f6b150-0148-4642-aa5b-d4074ff3800a {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:51:30 user nova-compute[75071]: WARNING nova.compute.manager [req-06b86c42-a955-4ed9-9a27-edf0e5ddc04b req-e2ad7bc6-1b5d-46f4-a4ba-a08112b60ed8 service nova] [instance: 62e2d4c2-14c2-41c4-bab0-3131622918ea] Received unexpected event network-vif-plugged-16f6b150-0148-4642-aa5b-d4074ff3800a for instance with vm_state deleted and task_state None.
Dec 05 12:51:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:51:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:51:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:51:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:51:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:51:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:51:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:51:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:51:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:51:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:51:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:51:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:51:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:51:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:51:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:51:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:52:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:52:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:52:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:52:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:52:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:05 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:52:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-3e53b4d3-d164-4219-9c3f-1b1d1a3ee882 req-179ad220-6c4b-4d4d-a774-4748b3477a73 service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Received event network-changed-d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:52:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-3e53b4d3-d164-4219-9c3f-1b1d1a3ee882 req-179ad220-6c4b-4d4d-a774-4748b3477a73 service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Refreshing instance network info cache due to event network-changed-d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:52:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e53b4d3-d164-4219-9c3f-1b1d1a3ee882 req-179ad220-6c4b-4d4d-a774-4748b3477a73 service nova] Acquiring lock "refresh_cache-8e787b1f-b8ed-48f8-baba-e168fab8c07f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:52:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e53b4d3-d164-4219-9c3f-1b1d1a3ee882 req-179ad220-6c4b-4d4d-a774-4748b3477a73 service nova] Acquired lock "refresh_cache-8e787b1f-b8ed-48f8-baba-e168fab8c07f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:52:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-3e53b4d3-d164-4219-9c3f-1b1d1a3ee882 req-179ad220-6c4b-4d4d-a774-4748b3477a73 service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Refreshing network info cache for port d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:52:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:09 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:52:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-3e53b4d3-d164-4219-9c3f-1b1d1a3ee882 req-179ad220-6c4b-4d4d-a774-4748b3477a73 service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Updated VIF entry in instance network info cache for port d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:52:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-3e53b4d3-d164-4219-9c3f-1b1d1a3ee882 req-179ad220-6c4b-4d4d-a774-4748b3477a73 service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Updating instance_info_cache with network_info: [{"id": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "address": "fa:16:3e:44:c2:36", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d2b8bc-7b", "ovs_interfaceid": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:52:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3e53b4d3-d164-4219-9c3f-1b1d1a3ee882 req-179ad220-6c4b-4d4d-a774-4748b3477a73 service nova] Releasing lock "refresh_cache-8e787b1f-b8ed-48f8-baba-e168fab8c07f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:52:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:52:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:52:12 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:52:12 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:52:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:52:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:52:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:52:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:52:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:52:14 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:52:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:52:15 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:52:15 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:52:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8983MB free_disk=25.028121948242188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:52:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:52:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:52:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 8e787b1f-b8ed-48f8-baba-e168fab8c07f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:52:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:52:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:52:15 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:52:15 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:52:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:52:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:52:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:18 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:52:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "58b87256-f425-43c0-9ace-1ef88e03a776" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:52:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "58b87256-f425-43c0-9ace-1ef88e03a776" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:52:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:52:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:52:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:52:18 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:52:18 user nova-compute[75071]: INFO nova.compute.claims [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Claim successful on node user
Dec 05 12:52:18 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:52:18 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:52:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.221s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:52:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:52:18 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:52:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:52:18 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:52:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:52:18 user nova-compute[75071]: INFO nova.virt.block_device [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Booting with volume snapshot b45bebde-9b03-4a80-a1ca-5b2251b58816 at /dev/vda
Dec 05 12:52:18 user nova-compute[75071]: DEBUG nova.policy [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c40b4872327a40968c5e7a5f89cd137a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87e18fa15d84a858a5e6c8306589285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:52:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:19 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Successfully created port: ed650c4a-11ae-4139-a825-3ff9538aa092 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:52:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Successfully updated port: ed650c4a-11ae-4139-a825-3ff9538aa092 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "refresh_cache-58b87256-f425-43c0-9ace-1ef88e03a776" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquired lock "refresh_cache-58b87256-f425-43c0-9ace-1ef88e03a776" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:52:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:52:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-3257eaac-00c0-479c-a947-085a4f0b4ff6 req-a252c8b4-f2b2-423d-b70d-cda85ab4e333 service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Received event network-changed-ed650c4a-11ae-4139-a825-3ff9538aa092 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:52:20 user nova-compute[75071]: DEBUG nova.compute.manager [req-3257eaac-00c0-479c-a947-085a4f0b4ff6 req-a252c8b4-f2b2-423d-b70d-cda85ab4e333 service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Refreshing instance network info cache due to event network-changed-ed650c4a-11ae-4139-a825-3ff9538aa092. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3257eaac-00c0-479c-a947-085a4f0b4ff6 req-a252c8b4-f2b2-423d-b70d-cda85ab4e333 service nova] Acquiring lock "refresh_cache-58b87256-f425-43c0-9ace-1ef88e03a776" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:52:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:52:20 user nova-compute[75071]: DEBUG nova.network.neutron [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Updating instance_info_cache with network_info: [{"id": "ed650c4a-11ae-4139-a825-3ff9538aa092", "address": "fa:16:3e:95:a8:f9", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped650c4a-11", "ovs_interfaceid": "ed650c4a-11ae-4139-a825-3ff9538aa092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Releasing lock "refresh_cache-58b87256-f425-43c0-9ace-1ef88e03a776" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:52:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Instance network_info: |[{"id": "ed650c4a-11ae-4139-a825-3ff9538aa092", "address": "fa:16:3e:95:a8:f9", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped650c4a-11", "ovs_interfaceid": "ed650c4a-11ae-4139-a825-3ff9538aa092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:52:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3257eaac-00c0-479c-a947-085a4f0b4ff6 req-a252c8b4-f2b2-423d-b70d-cda85ab4e333 service nova] Acquired lock "refresh_cache-58b87256-f425-43c0-9ace-1ef88e03a776" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:52:20 user nova-compute[75071]: DEBUG nova.network.neutron [req-3257eaac-00c0-479c-a947-085a4f0b4ff6 req-a252c8b4-f2b2-423d-b70d-cda85ab4e333 service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Refreshing network info cache for port ed650c4a-11ae-4139-a825-3ff9538aa092 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:52:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-3257eaac-00c0-479c-a947-085a4f0b4ff6 req-a252c8b4-f2b2-423d-b70d-cda85ab4e333 service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Updated VIF entry in instance network info cache for port ed650c4a-11ae-4139-a825-3ff9538aa092. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:52:21 user nova-compute[75071]: DEBUG nova.network.neutron [req-3257eaac-00c0-479c-a947-085a4f0b4ff6 req-a252c8b4-f2b2-423d-b70d-cda85ab4e333 service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Updating instance_info_cache with network_info: [{"id": "ed650c4a-11ae-4139-a825-3ff9538aa092", "address": "fa:16:3e:95:a8:f9", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped650c4a-11", "ovs_interfaceid": "ed650c4a-11ae-4139-a825-3ff9538aa092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:52:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-3257eaac-00c0-479c-a947-085a4f0b4ff6 req-a252c8b4-f2b2-423d-b70d-cda85ab4e333 service nova] Releasing lock "refresh_cache-58b87256-f425-43c0-9ace-1ef88e03a776" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:52:23 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:52:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:52:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-8e787b1f-b8ed-48f8-baba-e168fab8c07f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:52:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-8e787b1f-b8ed-48f8-baba-e168fab8c07f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:52:23 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Updating instance_info_cache with network_info: [{"id": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "address": "fa:16:3e:44:c2:36", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d2b8bc-7b", "ovs_interfaceid": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-8e787b1f-b8ed-48f8-baba-e168fab8c07f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG os_brick.utils [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3514c5-2f1c-494c-9833-fa4c9435fd02]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fab2ac-446f-4f19-bcaf-4ea4ec0e00ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c459b5-eaba-4b2b-af75-cd48cf4d423a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[66154b0b-229b-47d3-9e8e-1d67b77ccb92]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:52:24 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:52:24 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b228294-5689-4a7a-8316-6a82aab4de04]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG os_brick.utils [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:52:24 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Updating existing volume attachment record: a0d1e0c2-c828-4dcb-a51b-cf4635fb81d3 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:52:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Verify base images {{(pid=75071) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Image id 78202c92-ea63-4c60-a7cf-ac22107ae873 yields fingerprint 48afc3e5306bf5c5e5f63ed3b1f1116075427d96 {{(pid=75071) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75071) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] 8e787b1f-b8ed-48f8-baba-e168fab8c07f is a valid instance name {{(pid=75071) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 05 12:52:33 user nova-compute[75071]: WARNING nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Unknown base file: /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18
Dec 05 12:52:33 user nova-compute[75071]: WARNING nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Unknown base file: /opt/stack/data/nova/instances/_base/1b45fd392320e5c8c9c34d475e76cc19409456d9
Dec 05 12:52:33 user nova-compute[75071]: WARNING nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Unknown base file: /opt/stack/data/nova/instances/_base/992007aef39172abdffec43719adec38c8ee42d6
Dec 05 12:52:33 user nova-compute[75071]: WARNING nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Unknown base file: /opt/stack/data/nova/instances/_base/b9228069741ba74612c0465323e6f8c394d84bb9
Dec 05 12:52:33 user nova-compute[75071]: WARNING nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Unknown base file: /opt/stack/data/nova/instances/_base/dacafeaeb8cb00764d7099b6b93c26d7e94e5655
Dec 05 12:52:33 user nova-compute[75071]: WARNING nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Unknown base file: /opt/stack/data/nova/instances/_base/4fb8a478fd077b5909a679b30ad5f87d25ed3b78
Dec 05 12:52:33 user nova-compute[75071]: WARNING nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Unknown base file: /opt/stack/data/nova/instances/_base/abf92b803935b7c006ff6444550e1015589a942a
Dec 05 12:52:33 user nova-compute[75071]: WARNING nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Unknown base file: /opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b
Dec 05 12:52:33 user nova-compute[75071]: WARNING nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Unknown base file: /opt/stack/data/nova/instances/_base/1f66afeb7b71615884afd49cbe357a9bfe26f12c
Dec 05 12:52:33 user nova-compute[75071]: WARNING nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Unknown base file: /opt/stack/data/nova/instances/_base/d5f3fb99c27e4a4ef08367348f4ce741dacc741f
Dec 05 12:52:33 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Removable base files: /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 /opt/stack/data/nova/instances/_base/1b45fd392320e5c8c9c34d475e76cc19409456d9 /opt/stack/data/nova/instances/_base/992007aef39172abdffec43719adec38c8ee42d6 /opt/stack/data/nova/instances/_base/b9228069741ba74612c0465323e6f8c394d84bb9 /opt/stack/data/nova/instances/_base/dacafeaeb8cb00764d7099b6b93c26d7e94e5655 /opt/stack/data/nova/instances/_base/4fb8a478fd077b5909a679b30ad5f87d25ed3b78 /opt/stack/data/nova/instances/_base/abf92b803935b7c006ff6444550e1015589a942a /opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b /opt/stack/data/nova/instances/_base/1f66afeb7b71615884afd49cbe357a9bfe26f12c /opt/stack/data/nova/instances/_base/d5f3fb99c27e4a4ef08367348f4ce741dacc741f
Dec 05 12:52:33 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18
Dec 05 12:52:33 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1b45fd392320e5c8c9c34d475e76cc19409456d9
Dec 05 12:52:33 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/992007aef39172abdffec43719adec38c8ee42d6
Dec 05 12:52:33 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b9228069741ba74612c0465323e6f8c394d84bb9
Dec 05 12:52:33 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/dacafeaeb8cb00764d7099b6b93c26d7e94e5655
Dec 05 12:52:33 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4fb8a478fd077b5909a679b30ad5f87d25ed3b78
Dec 05 12:52:33 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/abf92b803935b7c006ff6444550e1015589a942a
Dec 05 12:52:33 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d0909f64c74f4e3908389a7cae90a4b018ba6b5b
Dec 05 12:52:33 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1f66afeb7b71615884afd49cbe357a9bfe26f12c
Dec 05 12:52:33 user nova-compute[75071]: INFO nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d5f3fb99c27e4a4ef08367348f4ce741dacc741f
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Verification complete {{(pid=75071) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Verify swap images {{(pid=75071) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.imagecache [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Verify ephemeral images {{(pid=75071) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:52:33 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Creating image(s)
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Ensure instance console log exists: /opt/stack/data/nova/instances/58b87256-f425-43c0-9ace-1ef88e03a776/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Start _get_guest_xml network_info=[{"id": "ed650c4a-11ae-4139-a825-3ff9538aa092", "address": "fa:16:3e:95:a8:f9", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped650c4a-11", "ovs_interfaceid": "ed650c4a-11ae-4139-a825-3ff9538aa092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-12-05T12:52:12Z,direct_url=<?>,disk_format='qcow2',id=78202c92-ea63-4c60-a7cf-ac22107ae873,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1071783830',owner='e87e18fa15d84a858a5e6c8306589285',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-12-05T12:52:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'a0d1e0c2-c828-4dcb-a51b-cf4635fb81d3', 'device_type': 'disk', 'delete_on_termination': True, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQhHEriN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '58b87256-f425-43c0-9ace-1ef88e03a776', 'attached_at': '', 'detached_at': '', 'volume_id': '3626057c-a07c-4770-a513-cff3207a81e2', 'serial': '3626057c-a07c-4770-a513-cff3207a81e2'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:52:33 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:52:33 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-12-05T12:52:12Z,direct_url=<?>,disk_format='qcow2',id=78202c92-ea63-4c60-a7cf-ac22107ae873,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1071783830',owner='e87e18fa15d84a858a5e6c8306589285',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-12-05T12:52:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQhHEriN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:52:33 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:52:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:52:33 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:52:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:52:33 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[76838277-fc42-4003-a0d3-9952c9653aba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:52:33 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[438dee21-e3d9-408d-b98f-893333586051]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2] added
Dec 05 12:52:33 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7437bf24-1e86-44c2-af45-5189455d8f29]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c30aa06-1300-4fad-83c5-16bcc8912b00]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OQhHEriN {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OQhHEriN" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b686e493-58f3-4070-a086-30e1a0133958]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OQhHEriN'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:52:33 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.069s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f6a1d3-94fa-4992-8320-b750461a738f]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2135e2f8-ba12-4177-af75-63bb6c07cbd4]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)
Dec 05 12:52:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)
Dec 05 12:52:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce2dd4b-775f-4695-a669-16c966f1d9b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2, portal: 172.16.0.220,3260]
Dec 05 12:52:34 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2, portal: 172.16.0.220,3260] successful.
Dec 05 12:52:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[52775a86-cf8a-46b8-910f-8bad45988986]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a72668-516b-49c1-923b-835d75a4c579]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)
Dec 05 12:52:34 user nova-compute[75071]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 (non-flash)
Dec 05 12:52:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)
Dec 05 12:52:34 user nova-compute[75071]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 (non-flash)
Dec 05 12:52:34 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb9cdbe-74be-437e-bc0b-60db94f0cdfc]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:52:34 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQhHEriN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26137653139333938', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137653139333938', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:52:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-672934616',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-672934616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-672934616',id=47,image_ref='78202c92-ea63-4c60-a7cf-ac22107ae873',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAusH7CsqLzeA9ZFUeU32G1PqkcDc1zxAFJ3mH2/l/UPYQsbazGzus7tREGABe6ZxrMpfwDG1SqUQwVMjq3qO7EypTZxuU1GH2vQhwKQYUDgNnIHKjmwv1g9FOE7EBI5Cg==',key_name='tempest-keypair-55924537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e87e18fa15d84a858a5e6c8306589285',ramdisk_id='',reservation_id='r-vd91ft5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2021686022',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2021686022',owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:52:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c40b4872327a40968c5e7a5f89cd137a',uuid=58b87256-f425-43c0-9ace-1ef88e03a776,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed650c4a-11ae-4139-a825-3ff9538aa092", "address": "fa:16:3e:95:a8:f9", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped650c4a-11", "ovs_interfaceid": "ed650c4a-11ae-4139-a825-3ff9538aa092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converting VIF {"id": "ed650c4a-11ae-4139-a825-3ff9538aa092", "address": "fa:16:3e:95:a8:f9", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped650c4a-11", "ovs_interfaceid": "ed650c4a-11ae-4139-a825-3ff9538aa092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:a8:f9,bridge_name='br-int',has_traffic_filtering=True,id=ed650c4a-11ae-4139-a825-3ff9538aa092,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped650c4a-11') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG nova.objects.instance [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lazy-loading 'pci_devices' on Instance uuid 58b87256-f425-43c0-9ace-1ef88e03a776 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:52:35 user nova-compute[75071]:   <uuid>58b87256-f425-43c0-9ace-1ef88e03a776</uuid>
Dec 05 12:52:35 user nova-compute[75071]:   <name>instance-0000002f</name>
Dec 05 12:52:35 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:52:35 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:52:35 user nova-compute[75071]:   <metadata>
Dec 05 12:52:35 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:52:35 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:52:35 user nova-compute[75071]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-672934616</nova:name>
Dec 05 12:52:35 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:52:33</nova:creationTime>
Dec 05 12:52:35 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:52:35 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:52:35 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:52:35 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:52:35 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:52:35 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:52:35 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:52:35 user nova-compute[75071]:       <nova:owner>
Dec 05 12:52:35 user nova-compute[75071]:         <nova:user uuid="c40b4872327a40968c5e7a5f89cd137a">tempest-TestVolumeBootPattern-2021686022-project-member</nova:user>
Dec 05 12:52:35 user nova-compute[75071]:         <nova:project uuid="e87e18fa15d84a858a5e6c8306589285">tempest-TestVolumeBootPattern-2021686022</nova:project>
Dec 05 12:52:35 user nova-compute[75071]:       </nova:owner>
Dec 05 12:52:35 user nova-compute[75071]:       <nova:root type="image" uuid="78202c92-ea63-4c60-a7cf-ac22107ae873"/>
Dec 05 12:52:35 user nova-compute[75071]:       <nova:ports>
Dec 05 12:52:35 user nova-compute[75071]:         <nova:port uuid="ed650c4a-11ae-4139-a825-3ff9538aa092">
Dec 05 12:52:35 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 05 12:52:35 user nova-compute[75071]:         </nova:port>
Dec 05 12:52:35 user nova-compute[75071]:       </nova:ports>
Dec 05 12:52:35 user nova-compute[75071]:     </nova:instance>
Dec 05 12:52:35 user nova-compute[75071]:   </metadata>
Dec 05 12:52:35 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:52:35 user nova-compute[75071]:     <system>
Dec 05 12:52:35 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:52:35 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:52:35 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:52:35 user nova-compute[75071]:       <entry name="serial">58b87256-f425-43c0-9ace-1ef88e03a776</entry>
Dec 05 12:52:35 user nova-compute[75071]:       <entry name="uuid">58b87256-f425-43c0-9ace-1ef88e03a776</entry>
Dec 05 12:52:35 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:52:35 user nova-compute[75071]:     </system>
Dec 05 12:52:35 user nova-compute[75071]:   </sysinfo>
Dec 05 12:52:35 user nova-compute[75071]:   <os>
Dec 05 12:52:35 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:52:35 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:52:35 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:52:35 user nova-compute[75071]:   </os>
Dec 05 12:52:35 user nova-compute[75071]:   <features>
Dec 05 12:52:35 user nova-compute[75071]:     <acpi/>
Dec 05 12:52:35 user nova-compute[75071]:     <apic/>
Dec 05 12:52:35 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:52:35 user nova-compute[75071]:   </features>
Dec 05 12:52:35 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:52:35 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:52:35 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:52:35 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:52:35 user nova-compute[75071]:   </clock>
Dec 05 12:52:35 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:52:35 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:52:35 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:52:35 user nova-compute[75071]:   </cpu>
Dec 05 12:52:35 user nova-compute[75071]:   <devices>
Dec 05 12:52:35 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:52:35 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:52:35 user nova-compute[75071]:       <source dev="/dev/sdb"/>
Dec 05 12:52:35 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:52:35 user nova-compute[75071]:       <serial>3626057c-a07c-4770-a513-cff3207a81e2</serial>
Dec 05 12:52:35 user nova-compute[75071]:     </disk>
Dec 05 12:52:35 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:52:35 user nova-compute[75071]:       <mac address="fa:16:3e:95:a8:f9"/>
Dec 05 12:52:35 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:52:35 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:52:35 user nova-compute[75071]:       <target dev="taped650c4a-11"/>
Dec 05 12:52:35 user nova-compute[75071]:     </interface>
Dec 05 12:52:35 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:52:35 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/58b87256-f425-43c0-9ace-1ef88e03a776/console.log" append="off"/>
Dec 05 12:52:35 user nova-compute[75071]:     </serial>
Dec 05 12:52:35 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:52:35 user nova-compute[75071]:     <video>
Dec 05 12:52:35 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:52:35 user nova-compute[75071]:     </video>
Dec 05 12:52:35 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:52:35 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:52:35 user nova-compute[75071]:     </rng>
Dec 05 12:52:35 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:52:35 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:52:35 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:52:35 user nova-compute[75071]:     </memballoon>
Dec 05 12:52:35 user nova-compute[75071]:   </devices>
Dec 05 12:52:35 user nova-compute[75071]: </domain>
Dec 05 12:52:35 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:52:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-672934616',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-672934616',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-672934616',id=47,image_ref='78202c92-ea63-4c60-a7cf-ac22107ae873',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAusH7CsqLzeA9ZFUeU32G1PqkcDc1zxAFJ3mH2/l/UPYQsbazGzus7tREGABe6ZxrMpfwDG1SqUQwVMjq3qO7EypTZxuU1GH2vQhwKQYUDgNnIHKjmwv1g9FOE7EBI5Cg==',key_name='tempest-keypair-55924537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e87e18fa15d84a858a5e6c8306589285',ramdisk_id='',reservation_id='r-vd91ft5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2021686022',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2021686022',owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:52:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c40b4872327a40968c5e7a5f89cd137a',uuid=58b87256-f425-43c0-9ace-1ef88e03a776,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed650c4a-11ae-4139-a825-3ff9538aa092", "address": "fa:16:3e:95:a8:f9", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped650c4a-11", "ovs_interfaceid": "ed650c4a-11ae-4139-a825-3ff9538aa092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converting VIF {"id": "ed650c4a-11ae-4139-a825-3ff9538aa092", "address": "fa:16:3e:95:a8:f9", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped650c4a-11", "ovs_interfaceid": "ed650c4a-11ae-4139-a825-3ff9538aa092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:a8:f9,bridge_name='br-int',has_traffic_filtering=True,id=ed650c4a-11ae-4139-a825-3ff9538aa092,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped650c4a-11') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG os_vif [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:a8:f9,bridge_name='br-int',has_traffic_filtering=True,id=ed650c4a-11ae-4139-a825-3ff9538aa092,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped650c4a-11') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '676f0702-d492-5ce5-880a-1372c827c90f', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped650c4a-11, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped650c4a-11, col_values=(('qos', UUID('5b2d3320-d3d0-4d39-9908-a4f9f232a588')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped650c4a-11, col_values=(('external_ids', {'iface-id': 'ed650c4a-11ae-4139-a825-3ff9538aa092', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:a8:f9', 'vm-uuid': '58b87256-f425-43c0-9ace-1ef88e03a776'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:35 user nova-compute[75071]: INFO os_vif [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:a8:f9,bridge_name='br-int',has_traffic_filtering=True,id=ed650c4a-11ae-4139-a825-3ff9538aa092,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped650c4a-11')
Dec 05 12:52:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] No VIF found with MAC fa:16:3e:95:a8:f9, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:52:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-a4529474-0cc5-4d48-ba7d-782f372cbf1a req-dda995ba-42b3-4300-9e3d-601d65f9dad1 service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Received event network-vif-plugged-ed650c4a-11ae-4139-a825-3ff9538aa092 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:52:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a4529474-0cc5-4d48-ba7d-782f372cbf1a req-dda995ba-42b3-4300-9e3d-601d65f9dad1 service nova] Acquiring lock "58b87256-f425-43c0-9ace-1ef88e03a776-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:52:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a4529474-0cc5-4d48-ba7d-782f372cbf1a req-dda995ba-42b3-4300-9e3d-601d65f9dad1 service nova] Lock "58b87256-f425-43c0-9ace-1ef88e03a776-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:52:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a4529474-0cc5-4d48-ba7d-782f372cbf1a req-dda995ba-42b3-4300-9e3d-601d65f9dad1 service nova] Lock "58b87256-f425-43c0-9ace-1ef88e03a776-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:52:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-a4529474-0cc5-4d48-ba7d-782f372cbf1a req-dda995ba-42b3-4300-9e3d-601d65f9dad1 service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] No waiting events found dispatching network-vif-plugged-ed650c4a-11ae-4139-a825-3ff9538aa092 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:52:36 user nova-compute[75071]: WARNING nova.compute.manager [req-a4529474-0cc5-4d48-ba7d-782f372cbf1a req-dda995ba-42b3-4300-9e3d-601d65f9dad1 service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Received unexpected event network-vif-plugged-ed650c4a-11ae-4139-a825-3ff9538aa092 for instance with vm_state building and task_state spawning.
Dec 05 12:52:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:52:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:52:38 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Instance spawned successfully.
Dec 05 12:52:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:52:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:52:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:52:38 user nova-compute[75071]: INFO nova.compute.manager [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Took 5.04 seconds to spawn the instance on the hypervisor.
Dec 05 12:52:38 user nova-compute[75071]: DEBUG nova.compute.manager [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:52:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-0d9c62e3-32c4-43f2-a61c-1525a589b0c5 req-6906c8fd-3250-4888-bc5d-f984e5494a9d service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Received event network-vif-plugged-ed650c4a-11ae-4139-a825-3ff9538aa092 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:52:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0d9c62e3-32c4-43f2-a61c-1525a589b0c5 req-6906c8fd-3250-4888-bc5d-f984e5494a9d service nova] Acquiring lock "58b87256-f425-43c0-9ace-1ef88e03a776-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:52:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0d9c62e3-32c4-43f2-a61c-1525a589b0c5 req-6906c8fd-3250-4888-bc5d-f984e5494a9d service nova] Lock "58b87256-f425-43c0-9ace-1ef88e03a776-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:52:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0d9c62e3-32c4-43f2-a61c-1525a589b0c5 req-6906c8fd-3250-4888-bc5d-f984e5494a9d service nova] Lock "58b87256-f425-43c0-9ace-1ef88e03a776-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:52:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-0d9c62e3-32c4-43f2-a61c-1525a589b0c5 req-6906c8fd-3250-4888-bc5d-f984e5494a9d service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] No waiting events found dispatching network-vif-plugged-ed650c4a-11ae-4139-a825-3ff9538aa092 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:52:38 user nova-compute[75071]: WARNING nova.compute.manager [req-0d9c62e3-32c4-43f2-a61c-1525a589b0c5 req-6906c8fd-3250-4888-bc5d-f984e5494a9d service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Received unexpected event network-vif-plugged-ed650c4a-11ae-4139-a825-3ff9538aa092 for instance with vm_state building and task_state spawning.
Dec 05 12:52:38 user nova-compute[75071]: INFO nova.compute.manager [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Took 20.51 seconds to build instance.
Dec 05 12:52:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-a5362d10-7042-41af-85ca-4a47ac1db58e tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "58b87256-f425-43c0-9ace-1ef88e03a776" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.598s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:52:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:52:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:52:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:53:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:53:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:53:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:53:07 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:53:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:53:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:53:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:53:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:53:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:53:12 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:53:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:53:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:53:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:53:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:53:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:53:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:53:14 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:53:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:53:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:53:15 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:53:15 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:53:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8858MB free_disk=25.016708374023438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:53:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:53:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:53:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:53:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 8e787b1f-b8ed-48f8-baba-e168fab8c07f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:53:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 58b87256-f425-43c0-9ace-1ef88e03a776 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:53:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:53:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:53:15 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:53:15 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:53:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:53:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:53:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:53:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:53:16 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:53:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:53:19 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:53:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:53:24 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:53:24 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:53:24 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 12:53:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-8e787b1f-b8ed-48f8-baba-e168fab8c07f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:53:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-8e787b1f-b8ed-48f8-baba-e168fab8c07f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:53:24 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:53:24 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lazy-loading 'info_cache' on Instance uuid 8e787b1f-b8ed-48f8-baba-e168fab8c07f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:53:25 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Updating instance_info_cache with network_info: [{"id": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "address": "fa:16:3e:44:c2:36", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d2b8bc-7b", "ovs_interfaceid": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:53:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-8e787b1f-b8ed-48f8-baba-e168fab8c07f" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:53:25 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:53:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:53:27 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:53:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 12:53:27 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 12:53:28 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:53:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 12:53:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:53:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:53:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:53:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:53:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:53:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:53:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:53:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:53:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:01 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_power_states {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:54:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 8e787b1f-b8ed-48f8-baba-e168fab8c07f {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:54:01 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Triggering sync for uuid 58b87256-f425-43c0-9ace-1ef88e03a776 {{(pid=75071) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 05 12:54:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:54:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:54:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "58b87256-f425-43c0-9ace-1ef88e03a776" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:54:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "58b87256-f425-43c0-9ace-1ef88e03a776" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:54:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "58b87256-f425-43c0-9ace-1ef88e03a776" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:54:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:54:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:07 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:54:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "58a640e9-e32f-4294-be4c-9751a5f3c988" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:54:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:54:08 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:54:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:54:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:54:08 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:54:08 user nova-compute[75071]: INFO nova.compute.claims [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Claim successful on node user
Dec 05 12:54:09 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.262s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:54:09 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:54:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-7627a613-d4a5-40ba-9798-2aa2b4d0bd49 req-04a07415-69c0-4e28-ae5d-76e5e70c6184 service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Received event network-changed-ed650c4a-11ae-4139-a825-3ff9538aa092 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG nova.compute.manager [req-7627a613-d4a5-40ba-9798-2aa2b4d0bd49 req-04a07415-69c0-4e28-ae5d-76e5e70c6184 service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Refreshing instance network info cache due to event network-changed-ed650c4a-11ae-4139-a825-3ff9538aa092. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7627a613-d4a5-40ba-9798-2aa2b4d0bd49 req-04a07415-69c0-4e28-ae5d-76e5e70c6184 service nova] Acquiring lock "refresh_cache-58b87256-f425-43c0-9ace-1ef88e03a776" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7627a613-d4a5-40ba-9798-2aa2b4d0bd49 req-04a07415-69c0-4e28-ae5d-76e5e70c6184 service nova] Acquired lock "refresh_cache-58b87256-f425-43c0-9ace-1ef88e03a776" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-7627a613-d4a5-40ba-9798-2aa2b4d0bd49 req-04a07415-69c0-4e28-ae5d-76e5e70c6184 service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Refreshing network info cache for port ed650c4a-11ae-4139-a825-3ff9538aa092 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG nova.policy [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7565c1aa17c04008bf6b18f9d1266789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12207f9ede84297ad7b3919e28b91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:54:09 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Creating image(s)
Dec 05 12:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "/opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "/opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "/opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk 1073741824" returned: 0 in 0.059s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:54:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.207s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "58b87256-f425-43c0-9ace-1ef88e03a776" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "58b87256-f425-43c0-9ace-1ef88e03a776" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "58b87256-f425-43c0-9ace-1ef88e03a776-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "58b87256-f425-43c0-9ace-1ef88e03a776-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "58b87256-f425-43c0-9ace-1ef88e03a776-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-7627a613-d4a5-40ba-9798-2aa2b4d0bd49 req-04a07415-69c0-4e28-ae5d-76e5e70c6184 service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Updated VIF entry in instance network info cache for port ed650c4a-11ae-4139-a825-3ff9538aa092. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG nova.network.neutron [req-7627a613-d4a5-40ba-9798-2aa2b4d0bd49 req-04a07415-69c0-4e28-ae5d-76e5e70c6184 service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Updating instance_info_cache with network_info: [{"id": "ed650c4a-11ae-4139-a825-3ff9538aa092", "address": "fa:16:3e:95:a8:f9", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped650c4a-11", "ovs_interfaceid": "ed650c4a-11ae-4139-a825-3ff9538aa092", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:54:10 user nova-compute[75071]: INFO nova.compute.manager [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Terminating instance
Dec 05 12:54:10 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7627a613-d4a5-40ba-9798-2aa2b4d0bd49 req-04a07415-69c0-4e28-ae5d-76e5e70c6184 service nova] Releasing lock "refresh_cache-58b87256-f425-43c0-9ace-1ef88e03a776" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Cannot resize image /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Ensure instance console log exists: /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Successfully created port: b3f8a93f-db39-4e16-8ede-fda30d1e6fbf {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-dea9ed62-4efc-42f9-961d-4bc587e7c7c9 req-e474c99c-1467-46e4-9b00-4f976afeb28e service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Received event network-vif-unplugged-ed650c4a-11ae-4139-a825-3ff9538aa092 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dea9ed62-4efc-42f9-961d-4bc587e7c7c9 req-e474c99c-1467-46e4-9b00-4f976afeb28e service nova] Acquiring lock "58b87256-f425-43c0-9ace-1ef88e03a776-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dea9ed62-4efc-42f9-961d-4bc587e7c7c9 req-e474c99c-1467-46e4-9b00-4f976afeb28e service nova] Lock "58b87256-f425-43c0-9ace-1ef88e03a776-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-dea9ed62-4efc-42f9-961d-4bc587e7c7c9 req-e474c99c-1467-46e4-9b00-4f976afeb28e service nova] Lock "58b87256-f425-43c0-9ace-1ef88e03a776-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-dea9ed62-4efc-42f9-961d-4bc587e7c7c9 req-e474c99c-1467-46e4-9b00-4f976afeb28e service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] No waiting events found dispatching network-vif-unplugged-ed650c4a-11ae-4139-a825-3ff9538aa092 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG nova.compute.manager [req-dea9ed62-4efc-42f9-961d-4bc587e7c7c9 req-e474c99c-1467-46e4-9b00-4f976afeb28e service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Received event network-vif-unplugged-ed650c4a-11ae-4139-a825-3ff9538aa092 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Successfully updated port: b3f8a93f-db39-4e16-8ede-fda30d1e6fbf {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:54:11 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Instance destroyed successfully.
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.objects.instance [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lazy-loading 'resources' on Instance uuid 58b87256-f425-43c0-9ace-1ef88e03a776 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:52:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-672934616',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-672934616',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-672934616',id=47,image_ref='78202c92-ea63-4c60-a7cf-ac22107ae873',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAusH7CsqLzeA9ZFUeU32G1PqkcDc1zxAFJ3mH2/l/UPYQsbazGzus7tREGABe6ZxrMpfwDG1SqUQwVMjq3qO7EypTZxuU1GH2vQhwKQYUDgNnIHKjmwv1g9FOE7EBI5Cg==',key_name='tempest-keypair-55924537',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:52:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e87e18fa15d84a858a5e6c8306589285',ramdisk_id='',reservation_id='r-vd91ft5d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2021686022',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2021686022',owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:52:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c40b4872327a40968c5e7a5f89cd137a',uuid=58b87256-f425-43c0-9ace-1ef88e03a776,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed650c4a-11ae-4139-a825-3ff9538aa092", "address": "fa:16:3e:95:a8:f9", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped650c4a-11", "ovs_interfaceid": "ed650c4a-11ae-4139-a825-3ff9538aa092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converting VIF {"id": "ed650c4a-11ae-4139-a825-3ff9538aa092", "address": "fa:16:3e:95:a8:f9", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped650c4a-11", "ovs_interfaceid": "ed650c4a-11ae-4139-a825-3ff9538aa092", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:a8:f9,bridge_name='br-int',has_traffic_filtering=True,id=ed650c4a-11ae-4139-a825-3ff9538aa092,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped650c4a-11') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_vif [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:a8:f9,bridge_name='br-int',has_traffic_filtering=True,id=ed650c4a-11ae-4139-a825-3ff9538aa092,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped650c4a-11') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "refresh_cache-58a640e9-e32f-4294-be4c-9751a5f3c988" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquired lock "refresh_cache-58a640e9-e32f-4294-be4c-9751a5f3c988" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped650c4a-11, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b2d3320-d3d0-4d39-9908-a4f9f232a588) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:54:11 user nova-compute[75071]: INFO os_vif [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:a8:f9,bridge_name='br-int',has_traffic_filtering=True,id=ed650c4a-11ae-4139-a825-3ff9538aa092,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped650c4a-11')
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OQhHEriN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:54:11 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d45b70d-0241-41be-b011-1707d97c4f95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:54:11 user nova-compute[75071]: No targets found.
Dec 05 12:54:11 user nova-compute[75071]: iSNS:
Dec 05 12:54:11 user nova-compute[75071]: No targets found.
Dec 05 12:54:11 user nova-compute[75071]: STATIC:
Dec 05 12:54:11 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5
Dec 05 12:54:11 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:54:11 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:54:11 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2
Dec 05 12:54:11 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:54:11 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:54:11 user nova-compute[75071]: FIRMWARE:
Dec 05 12:54:11 user nova-compute[75071]: No targets found.
Dec 05 12:54:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:54:11 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:54:11 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-26e5c282-265e-40ce-b836-3a44f3c93e93 req-309f4bc7-d8c6-4568-8474-43cf8e74e819 service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Received event network-changed-b3f8a93f-db39-4e16-8ede-fda30d1e6fbf {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.compute.manager [req-26e5c282-265e-40ce-b836-3a44f3c93e93 req-309f4bc7-d8c6-4568-8474-43cf8e74e819 service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Refreshing instance network info cache due to event network-changed-b3f8a93f-db39-4e16-8ede-fda30d1e6fbf. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-26e5c282-265e-40ce-b836-3a44f3c93e93 req-309f4bc7-d8c6-4568-8474-43cf8e74e819 service nova] Acquiring lock "refresh_cache-58a640e9-e32f-4294-be4c-9751a5f3c988" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd611545-2247-444e-a20e-926774c1f384]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b24b2d4-cd92-4be0-81d0-7872b0f6e68f]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)
Dec 05 12:54:11 user nova-compute[75071]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 (non-flash)
Dec 05 12:54:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)
Dec 05 12:54:11 user nova-compute[75071]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 (non-flash)
Dec 05 12:54:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f82641a4160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0496c64b-aaee-42fd-b465-20f274ecd1d6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ba7408-f081-455b-9501-94a98df7a562]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c69c542-961f-4c80-942a-0aee9ce0c2cc]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.185s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e1d05e-69ed-43b0-bbc9-6ec38edd73fd]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aead004b-9112-4ecd-aa1c-638728986ae2]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d6d2f5-c2c7-447e-b506-f90c43c60a80]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2, portal: 172.16.0.220,3260]
Dec 05 12:54:11 user nova-compute[75071]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2, portal: 172.16.0.220,3260] successful.
Dec 05 12:54:11 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3626057c-a07c-4770-a513-cff3207a81e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e683014-bb9a-4eeb-94d3-fd51f5a6141d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] <== disconnect_volume: return (440ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:54:11 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Deleting instance files /opt/stack/data/nova/instances/58b87256-f425-43c0-9ace-1ef88e03a776_del
Dec 05 12:54:11 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Deletion of /opt/stack/data/nova/instances/58b87256-f425-43c0-9ace-1ef88e03a776_del complete
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Updating instance_info_cache with network_info: [{"id": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "address": "fa:16:3e:d7:5d:8c", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3f8a93f-db", "ovs_interfaceid": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Releasing lock "refresh_cache-58a640e9-e32f-4294-be4c-9751a5f3c988" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Instance network_info: |[{"id": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "address": "fa:16:3e:d7:5d:8c", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3f8a93f-db", "ovs_interfaceid": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-26e5c282-265e-40ce-b836-3a44f3c93e93 req-309f4bc7-d8c6-4568-8474-43cf8e74e819 service nova] Acquired lock "refresh_cache-58a640e9-e32f-4294-be4c-9751a5f3c988" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.network.neutron [req-26e5c282-265e-40ce-b836-3a44f3c93e93 req-309f4bc7-d8c6-4568-8474-43cf8e74e819 service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Refreshing network info cache for port b3f8a93f-db39-4e16-8ede-fda30d1e6fbf {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Start _get_guest_xml network_info=[{"id": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "address": "fa:16:3e:d7:5d:8c", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3f8a93f-db", "ovs_interfaceid": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:54:11 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:54:11 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:54:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-81351338',display_name='tempest-VolumesSnapshotTestJSON-instance-81351338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-81351338',id=48,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuAdwVJlxIQui3CZYj+qeMJfl6QxMxoGxUqPRuyyxrguAv7tlJa4NA4+gcGiU29U6nvSUlR3UhkJ4CJJqd+lL5ybyVHgSeejvKMkeG5oiZ74xUXunt2wrXUpPolk2y2Sw==',key_name='tempest-keypair-2145278422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b12207f9ede84297ad7b3919e28b91ee',ramdisk_id='',reservation_id='r-aknwepe5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-570207846',owner_user_name='tempest-VolumesSnapshotTestJSON-570207846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:54:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7565c1aa17c04008bf6b18f9d1266789',uuid=58a640e9-e32f-4294-be4c-9751a5f3c988,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "address": "fa:16:3e:d7:5d:8c", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3f8a93f-db", "ovs_interfaceid": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Converting VIF {"id": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "address": "fa:16:3e:d7:5d:8c", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3f8a93f-db", "ovs_interfaceid": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:5d:8c,bridge_name='br-int',has_traffic_filtering=True,id=b3f8a93f-db39-4e16-8ede-fda30d1e6fbf,network=Network(d5f7a21d-7394-431d-b06f-677d94876d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3f8a93f-db') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lazy-loading 'pci_devices' on Instance uuid 58a640e9-e32f-4294-be4c-9751a5f3c988 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:54:11 user nova-compute[75071]:   <uuid>58a640e9-e32f-4294-be4c-9751a5f3c988</uuid>
Dec 05 12:54:11 user nova-compute[75071]:   <name>instance-00000030</name>
Dec 05 12:54:11 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:54:11 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:54:11 user nova-compute[75071]:   <metadata>
Dec 05 12:54:11 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:54:11 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:54:11 user nova-compute[75071]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-81351338</nova:name>
Dec 05 12:54:11 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:54:11</nova:creationTime>
Dec 05 12:54:11 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:54:11 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:54:11 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:54:11 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:54:11 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:54:11 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:54:11 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:54:11 user nova-compute[75071]:       <nova:owner>
Dec 05 12:54:11 user nova-compute[75071]:         <nova:user uuid="7565c1aa17c04008bf6b18f9d1266789">tempest-VolumesSnapshotTestJSON-570207846-project-member</nova:user>
Dec 05 12:54:11 user nova-compute[75071]:         <nova:project uuid="b12207f9ede84297ad7b3919e28b91ee">tempest-VolumesSnapshotTestJSON-570207846</nova:project>
Dec 05 12:54:11 user nova-compute[75071]:       </nova:owner>
Dec 05 12:54:11 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:54:11 user nova-compute[75071]:       <nova:ports>
Dec 05 12:54:11 user nova-compute[75071]:         <nova:port uuid="b3f8a93f-db39-4e16-8ede-fda30d1e6fbf">
Dec 05 12:54:11 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 05 12:54:11 user nova-compute[75071]:         </nova:port>
Dec 05 12:54:11 user nova-compute[75071]:       </nova:ports>
Dec 05 12:54:11 user nova-compute[75071]:     </nova:instance>
Dec 05 12:54:11 user nova-compute[75071]:   </metadata>
Dec 05 12:54:11 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:54:11 user nova-compute[75071]:     <system>
Dec 05 12:54:11 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:54:11 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:54:11 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:54:11 user nova-compute[75071]:       <entry name="serial">58a640e9-e32f-4294-be4c-9751a5f3c988</entry>
Dec 05 12:54:11 user nova-compute[75071]:       <entry name="uuid">58a640e9-e32f-4294-be4c-9751a5f3c988</entry>
Dec 05 12:54:11 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:54:11 user nova-compute[75071]:     </system>
Dec 05 12:54:11 user nova-compute[75071]:   </sysinfo>
Dec 05 12:54:11 user nova-compute[75071]:   <os>
Dec 05 12:54:11 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:54:11 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:54:11 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:54:11 user nova-compute[75071]:   </os>
Dec 05 12:54:11 user nova-compute[75071]:   <features>
Dec 05 12:54:11 user nova-compute[75071]:     <acpi/>
Dec 05 12:54:11 user nova-compute[75071]:     <apic/>
Dec 05 12:54:11 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:54:11 user nova-compute[75071]:   </features>
Dec 05 12:54:11 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:54:11 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:54:11 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:54:11 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:54:11 user nova-compute[75071]:   </clock>
Dec 05 12:54:11 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:54:11 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:54:11 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:54:11 user nova-compute[75071]:   </cpu>
Dec 05 12:54:11 user nova-compute[75071]:   <devices>
Dec 05 12:54:11 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:54:11 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:54:11 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk"/>
Dec 05 12:54:11 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:54:11 user nova-compute[75071]:     </disk>
Dec 05 12:54:11 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:54:11 user nova-compute[75071]:       <mac address="fa:16:3e:d7:5d:8c"/>
Dec 05 12:54:11 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:54:11 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:54:11 user nova-compute[75071]:       <target dev="tapb3f8a93f-db"/>
Dec 05 12:54:11 user nova-compute[75071]:     </interface>
Dec 05 12:54:11 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:54:11 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/console.log" append="off"/>
Dec 05 12:54:11 user nova-compute[75071]:     </serial>
Dec 05 12:54:11 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:54:11 user nova-compute[75071]:     <video>
Dec 05 12:54:11 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:54:11 user nova-compute[75071]:     </video>
Dec 05 12:54:11 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:54:11 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:54:11 user nova-compute[75071]:     </rng>
Dec 05 12:54:11 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:54:11 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:54:11 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:54:11 user nova-compute[75071]:     </memballoon>
Dec 05 12:54:11 user nova-compute[75071]:   </devices>
Dec 05 12:54:11 user nova-compute[75071]: </domain>
Dec 05 12:54:11 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:54:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-81351338',display_name='tempest-VolumesSnapshotTestJSON-instance-81351338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-81351338',id=48,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuAdwVJlxIQui3CZYj+qeMJfl6QxMxoGxUqPRuyyxrguAv7tlJa4NA4+gcGiU29U6nvSUlR3UhkJ4CJJqd+lL5ybyVHgSeejvKMkeG5oiZ74xUXunt2wrXUpPolk2y2Sw==',key_name='tempest-keypair-2145278422',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b12207f9ede84297ad7b3919e28b91ee',ramdisk_id='',reservation_id='r-aknwepe5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-570207846',owner_user_name='tempest-VolumesSnapshotTestJSON-570207846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:54:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7565c1aa17c04008bf6b18f9d1266789',uuid=58a640e9-e32f-4294-be4c-9751a5f3c988,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "address": "fa:16:3e:d7:5d:8c", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3f8a93f-db", "ovs_interfaceid": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Converting VIF {"id": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "address": "fa:16:3e:d7:5d:8c", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3f8a93f-db", "ovs_interfaceid": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:5d:8c,bridge_name='br-int',has_traffic_filtering=True,id=b3f8a93f-db39-4e16-8ede-fda30d1e6fbf,network=Network(d5f7a21d-7394-431d-b06f-677d94876d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3f8a93f-db') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG os_vif [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:5d:8c,bridge_name='br-int',has_traffic_filtering=True,id=b3f8a93f-db39-4e16-8ede-fda30d1e6fbf,network=Network(d5f7a21d-7394-431d-b06f-677d94876d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3f8a93f-db') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:54:11 user nova-compute[75071]: INFO nova.compute.manager [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Took 1.39 seconds to destroy the instance on the hypervisor.
Dec 05 12:54:11 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00b6f567-f353-5c7d-a5b9-5723f9a31714', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3f8a93f-db, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb3f8a93f-db, col_values=(('qos', UUID('53c9ddbc-415d-477c-af71-212bf8917747')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb3f8a93f-db, col_values=(('external_ids', {'iface-id': 'b3f8a93f-db39-4e16-8ede-fda30d1e6fbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:5d:8c', 'vm-uuid': '58a640e9-e32f-4294-be4c-9751a5f3c988'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:11 user nova-compute[75071]: INFO os_vif [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:5d:8c,bridge_name='br-int',has_traffic_filtering=True,id=b3f8a93f-db39-4e16-8ede-fda30d1e6fbf,network=Network(d5f7a21d-7394-431d-b06f-677d94876d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3f8a93f-db')
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:54:11 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] No VIF found with MAC fa:16:3e:d7:5d:8c, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:54:12 user nova-compute[75071]: DEBUG nova.network.neutron [req-26e5c282-265e-40ce-b836-3a44f3c93e93 req-309f4bc7-d8c6-4568-8474-43cf8e74e819 service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Updated VIF entry in instance network info cache for port b3f8a93f-db39-4e16-8ede-fda30d1e6fbf. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:54:12 user nova-compute[75071]: DEBUG nova.network.neutron [req-26e5c282-265e-40ce-b836-3a44f3c93e93 req-309f4bc7-d8c6-4568-8474-43cf8e74e819 service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Updating instance_info_cache with network_info: [{"id": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "address": "fa:16:3e:d7:5d:8c", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3f8a93f-db", "ovs_interfaceid": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:54:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-26e5c282-265e-40ce-b836-3a44f3c93e93 req-309f4bc7-d8c6-4568-8474-43cf8e74e819 service nova] Releasing lock "refresh_cache-58a640e9-e32f-4294-be4c-9751a5f3c988" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:54:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-de1a4f6c-d443-4b38-8b69-b9d323daec42 req-3d1bd378-b751-4112-aa78-c4996b689bef service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Received event network-vif-plugged-ed650c4a-11ae-4139-a825-3ff9538aa092 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:54:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-de1a4f6c-d443-4b38-8b69-b9d323daec42 req-3d1bd378-b751-4112-aa78-c4996b689bef service nova] Acquiring lock "58b87256-f425-43c0-9ace-1ef88e03a776-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:54:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-de1a4f6c-d443-4b38-8b69-b9d323daec42 req-3d1bd378-b751-4112-aa78-c4996b689bef service nova] Lock "58b87256-f425-43c0-9ace-1ef88e03a776-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:54:12 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-de1a4f6c-d443-4b38-8b69-b9d323daec42 req-3d1bd378-b751-4112-aa78-c4996b689bef service nova] Lock "58b87256-f425-43c0-9ace-1ef88e03a776-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:54:12 user nova-compute[75071]: DEBUG nova.compute.manager [req-de1a4f6c-d443-4b38-8b69-b9d323daec42 req-3d1bd378-b751-4112-aa78-c4996b689bef service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] No waiting events found dispatching network-vif-plugged-ed650c4a-11ae-4139-a825-3ff9538aa092 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:54:12 user nova-compute[75071]: WARNING nova.compute.manager [req-de1a4f6c-d443-4b38-8b69-b9d323daec42 req-3d1bd378-b751-4112-aa78-c4996b689bef service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Received unexpected event network-vif-plugged-ed650c4a-11ae-4139-a825-3ff9538aa092 for instance with vm_state active and task_state deleting.
Dec 05 12:54:12 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:54:12 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:54:12 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Took 1.09 seconds to deallocate network for instance.
Dec 05 12:54:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-bbebeab6-850a-4a2f-8e9a-6e7cfcbd89e2 req-24629488-a662-42fc-926e-cbbff09a12e2 service nova] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Received event network-vif-deleted-ed650c4a-11ae-4139-a825-3ff9538aa092 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-bbebeab6-850a-4a2f-8e9a-6e7cfcbd89e2 req-24629488-a662-42fc-926e-cbbff09a12e2 service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Received event network-vif-plugged-b3f8a93f-db39-4e16-8ede-fda30d1e6fbf {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bbebeab6-850a-4a2f-8e9a-6e7cfcbd89e2 req-24629488-a662-42fc-926e-cbbff09a12e2 service nova] Acquiring lock "58a640e9-e32f-4294-be4c-9751a5f3c988-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bbebeab6-850a-4a2f-8e9a-6e7cfcbd89e2 req-24629488-a662-42fc-926e-cbbff09a12e2 service nova] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bbebeab6-850a-4a2f-8e9a-6e7cfcbd89e2 req-24629488-a662-42fc-926e-cbbff09a12e2 service nova] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG nova.compute.manager [req-bbebeab6-850a-4a2f-8e9a-6e7cfcbd89e2 req-24629488-a662-42fc-926e-cbbff09a12e2 service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] No waiting events found dispatching network-vif-plugged-b3f8a93f-db39-4e16-8ede-fda30d1e6fbf {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:54:13 user nova-compute[75071]: WARNING nova.compute.manager [req-bbebeab6-850a-4a2f-8e9a-6e7cfcbd89e2 req-24629488-a662-42fc-926e-cbbff09a12e2 service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Received unexpected event network-vif-plugged-b3f8a93f-db39-4e16-8ede-fda30d1e6fbf for instance with vm_state building and task_state spawning.
Dec 05 12:54:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:13 user nova-compute[75071]: INFO nova.compute.manager [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Took 0.86 seconds to detach 1 volumes for instance.
Dec 05 12:54:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 58b87256-f425-43c0-9ace-1ef88e03a776] Deleting volume: 3626057c-a07c-4770-a513-cff3207a81e2 {{(pid=75071) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Refreshing inventories for resource provider 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Updating ProviderTree inventory for provider 25beb694-9dd7-475f-9657-74a5f0368417 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Updating inventory in ProviderTree for provider 25beb694-9dd7-475f-9657-74a5f0368417 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Refreshing aggregate associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Refreshing trait associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:54:13 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:54:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:54:14 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Deleted allocations for instance 58b87256-f425-43c0-9ace-1ef88e03a776
Dec 05 12:54:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-9dc8deb0-5f6f-4e11-b016-e21e213a21a1 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "58b87256-f425-43c0-9ace-1ef88e03a776" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.926s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:54:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:54:15 user nova-compute[75071]: DEBUG nova.compute.manager [req-7a4488d0-a52f-454b-9fa8-4f4879391248 req-1dd1fa5c-a86c-428c-a140-cbfe224bdbda service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Received event network-vif-plugged-b3f8a93f-db39-4e16-8ede-fda30d1e6fbf {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7a4488d0-a52f-454b-9fa8-4f4879391248 req-1dd1fa5c-a86c-428c-a140-cbfe224bdbda service nova] Acquiring lock "58a640e9-e32f-4294-be4c-9751a5f3c988-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7a4488d0-a52f-454b-9fa8-4f4879391248 req-1dd1fa5c-a86c-428c-a140-cbfe224bdbda service nova] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-7a4488d0-a52f-454b-9fa8-4f4879391248 req-1dd1fa5c-a86c-428c-a140-cbfe224bdbda service nova] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:54:15 user nova-compute[75071]: DEBUG nova.compute.manager [req-7a4488d0-a52f-454b-9fa8-4f4879391248 req-1dd1fa5c-a86c-428c-a140-cbfe224bdbda service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] No waiting events found dispatching network-vif-plugged-b3f8a93f-db39-4e16-8ede-fda30d1e6fbf {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:54:15 user nova-compute[75071]: WARNING nova.compute.manager [req-7a4488d0-a52f-454b-9fa8-4f4879391248 req-1dd1fa5c-a86c-428c-a140-cbfe224bdbda service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Received unexpected event network-vif-plugged-b3f8a93f-db39-4e16-8ede-fda30d1e6fbf for instance with vm_state building and task_state spawning.
Dec 05 12:54:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:54:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:54:15 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Instance spawned successfully.
Dec 05 12:54:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:54:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:54:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:54:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:54:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:54:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:54:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:54:15 user nova-compute[75071]: INFO nova.compute.manager [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Took 5.85 seconds to spawn the instance on the hypervisor.
Dec 05 12:54:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:54:15 user nova-compute[75071]: INFO nova.compute.manager [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Took 6.56 seconds to build instance.
Dec 05 12:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b737a505-a17c-47be-bfed-bcc40d63f542 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.667s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:54:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:54:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:54:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:54:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:54:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:54:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:54:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:54:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:54:16 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:54:16 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:54:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8895MB free_disk=25.004623413085938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:54:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:54:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:54:16 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 8e787b1f-b8ed-48f8-baba-e168fab8c07f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:54:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 58a640e9-e32f-4294-be4c-9751a5f3c988 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:54:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:54:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:54:16 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:54:16 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:54:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:54:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:54:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:20 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:54:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:26 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:54:26 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:54:26 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 12:54:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:54:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:54:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:54:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:54:26 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:31 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:54:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:55:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:55:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:55:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:55:04 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:55:04 user nova-compute[75071]: INFO nova.compute.manager [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Terminating instance
Dec 05 12:55:04 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-1d7b0976-7d58-4c6e-9943-c2b147522e77 req-adebeec1-2a18-496f-bf05-50dc6174aa89 service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Received event network-vif-unplugged-d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1d7b0976-7d58-4c6e-9943-c2b147522e77 req-adebeec1-2a18-496f-bf05-50dc6174aa89 service nova] Acquiring lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1d7b0976-7d58-4c6e-9943-c2b147522e77 req-adebeec1-2a18-496f-bf05-50dc6174aa89 service nova] Lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-1d7b0976-7d58-4c6e-9943-c2b147522e77 req-adebeec1-2a18-496f-bf05-50dc6174aa89 service nova] Lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-1d7b0976-7d58-4c6e-9943-c2b147522e77 req-adebeec1-2a18-496f-bf05-50dc6174aa89 service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] No waiting events found dispatching network-vif-unplugged-d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-1d7b0976-7d58-4c6e-9943-c2b147522e77 req-adebeec1-2a18-496f-bf05-50dc6174aa89 service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Received event network-vif-unplugged-d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:05 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Instance destroyed successfully.
Dec 05 12:55:05 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lazy-loading 'resources' on Instance uuid 8e787b1f-b8ed-48f8-baba-e168fab8c07f {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:50:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1193594049',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1193594049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1193594049',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEf8k8uSQcY6ScqM/828QXg8i7LDjELyewo53grPDVvJxD5v1siPYLA6tZy6bzluInPbhGFfi9Tctfdb0IJBqfZuDKQwxgNpFRKpp4c+dLyEj+VmMJwK45eaqZYM6fEFCA==',key_name='tempest-keypair-2121985300',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:50:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e87e18fa15d84a858a5e6c8306589285',ramdisk_id='',reservation_id='r-c1cnt57a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2021686022',owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:50:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c40b4872327a40968c5e7a5f89cd137a',uuid=8e787b1f-b8ed-48f8-baba-e168fab8c07f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "address": "fa:16:3e:44:c2:36", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d2b8bc-7b", "ovs_interfaceid": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converting VIF {"id": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "address": "fa:16:3e:44:c2:36", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d2b8bc-7b", "ovs_interfaceid": "d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:c2:36,bridge_name='br-int',has_traffic_filtering=True,id=d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d2b8bc-7b') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG os_vif [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:c2:36,bridge_name='br-int',has_traffic_filtering=True,id=d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d2b8bc-7b') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9d2b8bc-7b, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8871332-45f6-4e87-a9c4-81e1c49c9b52) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:55:05 user nova-compute[75071]: INFO os_vif [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:c2:36,bridge_name='br-int',has_traffic_filtering=True,id=d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d2b8bc-7b')
Dec 05 12:55:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoabxQMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:55:05 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:55:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c93e68-4fd7-4b9e-b748-8cba3d0fe99f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:55:05 user nova-compute[75071]: No targets found.
Dec 05 12:55:05 user nova-compute[75071]: iSNS:
Dec 05 12:55:05 user nova-compute[75071]: No targets found.
Dec 05 12:55:05 user nova-compute[75071]: STATIC:
Dec 05 12:55:05 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5
Dec 05 12:55:05 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:55:05 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:55:05 user nova-compute[75071]: FIRMWARE:
Dec 05 12:55:05 user nova-compute[75071]: No targets found.
Dec 05 12:55:05 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:55:05 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:55:05 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5f3f37-1f27-4265-a142-5cd5bdf5b462]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdd0f0f-bf88-4e68-9904-1441ffd1dacd]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)
Dec 05 12:55:05 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 (non-flash)
Dec 05 12:55:05 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f826416e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eef388f-4ace-46e0-b5e7-7132823e27a6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[640980c8-cc4d-467c-825d-cb781295ccbf]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[67387ea9-5def-4c3a-a0d7-eb9d18cddccb]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[feef245b-47d0-4d1c-bdf6-376da196a001]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23935356339643264', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_52dbb3f8', '/dev/disk/by-id/scsi-1SCST_BIO52dbb3f8-955c9d2db2ad3870') {{(pid=85641) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 05 12:55:05 user nova-compute[75071]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23935356339643264
Dec 05 12:55:05 user nova-compute[75071]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_52dbb3f8
Dec 05 12:55:05 user nova-compute[75071]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO52dbb3f8-955c9d2db2ad3870
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3322c4-5e89-4cd6-b063-cc37a39705a9]: (4, None) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[638890b9-d7fa-43fd-9277-229471d01203]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:55:05 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:55:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:55:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6db489b-a713-4dd4-89fa-ee3fe877451a]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:55:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5, portal: 172.16.0.220,3260]
Dec 05 12:55:06 user nova-compute[75071]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5, portal: 172.16.0.220,3260] successful.
Dec 05 12:55:06 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:55:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:55:06 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4e46048-9848-4dec-b5eb-33e0e32679d5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:55:06 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad9192a-5836-45da-8a1a-98c78ec6fe79]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:55:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:55:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:55:06 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] <== disconnect_volume: return (289ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:55:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:55:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Deleting instance files /opt/stack/data/nova/instances/8e787b1f-b8ed-48f8-baba-e168fab8c07f_del
Dec 05 12:55:06 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Deletion of /opt/stack/data/nova/instances/8e787b1f-b8ed-48f8-baba-e168fab8c07f_del complete
Dec 05 12:55:06 user nova-compute[75071]: INFO nova.compute.manager [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Took 1.17 seconds to destroy the instance on the hypervisor.
Dec 05 12:55:06 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:55:06 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:55:06 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:55:06 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:55:06 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Took 0.76 seconds to deallocate network for instance.
Dec 05 12:55:06 user nova-compute[75071]: DEBUG nova.compute.manager [req-ddd15ac7-23df-4f52-8a25-8b746cdefe4e req-c3243746-8c23-48b0-8127-612381bc87aa service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Received event network-vif-deleted-d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:55:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-906b504c-b60a-42e4-8129-41194a0a3d66 req-ba591d89-6b9c-4776-a9fe-9825a4c7349f service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Received event network-vif-plugged-d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:55:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-906b504c-b60a-42e4-8129-41194a0a3d66 req-ba591d89-6b9c-4776-a9fe-9825a4c7349f service nova] Acquiring lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:55:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-906b504c-b60a-42e4-8129-41194a0a3d66 req-ba591d89-6b9c-4776-a9fe-9825a4c7349f service nova] Lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:55:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-906b504c-b60a-42e4-8129-41194a0a3d66 req-ba591d89-6b9c-4776-a9fe-9825a4c7349f service nova] Lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:55:07 user nova-compute[75071]: DEBUG nova.compute.manager [req-906b504c-b60a-42e4-8129-41194a0a3d66 req-ba591d89-6b9c-4776-a9fe-9825a4c7349f service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] No waiting events found dispatching network-vif-plugged-d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:55:07 user nova-compute[75071]: WARNING nova.compute.manager [req-906b504c-b60a-42e4-8129-41194a0a3d66 req-ba591d89-6b9c-4776-a9fe-9825a4c7349f service nova] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Received unexpected event network-vif-plugged-d9d2b8bc-7bc0-451b-ba28-73d1ab7f7037 for instance with vm_state active and task_state deleting.
Dec 05 12:55:07 user nova-compute[75071]: INFO nova.compute.manager [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Took 0.79 seconds to detach 1 volumes for instance.
Dec 05 12:55:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8e787b1f-b8ed-48f8-baba-e168fab8c07f] Deleting volume: a4e46048-9848-4dec-b5eb-33e0e32679d5 {{(pid=75071) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 05 12:55:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:55:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:55:07 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:55:07 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:55:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:55:08 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Deleted allocations for instance 8e787b1f-b8ed-48f8-baba-e168fab8c07f
Dec 05 12:55:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b53c5753-b917-45e7-9061-2e626591f971 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "8e787b1f-b8ed-48f8-baba-e168fab8c07f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.158s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:55:08 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:55:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:55:12 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:55:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:55:13 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:55:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:55:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:55:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:55:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:55:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:55:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:55:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:55:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:55:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:55:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:55:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:55:16 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:55:16 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:55:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8963MB free_disk=24.975872039794922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:55:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:55:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:55:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 58a640e9-e32f-4294-be4c-9751a5f3c988 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:55:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:55:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:55:16 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:55:16 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:55:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:55:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:55:17 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:55:18 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:55:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:55:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:55:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:55:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:55:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:55:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:55:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:28 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:55:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:55:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 12:55:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-58a640e9-e32f-4294-be4c-9751a5f3c988" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:55:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-58a640e9-e32f-4294-be4c-9751a5f3c988" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:55:28 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:55:28 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lazy-loading 'info_cache' on Instance uuid 58a640e9-e32f-4294-be4c-9751a5f3c988 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:55:29 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Updating instance_info_cache with network_info: [{"id": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "address": "fa:16:3e:d7:5d:8c", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3f8a93f-db", "ovs_interfaceid": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:55:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-58a640e9-e32f-4294-be4c-9751a5f3c988" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:55:29 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:55:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:55:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:55:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:55:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:55:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:55:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:55:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba375a85-e85c-455d-9640-c50c3df4d3a9 req-05763048-e024-4435-97ff-43fb2cf6815f service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Received event network-changed-b3f8a93f-db39-4e16-8ede-fda30d1e6fbf {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:55:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-ba375a85-e85c-455d-9640-c50c3df4d3a9 req-05763048-e024-4435-97ff-43fb2cf6815f service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Refreshing instance network info cache due to event network-changed-b3f8a93f-db39-4e16-8ede-fda30d1e6fbf. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba375a85-e85c-455d-9640-c50c3df4d3a9 req-05763048-e024-4435-97ff-43fb2cf6815f service nova] Acquiring lock "refresh_cache-58a640e9-e32f-4294-be4c-9751a5f3c988" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba375a85-e85c-455d-9640-c50c3df4d3a9 req-05763048-e024-4435-97ff-43fb2cf6815f service nova] Acquired lock "refresh_cache-58a640e9-e32f-4294-be4c-9751a5f3c988" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:55:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-ba375a85-e85c-455d-9640-c50c3df4d3a9 req-05763048-e024-4435-97ff-43fb2cf6815f service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Refreshing network info cache for port b3f8a93f-db39-4e16-8ede-fda30d1e6fbf {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "58a640e9-e32f-4294-be4c-9751a5f3c988" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:55:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:55:59 user nova-compute[75071]: DEBUG nova.objects.instance [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lazy-loading 'flavor' on Instance uuid 58a640e9-e32f-4294-be4c-9751a5f3c988 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:56:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Ignoring supplied device name: /dev/vdb
Dec 05 12:56:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "58a640e9-e32f-4294-be4c-9751a5f3c988" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:56:00 user nova-compute[75071]: INFO nova.compute.manager [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Attaching volume d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 to /dev/vdb
Dec 05 12:56:00 user nova-compute[75071]: DEBUG nova.network.neutron [req-ba375a85-e85c-455d-9640-c50c3df4d3a9 req-05763048-e024-4435-97ff-43fb2cf6815f service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Updated VIF entry in instance network info cache for port b3f8a93f-db39-4e16-8ede-fda30d1e6fbf. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG nova.network.neutron [req-ba375a85-e85c-455d-9640-c50c3df4d3a9 req-05763048-e024-4435-97ff-43fb2cf6815f service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Updating instance_info_cache with network_info: [{"id": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "address": "fa:16:3e:d7:5d:8c", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3f8a93f-db", "ovs_interfaceid": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ba375a85-e85c-455d-9640-c50c3df4d3a9 req-05763048-e024-4435-97ff-43fb2cf6815f service nova] Releasing lock "refresh_cache-58a640e9-e32f-4294-be4c-9751a5f3c988" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG os_brick.utils [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6981ca-c5f0-45eb-ae32-3dd44928f322]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b217b9e-9922-4307-b7cd-6e484ca813e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b26914-51eb-4840-bbf6-aa18381182e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[955fb613-7445-4e66-8073-0efa003bfe20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:56:00 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:56:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada09896-1d88-41d6-8bf5-4263eb345445]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG os_brick.utils [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Updating existing volume attachment record: 3c69cc83-12fc-40df-be31-06c528022514 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:56:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:56:07 user nova-compute[75071]: INFO nova.compute.claims [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Claim successful on node user
Dec 05 12:56:07 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG nova.network.neutron [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:56:07 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:56:07 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG nova.policy [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c40b4872327a40968c5e7a5f89cd137a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87e18fa15d84a858a5e6c8306589285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:56:07 user nova-compute[75071]: INFO nova.virt.block_device [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Booting with volume 65085adc-56bb-4667-b4d1-46714871846d at /dev/vda
Dec 05 12:56:07 user nova-compute[75071]: DEBUG os_brick.utils [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[47520ffc-df35-44bc-827c-5459a9ff00fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f66d1a-a453-4714-a583-f50df086b526]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c02fa7-a179-46fa-9dd5-8cb9a04f1466]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced5259d-c485-42c6-b548-dc9fb7e82aa8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:56:07 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:56:07 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f29971b-3b4c-4f99-8a5d-9b9a7b9818d7]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG os_brick.utils [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:56:07 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Updating existing volume attachment record: 6216dae4-0b77-473c-80d6-56c14e5627c2 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:56:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Successfully created port: ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976 {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:56:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Successfully updated port: ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976 {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:56:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "refresh_cache-8cd0a34e-bf3d-4d87-a80d-c87da59e2400" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:56:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquired lock "refresh_cache-8cd0a34e-bf3d-4d87-a80d-c87da59e2400" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:56:08 user nova-compute[75071]: DEBUG nova.network.neutron [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:56:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-868f0d8c-0cf7-4879-817c-f31800eaadd1 req-4ab357d8-c9ff-44e8-ab48-70907e81889e service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Received event network-changed-ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:56:08 user nova-compute[75071]: DEBUG nova.compute.manager [req-868f0d8c-0cf7-4879-817c-f31800eaadd1 req-4ab357d8-c9ff-44e8-ab48-70907e81889e service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Refreshing instance network info cache due to event network-changed-ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:56:08 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-868f0d8c-0cf7-4879-817c-f31800eaadd1 req-4ab357d8-c9ff-44e8-ab48-70907e81889e service nova] Acquiring lock "refresh_cache-8cd0a34e-bf3d-4d87-a80d-c87da59e2400" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PivezXGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:56:09 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:56:09 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:56:09 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a20ece3-da40-4cb3-96a7-1f23ab6c7ea6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:56:09 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1dac50-dabd-4ca7-8f3a-755112012a9f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014] added
Dec 05 12:56:09 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10a8969-9c54-49aa-b2a3-909d27c73dba]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37c1e1a-af3e-4036-a3a1-5db315a0f20f]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PivezXGu {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PivezXGu" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7262d5a3-3035-4300-b317-f483e42001ee]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PivezXGu'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG nova.network.neutron [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Updating instance_info_cache with network_info: [{"id": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "address": "fa:16:3e:62:45:c8", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab68749a-0f", "ovs_interfaceid": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef961fa-cc7c-4d8d-84da-21b9c1601882]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Releasing lock "refresh_cache-8cd0a34e-bf3d-4d87-a80d-c87da59e2400" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Instance network_info: |[{"id": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "address": "fa:16:3e:62:45:c8", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab68749a-0f", "ovs_interfaceid": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-868f0d8c-0cf7-4879-817c-f31800eaadd1 req-4ab357d8-c9ff-44e8-ab48-70907e81889e service nova] Acquired lock "refresh_cache-8cd0a34e-bf3d-4d87-a80d-c87da59e2400" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-868f0d8c-0cf7-4879-817c-f31800eaadd1 req-4ab357d8-c9ff-44e8-ab48-70907e81889e service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Refreshing network info cache for port ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74e4653-390d-4dcb-8ce8-fd5536129edd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 12:56:09 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 12:56:09 user nova-compute[75071]:  {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:56:09 user nova-compute[75071]: WARNING os_brick.initiator.connectors.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 12:56:09 user nova-compute[75071]: 
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b880f89-1d25-41c7-b309-242eeedf21c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014, portal: 172.16.0.220,3260]
Dec 05 12:56:09 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014, portal: 172.16.0.220,3260] successful.
Dec 05 12:56:09 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c280974-cf11-42f5-b0e0-1ce6fb7ae2b7]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c1fa18-0b88-44e7-9930-b08a13275595]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 (non-flash)
Dec 05 12:56:09 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 (non-flash)
Dec 05 12:56:09 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[79347fc9-0a7b-4384-b1be-65cbc73b1ea4]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PivezXGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-868f0d8c-0cf7-4879-817c-f31800eaadd1 req-4ab357d8-c9ff-44e8-ab48-70907e81889e service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Updated VIF entry in instance network info cache for port ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG nova.network.neutron [req-868f0d8c-0cf7-4879-817c-f31800eaadd1 req-4ab357d8-c9ff-44e8-ab48-70907e81889e service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Updating instance_info_cache with network_info: [{"id": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "address": "fa:16:3e:62:45:c8", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab68749a-0f", "ovs_interfaceid": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:56:09 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-868f0d8c-0cf7-4879-817c-f31800eaadd1 req-4ab357d8-c9ff-44e8-ab48-70907e81889e service nova] Releasing lock "refresh_cache-8cd0a34e-bf3d-4d87-a80d-c87da59e2400" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:56:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:56:10 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23964643065353533', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:56:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23964643065353533', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:56:10 user nova-compute[75071]: DEBUG nova.objects.instance [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lazy-loading 'flavor' on Instance uuid 58a640e9-e32f-4294-be4c-9751a5f3c988 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:56:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:56:10 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:56:10 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:56:10 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:56:10 user nova-compute[75071]:   <serial>d6a8863f-2c1b-4bd3-9fda-f4e8723e7014</serial>
Dec 05 12:56:10 user nova-compute[75071]: </disk>
Dec 05 12:56:10 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:56:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:56:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:56:10 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] No VIF found with MAC fa:16:3e:d7:5d:8c, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:56:10 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-ee80c227-2ce1-4d37-abbf-8e68ac49365d tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.793s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:56:12 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:56:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:56:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:56:14 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:56:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:56:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:56:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:56:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:56:15 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:56:15 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:56:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:15 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:16 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:56:16 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:56:16 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:56:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8971MB free_disk=24.974170684814453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:56:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:56:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:56:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 58a640e9-e32f-4294-be4c-9751a5f3c988 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:56:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 8cd0a34e-bf3d-4d87-a80d-c87da59e2400 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:56:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:56:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:56:16 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:56:16 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:56:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:56:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:56:17 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Creating image(s)
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Ensure instance console log exists: /opt/stack/data/nova/instances/8cd0a34e-bf3d-4d87-a80d-c87da59e2400/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Start _get_guest_xml network_info=[{"id": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "address": "fa:16:3e:62:45:c8", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab68749a-0f", "ovs_interfaceid": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '6216dae4-0b77-473c-80d6-56c14e5627c2', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBJNEDGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8cd0a34e-bf3d-4d87-a80d-c87da59e2400', 'attached_at': '', 'detached_at': '', 'volume_id': '65085adc-56bb-4667-b4d1-46714871846d', 'serial': '65085adc-56bb-4667-b4d1-46714871846d'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:56:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:56:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBJNEDGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:56:17 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:56:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:56:17 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:56:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:56:17 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d59da53-1a9f-4d2d-a3be-3814bfcff9dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:56:17 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d82bb67-c9f8-490a-9357-4a5fa07e0c03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d] added
Dec 05 12:56:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92de83f-4a5a-4e55-8d67-dddefea78124]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6cf7e2-0c1d-4ca4-ba46-e4a5b9c6a6cc]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBJNEDGm {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBJNEDGm" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e99896e-9d40-4861-81ca-766a67fd87d7]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PBJNEDGm'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d907bb8-77f4-4186-933a-deb88cfaf52c]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a547cd-fb19-4684-8b2a-59a2d327688b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 (non-flash)
Dec 05 12:56:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 (non-flash)
Dec 05 12:56:17 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:56:17 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --login" returned: 0 in 1.054s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a36825-aa1e-4ac6-9d9d-e3d9d2fa35cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d, portal: 172.16.0.220,3260]
Dec 05 12:56:18 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d, portal: 172.16.0.220,3260] successful.
Dec 05 12:56:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3d0be8-efe3-46ac-b6bd-d5e73f63a430]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf2c192-157c-4db7-8962-2471a39e7784]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 (non-flash)
Dec 05 12:56:18 user nova-compute[75071]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 12:56:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 (non-flash)
Dec 05 12:56:18 user nova-compute[75071]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 12:56:18 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.296s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7088ca5-d246-4568-ab94-7987131568e5]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:18 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBJNEDGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.324s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] <== connect_volume: return (2325ms) {'type': 'block', 'scsi_wwn': '26332653363343335', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332653363343335', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1918204683',display_name='tempest-TestVolumeBootPattern-server-1918204683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1918204683',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEBRikV+rtdEtghEQfmH+IM9/Mf1uSkOrTuZKMd3fh01GANS6sbLHxh5KDsp9Ng70B85S/CxxQKzaJLbSYZ6L85stWFiwwGN+NjfmI3mt1Tl5tjNPt0cjz/NZ+xBmahPA==',key_name='tempest-TestVolumeBootPattern-1615085816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e87e18fa15d84a858a5e6c8306589285',ramdisk_id='',reservation_id='r-bi0b89i5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2021686022',owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:56:08Z,user_data=None,user_id='c40b4872327a40968c5e7a5f89cd137a',uuid=8cd0a34e-bf3d-4d87-a80d-c87da59e2400,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "address": "fa:16:3e:62:45:c8", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab68749a-0f", "ovs_interfaceid": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converting VIF {"id": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "address": "fa:16:3e:62:45:c8", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab68749a-0f", "ovs_interfaceid": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:45:c8,bridge_name='br-int',has_traffic_filtering=True,id=ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab68749a-0f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG nova.objects.instance [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cd0a34e-bf3d-4d87-a80d-c87da59e2400 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:56:19 user nova-compute[75071]:   <uuid>8cd0a34e-bf3d-4d87-a80d-c87da59e2400</uuid>
Dec 05 12:56:19 user nova-compute[75071]:   <name>instance-00000031</name>
Dec 05 12:56:19 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:56:19 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:56:19 user nova-compute[75071]:   <metadata>
Dec 05 12:56:19 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:56:19 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:56:19 user nova-compute[75071]:       <nova:name>tempest-TestVolumeBootPattern-server-1918204683</nova:name>
Dec 05 12:56:19 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:56:17</nova:creationTime>
Dec 05 12:56:19 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:56:19 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:56:19 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:56:19 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:56:19 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:56:19 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:56:19 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:56:19 user nova-compute[75071]:       <nova:owner>
Dec 05 12:56:19 user nova-compute[75071]:         <nova:user uuid="c40b4872327a40968c5e7a5f89cd137a">tempest-TestVolumeBootPattern-2021686022-project-member</nova:user>
Dec 05 12:56:19 user nova-compute[75071]:         <nova:project uuid="e87e18fa15d84a858a5e6c8306589285">tempest-TestVolumeBootPattern-2021686022</nova:project>
Dec 05 12:56:19 user nova-compute[75071]:       </nova:owner>
Dec 05 12:56:19 user nova-compute[75071]:       <nova:ports>
Dec 05 12:56:19 user nova-compute[75071]:         <nova:port uuid="ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976">
Dec 05 12:56:19 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 05 12:56:19 user nova-compute[75071]:         </nova:port>
Dec 05 12:56:19 user nova-compute[75071]:       </nova:ports>
Dec 05 12:56:19 user nova-compute[75071]:     </nova:instance>
Dec 05 12:56:19 user nova-compute[75071]:   </metadata>
Dec 05 12:56:19 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:56:19 user nova-compute[75071]:     <system>
Dec 05 12:56:19 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:56:19 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:56:19 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:56:19 user nova-compute[75071]:       <entry name="serial">8cd0a34e-bf3d-4d87-a80d-c87da59e2400</entry>
Dec 05 12:56:19 user nova-compute[75071]:       <entry name="uuid">8cd0a34e-bf3d-4d87-a80d-c87da59e2400</entry>
Dec 05 12:56:19 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:56:19 user nova-compute[75071]:     </system>
Dec 05 12:56:19 user nova-compute[75071]:   </sysinfo>
Dec 05 12:56:19 user nova-compute[75071]:   <os>
Dec 05 12:56:19 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:56:19 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:56:19 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:56:19 user nova-compute[75071]:   </os>
Dec 05 12:56:19 user nova-compute[75071]:   <features>
Dec 05 12:56:19 user nova-compute[75071]:     <acpi/>
Dec 05 12:56:19 user nova-compute[75071]:     <apic/>
Dec 05 12:56:19 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:56:19 user nova-compute[75071]:   </features>
Dec 05 12:56:19 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:56:19 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:56:19 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:56:19 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:56:19 user nova-compute[75071]:   </clock>
Dec 05 12:56:19 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:56:19 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:56:19 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:56:19 user nova-compute[75071]:   </cpu>
Dec 05 12:56:19 user nova-compute[75071]:   <devices>
Dec 05 12:56:19 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:56:19 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:56:19 user nova-compute[75071]:       <source dev="/dev/sdc"/>
Dec 05 12:56:19 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:56:19 user nova-compute[75071]:       <serial>65085adc-56bb-4667-b4d1-46714871846d</serial>
Dec 05 12:56:19 user nova-compute[75071]:     </disk>
Dec 05 12:56:19 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:56:19 user nova-compute[75071]:       <mac address="fa:16:3e:62:45:c8"/>
Dec 05 12:56:19 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:56:19 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:56:19 user nova-compute[75071]:       <target dev="tapab68749a-0f"/>
Dec 05 12:56:19 user nova-compute[75071]:     </interface>
Dec 05 12:56:19 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:56:19 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/8cd0a34e-bf3d-4d87-a80d-c87da59e2400/console.log" append="off"/>
Dec 05 12:56:19 user nova-compute[75071]:     </serial>
Dec 05 12:56:19 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:56:19 user nova-compute[75071]:     <video>
Dec 05 12:56:19 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:56:19 user nova-compute[75071]:     </video>
Dec 05 12:56:19 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:56:19 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:56:19 user nova-compute[75071]:     </rng>
Dec 05 12:56:19 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:56:19 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:56:19 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:56:19 user nova-compute[75071]:     </memballoon>
Dec 05 12:56:19 user nova-compute[75071]:   </devices>
Dec 05 12:56:19 user nova-compute[75071]: </domain>
Dec 05 12:56:19 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1918204683',display_name='tempest-TestVolumeBootPattern-server-1918204683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1918204683',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEBRikV+rtdEtghEQfmH+IM9/Mf1uSkOrTuZKMd3fh01GANS6sbLHxh5KDsp9Ng70B85S/CxxQKzaJLbSYZ6L85stWFiwwGN+NjfmI3mt1Tl5tjNPt0cjz/NZ+xBmahPA==',key_name='tempest-TestVolumeBootPattern-1615085816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e87e18fa15d84a858a5e6c8306589285',ramdisk_id='',reservation_id='r-bi0b89i5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2021686022',owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:56:08Z,user_data=None,user_id='c40b4872327a40968c5e7a5f89cd137a',uuid=8cd0a34e-bf3d-4d87-a80d-c87da59e2400,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "address": "fa:16:3e:62:45:c8", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab68749a-0f", "ovs_interfaceid": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converting VIF {"id": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "address": "fa:16:3e:62:45:c8", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab68749a-0f", "ovs_interfaceid": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:45:c8,bridge_name='br-int',has_traffic_filtering=True,id=ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab68749a-0f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG os_vif [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:45:c8,bridge_name='br-int',has_traffic_filtering=True,id=ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab68749a-0f') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ce65b60-c9f0-50aa-86d9-f9b7febbb259', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab68749a-0f, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab68749a-0f, col_values=(('qos', UUID('0d0d6c80-ef44-4f21-92eb-08646b47b3e7')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab68749a-0f, col_values=(('external_ids', {'iface-id': 'ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:45:c8', 'vm-uuid': '8cd0a34e-bf3d-4d87-a80d-c87da59e2400'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:19 user nova-compute[75071]: INFO os_vif [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:45:c8,bridge_name='br-int',has_traffic_filtering=True,id=ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab68749a-0f')
Dec 05 12:56:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] No VIF found with MAC fa:16:3e:62:45:c8, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:56:19 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:56:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-85ff2b12-4c5f-4d6b-8681-853e5af83a9d req-5989e9ab-1a0d-4f4a-8819-702d8f465894 service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Received event network-vif-plugged-ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:56:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-85ff2b12-4c5f-4d6b-8681-853e5af83a9d req-5989e9ab-1a0d-4f4a-8819-702d8f465894 service nova] Acquiring lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:56:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-85ff2b12-4c5f-4d6b-8681-853e5af83a9d req-5989e9ab-1a0d-4f4a-8819-702d8f465894 service nova] Lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:56:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-85ff2b12-4c5f-4d6b-8681-853e5af83a9d req-5989e9ab-1a0d-4f4a-8819-702d8f465894 service nova] Lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:56:21 user nova-compute[75071]: DEBUG nova.compute.manager [req-85ff2b12-4c5f-4d6b-8681-853e5af83a9d req-5989e9ab-1a0d-4f4a-8819-702d8f465894 service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] No waiting events found dispatching network-vif-plugged-ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:56:21 user nova-compute[75071]: WARNING nova.compute.manager [req-85ff2b12-4c5f-4d6b-8681-853e5af83a9d req-5989e9ab-1a0d-4f4a-8819-702d8f465894 service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Received unexpected event network-vif-plugged-ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976 for instance with vm_state building and task_state spawning.
Dec 05 12:56:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:21 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:56:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:56:22 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Instance spawned successfully.
Dec 05 12:56:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:56:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:56:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:56:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:56:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:56:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:56:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:56:23 user nova-compute[75071]: INFO nova.compute.manager [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Took 5.96 seconds to spawn the instance on the hypervisor.
Dec 05 12:56:23 user nova-compute[75071]: DEBUG nova.compute.manager [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:56:23 user nova-compute[75071]: INFO nova.compute.manager [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Took 15.86 seconds to build instance.
Dec 05 12:56:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-0ca4513c-eb54-4695-befa-657631a830f2 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.955s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:56:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-a1df034b-09fc-48b9-b946-04e0cddb7b52 req-c7876757-7bd9-49f1-80b8-9d180c2116cd service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Received event network-vif-plugged-ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:56:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a1df034b-09fc-48b9-b946-04e0cddb7b52 req-c7876757-7bd9-49f1-80b8-9d180c2116cd service nova] Acquiring lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:56:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a1df034b-09fc-48b9-b946-04e0cddb7b52 req-c7876757-7bd9-49f1-80b8-9d180c2116cd service nova] Lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:56:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a1df034b-09fc-48b9-b946-04e0cddb7b52 req-c7876757-7bd9-49f1-80b8-9d180c2116cd service nova] Lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:56:23 user nova-compute[75071]: DEBUG nova.compute.manager [req-a1df034b-09fc-48b9-b946-04e0cddb7b52 req-c7876757-7bd9-49f1-80b8-9d180c2116cd service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] No waiting events found dispatching network-vif-plugged-ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:56:23 user nova-compute[75071]: WARNING nova.compute.manager [req-a1df034b-09fc-48b9-b946-04e0cddb7b52 req-c7876757-7bd9-49f1-80b8-9d180c2116cd service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Received unexpected event network-vif-plugged-ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976 for instance with vm_state active and task_state None.
Dec 05 12:56:23 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:56:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:28 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:56:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:56:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 12:56:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-58a640e9-e32f-4294-be4c-9751a5f3c988" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:56:28 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-58a640e9-e32f-4294-be4c-9751a5f3c988" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:56:28 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:56:28 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lazy-loading 'info_cache' on Instance uuid 58a640e9-e32f-4294-be4c-9751a5f3c988 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:56:29 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Updating instance_info_cache with network_info: [{"id": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "address": "fa:16:3e:d7:5d:8c", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3f8a93f-db", "ovs_interfaceid": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:56:29 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-58a640e9-e32f-4294-be4c-9751a5f3c988" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:56:29 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:56:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:56:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:56:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:56:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:56:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "58a640e9-e32f-4294-be4c-9751a5f3c988" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:56:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:56:37 user nova-compute[75071]: INFO nova.compute.manager [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Detaching volume d6a8863f-2c1b-4bd3-9fda-f4e8723e7014
Dec 05 12:56:38 user nova-compute[75071]: INFO nova.virt.block_device [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Attempting to driver detach volume d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 from mountpoint /dev/vdb
Dec 05 12:56:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Attempting to detach device vdb from instance 58a640e9-e32f-4294-be4c-9751a5f3c988 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 12:56:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:56:38 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:56:38 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:56:38 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:56:38 user nova-compute[75071]:   <serial>d6a8863f-2c1b-4bd3-9fda-f4e8723e7014</serial>
Dec 05 12:56:38 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:56:38 user nova-compute[75071]: </disk>
Dec 05 12:56:38 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:56:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "58a640e9-e32f-4294-be4c-9751a5f3c988" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:56:38 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Successfully detached device vdb from instance 58a640e9-e32f-4294-be4c-9751a5f3c988 from the persistent domain config.
Dec 05 12:56:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 58a640e9-e32f-4294-be4c-9751a5f3c988 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 12:56:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 12:56:38 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:56:38 user nova-compute[75071]:   <source dev="/dev/sdb"/>
Dec 05 12:56:38 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:56:38 user nova-compute[75071]:   <serial>d6a8863f-2c1b-4bd3-9fda-f4e8723e7014</serial>
Dec 05 12:56:38 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 12:56:38 user nova-compute[75071]: </disk>
Dec 05 12:56:38 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 12:56:38 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 58a640e9-e32f-4294-be4c-9751a5f3c988 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 12:56:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:39 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:58 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 58a640e9-e32f-4294-be4c-9751a5f3c988 is timed out.
Dec 05 12:56:58 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Successfully detached device vdb from instance 58a640e9-e32f-4294-be4c-9751a5f3c988 from the live domain config.
Dec 05 12:56:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PivezXGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:56:58 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9295b8-cd8c-43d4-9550-b63229051e90]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:56:58 user nova-compute[75071]: No targets found.
Dec 05 12:56:58 user nova-compute[75071]: iSNS:
Dec 05 12:56:58 user nova-compute[75071]: No targets found.
Dec 05 12:56:58 user nova-compute[75071]: STATIC:
Dec 05 12:56:58 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d
Dec 05 12:56:58 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:56:58 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:56:58 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014
Dec 05 12:56:58 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:56:58 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:56:58 user nova-compute[75071]: FIRMWARE:
Dec 05 12:56:58 user nova-compute[75071]: No targets found.
Dec 05 12:56:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:56:58 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:56:58 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b3e7b1-afb3-4f13-b338-b53ba443f646]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6080be5f-b86f-4bcf-b499-2da2887931dd]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 (non-flash)
Dec 05 12:56:58 user nova-compute[75071]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 12:56:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 (non-flash)
Dec 05 12:56:58 user nova-compute[75071]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 12:56:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f826416f130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2892de-2cd1-47ef-8515-2c73563ed673]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa66e357-5c00-426a-b565-a2b32e5148ba]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[86481453-f1d6-429b-b5dc-bcc24702fe3c]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac52480-c59e-4fff-bd17-b20ce3d3e9cf]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9eff50-0d64-42b5-9b94-f20c6ebe11ba]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --logout" returned: 0 in 0.105s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[00486501-20c2-4a0d-81e7-a6188f2cbc95]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014, portal: 172.16.0.220,3260]
Dec 05 12:56:58 user nova-compute[75071]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014, portal: 172.16.0.220,3260] successful.
Dec 05 12:56:58 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a02ca3-0bc4-4663-a8fb-f2fcaf670904]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] <== disconnect_volume: return (345ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:56:58 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:56:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:59 user nova-compute[75071]: DEBUG nova.objects.instance [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lazy-loading 'flavor' on Instance uuid 58a640e9-e32f-4294-be4c-9751a5f3c988 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:56:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-72a0c935-32f1-4dab-a8e8-ee746cb364c6 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.875s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:56:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.747s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:56:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "58a640e9-e32f-4294-be4c-9751a5f3c988-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:56:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:56:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:56:59 user nova-compute[75071]: INFO nova.compute.manager [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Terminating instance
Dec 05 12:56:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:56:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:56:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-72b8b0a2-a931-4bb8-b3a6-474f7569d1d1 req-9ca29442-a3f2-4384-a269-617dfb9d79ad service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Received event network-vif-unplugged-b3f8a93f-db39-4e16-8ede-fda30d1e6fbf {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-72b8b0a2-a931-4bb8-b3a6-474f7569d1d1 req-9ca29442-a3f2-4384-a269-617dfb9d79ad service nova] Acquiring lock "58a640e9-e32f-4294-be4c-9751a5f3c988-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-72b8b0a2-a931-4bb8-b3a6-474f7569d1d1 req-9ca29442-a3f2-4384-a269-617dfb9d79ad service nova] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-72b8b0a2-a931-4bb8-b3a6-474f7569d1d1 req-9ca29442-a3f2-4384-a269-617dfb9d79ad service nova] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-72b8b0a2-a931-4bb8-b3a6-474f7569d1d1 req-9ca29442-a3f2-4384-a269-617dfb9d79ad service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] No waiting events found dispatching network-vif-unplugged-b3f8a93f-db39-4e16-8ede-fda30d1e6fbf {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG nova.compute.manager [req-72b8b0a2-a931-4bb8-b3a6-474f7569d1d1 req-9ca29442-a3f2-4384-a269-617dfb9d79ad service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Received event network-vif-unplugged-b3f8a93f-db39-4e16-8ede-fda30d1e6fbf for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:57:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Instance destroyed successfully.
Dec 05 12:57:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lazy-loading 'resources' on Instance uuid 58a640e9-e32f-4294-be4c-9751a5f3c988 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:54:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-81351338',display_name='tempest-VolumesSnapshotTestJSON-instance-81351338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-81351338',id=48,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuAdwVJlxIQui3CZYj+qeMJfl6QxMxoGxUqPRuyyxrguAv7tlJa4NA4+gcGiU29U6nvSUlR3UhkJ4CJJqd+lL5ybyVHgSeejvKMkeG5oiZ74xUXunt2wrXUpPolk2y2Sw==',key_name='tempest-keypair-2145278422',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:54:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b12207f9ede84297ad7b3919e28b91ee',ramdisk_id='',reservation_id='r-aknwepe5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-570207846',owner_user_name='tempest-VolumesSnapshotTestJSON-570207846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:54:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7565c1aa17c04008bf6b18f9d1266789',uuid=58a640e9-e32f-4294-be4c-9751a5f3c988,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "address": "fa:16:3e:d7:5d:8c", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3f8a93f-db", "ovs_interfaceid": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Converting VIF {"id": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "address": "fa:16:3e:d7:5d:8c", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3f8a93f-db", "ovs_interfaceid": "b3f8a93f-db39-4e16-8ede-fda30d1e6fbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:5d:8c,bridge_name='br-int',has_traffic_filtering=True,id=b3f8a93f-db39-4e16-8ede-fda30d1e6fbf,network=Network(d5f7a21d-7394-431d-b06f-677d94876d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3f8a93f-db') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG os_vif [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:5d:8c,bridge_name='br-int',has_traffic_filtering=True,id=b3f8a93f-db39-4e16-8ede-fda30d1e6fbf,network=Network(d5f7a21d-7394-431d-b06f-677d94876d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3f8a93f-db') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3f8a93f-db, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53c9ddbc-415d-477c-af71-212bf8917747) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:57:00 user nova-compute[75071]: INFO os_vif [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:5d:8c,bridge_name='br-int',has_traffic_filtering=True,id=b3f8a93f-db39-4e16-8ede-fda30d1e6fbf,network=Network(d5f7a21d-7394-431d-b06f-677d94876d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3f8a93f-db')
Dec 05 12:57:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PivezXGu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:57:00 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:57:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faa24fc-0bef-41c4-a63f-cc063a92dd12]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:57:00 user nova-compute[75071]: No targets found.
Dec 05 12:57:00 user nova-compute[75071]: iSNS:
Dec 05 12:57:00 user nova-compute[75071]: No targets found.
Dec 05 12:57:00 user nova-compute[75071]: STATIC:
Dec 05 12:57:00 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d
Dec 05 12:57:00 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:57:00 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:57:00 user nova-compute[75071]: FIRMWARE:
Dec 05 12:57:00 user nova-compute[75071]: No targets found.
Dec 05 12:57:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:57:00 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:57:00 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6a8863f-2c1b-4bd3-9fda-f4e8723e7014', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe738a25-3555-4194-b3a5-bde9e487f95c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e389aef-a010-4d4a-8257-25b5d101d530]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 12:57:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 12:57:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f826416dcf0>, {}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Disconnecting from: [] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] <== disconnect_volume: return (67ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:57:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Deleting instance files /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988_del
Dec 05 12:57:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Deletion of /opt/stack/data/nova/instances/58a640e9-e32f-4294-be4c-9751a5f3c988_del complete
Dec 05 12:57:00 user nova-compute[75071]: INFO nova.compute.manager [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Took 0.91 seconds to destroy the instance on the hypervisor.
Dec 05 12:57:00 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:57:00 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:57:01 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:57:01 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Took 1.16 seconds to deallocate network for instance.
Dec 05 12:57:01 user nova-compute[75071]: WARNING nova.volume.cinder [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Attachment 3c69cc83-12fc-40df-be31-06c528022514 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3c69cc83-12fc-40df-be31-06c528022514. (HTTP 404) (Request-ID: req-fd2d0c15-9600-41f6-9961-5d338bcd6d8f)
Dec 05 12:57:01 user nova-compute[75071]: INFO nova.compute.manager [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Took 0.02 seconds to detach 1 volumes for instance.
Dec 05 12:57:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:57:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:57:02 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:57:02 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:57:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:57:02 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Deleted allocations for instance 58a640e9-e32f-4294-be4c-9751a5f3c988
Dec 05 12:57:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-be53394d-ea66-489f-a2fc-f50577a8359b req-aea820b0-9ac4-440b-84ea-e59155e59062 service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Received event network-vif-plugged-b3f8a93f-db39-4e16-8ede-fda30d1e6fbf {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:57:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-be53394d-ea66-489f-a2fc-f50577a8359b req-aea820b0-9ac4-440b-84ea-e59155e59062 service nova] Acquiring lock "58a640e9-e32f-4294-be4c-9751a5f3c988-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:57:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-be53394d-ea66-489f-a2fc-f50577a8359b req-aea820b0-9ac4-440b-84ea-e59155e59062 service nova] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:57:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-be53394d-ea66-489f-a2fc-f50577a8359b req-aea820b0-9ac4-440b-84ea-e59155e59062 service nova] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:57:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-be53394d-ea66-489f-a2fc-f50577a8359b req-aea820b0-9ac4-440b-84ea-e59155e59062 service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] No waiting events found dispatching network-vif-plugged-b3f8a93f-db39-4e16-8ede-fda30d1e6fbf {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:57:02 user nova-compute[75071]: WARNING nova.compute.manager [req-be53394d-ea66-489f-a2fc-f50577a8359b req-aea820b0-9ac4-440b-84ea-e59155e59062 service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Received unexpected event network-vif-plugged-b3f8a93f-db39-4e16-8ede-fda30d1e6fbf for instance with vm_state deleted and task_state None.
Dec 05 12:57:02 user nova-compute[75071]: DEBUG nova.compute.manager [req-be53394d-ea66-489f-a2fc-f50577a8359b req-aea820b0-9ac4-440b-84ea-e59155e59062 service nova] [instance: 58a640e9-e32f-4294-be4c-9751a5f3c988] Received event network-vif-deleted-b3f8a93f-db39-4e16-8ede-fda30d1e6fbf {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:57:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-7de17e27-22df-45e2-95c7-445b0aa37be7 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "58a640e9-e32f-4294-be4c-9751a5f3c988" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.403s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:57:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:11 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:57:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:57:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:57:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:57:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:57:15 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:57:16 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:57:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:57:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:57:16 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:57:16 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:57:16 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:57:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:57:17 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:57:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8977MB free_disk=25.000198364257812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:57:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:57:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:57:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance 8cd0a34e-bf3d-4d87-a80d-c87da59e2400 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:57:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:57:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:57:17 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:57:17 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:57:17 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:57:17 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:57:18 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:57:19 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:57:19 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:57:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:57:23 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:57:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:57:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:57:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:57:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:57:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:30 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:57:30 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:57:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-8cd0a34e-bf3d-4d87-a80d-c87da59e2400" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:57:30 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-8cd0a34e-bf3d-4d87-a80d-c87da59e2400" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:57:30 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:57:31 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Updating instance_info_cache with network_info: [{"id": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "address": "fa:16:3e:62:45:c8", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab68749a-0f", "ovs_interfaceid": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:57:31 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-8cd0a34e-bf3d-4d87-a80d-c87da59e2400" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:57:31 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:57:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:57:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:57:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:57:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:57:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "d467afb8-5ec3-4edd-b894-3894122515e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:57:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "d467afb8-5ec3-4edd-b894-3894122515e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:57:49 user nova-compute[75071]: DEBUG nova.compute.manager [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:57:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:57:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:57:49 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:57:49 user nova-compute[75071]: INFO nova.compute.claims [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Claim successful on node user
Dec 05 12:57:49 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:57:49 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:57:49 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.230s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:57:49 user nova-compute[75071]: DEBUG nova.compute.manager [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:57:49 user nova-compute[75071]: DEBUG nova.compute.manager [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:57:49 user nova-compute[75071]: DEBUG nova.network.neutron [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:57:49 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:57:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG nova.policy [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7565c1aa17c04008bf6b18f9d1266789', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b12207f9ede84297ad7b3919e28b91ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG nova.compute.manager [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:57:50 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Creating image(s)
Dec 05 12:57:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "/opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "/opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "/opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "3f1e5b38668af97682fa1052af2e16c983340a18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.181s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk 1073741824 {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18,backing_fmt=raw /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk 1073741824" returned: 0 in 0.054s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "3f1e5b38668af97682fa1052af2e16c983340a18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG nova.network.neutron [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Successfully created port: c53ce8ad-40f6-4b44-b067-3b9b770123ac {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f1e5b38668af97682fa1052af2e16c983340a18 --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk. size=1073741824 {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG nova.virt.disk.api [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Cannot resize image /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk to a smaller size. {{(pid=75071) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Created local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Ensure instance console log exists: /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:57:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.network.neutron [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Successfully updated port: c53ce8ad-40f6-4b44-b067-3b9b770123ac {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "refresh_cache-d467afb8-5ec3-4edd-b894-3894122515e1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquired lock "refresh_cache-d467afb8-5ec3-4edd-b894-3894122515e1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.network.neutron [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-2c36b2c2-4e30-46de-9332-11b0eb3814f9 req-a39caee5-2b20-44bd-bc48-e3953b88fdc6 service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Received event network-changed-c53ce8ad-40f6-4b44-b067-3b9b770123ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.compute.manager [req-2c36b2c2-4e30-46de-9332-11b0eb3814f9 req-a39caee5-2b20-44bd-bc48-e3953b88fdc6 service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Refreshing instance network info cache due to event network-changed-c53ce8ad-40f6-4b44-b067-3b9b770123ac. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2c36b2c2-4e30-46de-9332-11b0eb3814f9 req-a39caee5-2b20-44bd-bc48-e3953b88fdc6 service nova] Acquiring lock "refresh_cache-d467afb8-5ec3-4edd-b894-3894122515e1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.network.neutron [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.network.neutron [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Updating instance_info_cache with network_info: [{"id": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "address": "fa:16:3e:27:ed:ca", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53ce8ad-40", "ovs_interfaceid": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Releasing lock "refresh_cache-d467afb8-5ec3-4edd-b894-3894122515e1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Instance network_info: |[{"id": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "address": "fa:16:3e:27:ed:ca", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53ce8ad-40", "ovs_interfaceid": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2c36b2c2-4e30-46de-9332-11b0eb3814f9 req-a39caee5-2b20-44bd-bc48-e3953b88fdc6 service nova] Acquired lock "refresh_cache-d467afb8-5ec3-4edd-b894-3894122515e1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.network.neutron [req-2c36b2c2-4e30-46de-9332-11b0eb3814f9 req-a39caee5-2b20-44bd-bc48-e3953b88fdc6 service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Refreshing network info cache for port c53ce8ad-40f6-4b44-b067-3b9b770123ac {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Start _get_guest_xml network_info=[{"id": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "address": "fa:16:3e:27:ed:ca", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53ce8ad-40", "ovs_interfaceid": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'guest_format': None, 'encrypted': False, 'encryption_format': None, 'encryption_options': None, 'image_id': 'b161e746-a23e-4c74-ab8c-45ef211d5e66'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:57:51 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:57:51 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-05T12:13:02Z,direct_url=<?>,disk_format='qcow2',id=b161e746-a23e-4c74-ab8c-45ef211d5e66,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a819537618b54160ae57eb9baebc65fb',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-05T12:13:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:57:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1857407549',display_name='tempest-VolumesSnapshotTestJSON-instance-1857407549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1857407549',id=50,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrpVibjEvhNOa6iPbXLo0fPNAdYHcvtaJW6BcQHKlqmFeu2itOj3fQ1OSbAWQqyuUsYM95lt/i9+aK7ngOaafFMmuxyPeltXvx7bOt5DcT3XtOaSAzhNr5YEqUMwEjXQw==',key_name='tempest-keypair-373877285',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b12207f9ede84297ad7b3919e28b91ee',ramdisk_id='',reservation_id='r-jsva06z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-570207846',owner_user_name='tempest-VolumesSnapshotTestJSON-570207846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7565c1aa17c04008bf6b18f9d1266789',uuid=d467afb8-5ec3-4edd-b894-3894122515e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "address": "fa:16:3e:27:ed:ca", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53ce8ad-40", "ovs_interfaceid": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Converting VIF {"id": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "address": "fa:16:3e:27:ed:ca", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53ce8ad-40", "ovs_interfaceid": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:ed:ca,bridge_name='br-int',has_traffic_filtering=True,id=c53ce8ad-40f6-4b44-b067-3b9b770123ac,network=Network(d5f7a21d-7394-431d-b06f-677d94876d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53ce8ad-40') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.objects.instance [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lazy-loading 'pci_devices' on Instance uuid d467afb8-5ec3-4edd-b894-3894122515e1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:57:51 user nova-compute[75071]:   <uuid>d467afb8-5ec3-4edd-b894-3894122515e1</uuid>
Dec 05 12:57:51 user nova-compute[75071]:   <name>instance-00000032</name>
Dec 05 12:57:51 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:57:51 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:57:51 user nova-compute[75071]:   <metadata>
Dec 05 12:57:51 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:57:51 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:57:51 user nova-compute[75071]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1857407549</nova:name>
Dec 05 12:57:51 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:57:51</nova:creationTime>
Dec 05 12:57:51 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:57:51 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:57:51 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:57:51 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:57:51 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:57:51 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:57:51 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:57:51 user nova-compute[75071]:       <nova:owner>
Dec 05 12:57:51 user nova-compute[75071]:         <nova:user uuid="7565c1aa17c04008bf6b18f9d1266789">tempest-VolumesSnapshotTestJSON-570207846-project-member</nova:user>
Dec 05 12:57:51 user nova-compute[75071]:         <nova:project uuid="b12207f9ede84297ad7b3919e28b91ee">tempest-VolumesSnapshotTestJSON-570207846</nova:project>
Dec 05 12:57:51 user nova-compute[75071]:       </nova:owner>
Dec 05 12:57:51 user nova-compute[75071]:       <nova:root type="image" uuid="b161e746-a23e-4c74-ab8c-45ef211d5e66"/>
Dec 05 12:57:51 user nova-compute[75071]:       <nova:ports>
Dec 05 12:57:51 user nova-compute[75071]:         <nova:port uuid="c53ce8ad-40f6-4b44-b067-3b9b770123ac">
Dec 05 12:57:51 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 05 12:57:51 user nova-compute[75071]:         </nova:port>
Dec 05 12:57:51 user nova-compute[75071]:       </nova:ports>
Dec 05 12:57:51 user nova-compute[75071]:     </nova:instance>
Dec 05 12:57:51 user nova-compute[75071]:   </metadata>
Dec 05 12:57:51 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:57:51 user nova-compute[75071]:     <system>
Dec 05 12:57:51 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:57:51 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:57:51 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:57:51 user nova-compute[75071]:       <entry name="serial">d467afb8-5ec3-4edd-b894-3894122515e1</entry>
Dec 05 12:57:51 user nova-compute[75071]:       <entry name="uuid">d467afb8-5ec3-4edd-b894-3894122515e1</entry>
Dec 05 12:57:51 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:57:51 user nova-compute[75071]:     </system>
Dec 05 12:57:51 user nova-compute[75071]:   </sysinfo>
Dec 05 12:57:51 user nova-compute[75071]:   <os>
Dec 05 12:57:51 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:57:51 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:57:51 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:57:51 user nova-compute[75071]:   </os>
Dec 05 12:57:51 user nova-compute[75071]:   <features>
Dec 05 12:57:51 user nova-compute[75071]:     <acpi/>
Dec 05 12:57:51 user nova-compute[75071]:     <apic/>
Dec 05 12:57:51 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:57:51 user nova-compute[75071]:   </features>
Dec 05 12:57:51 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:57:51 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:57:51 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:57:51 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:57:51 user nova-compute[75071]:   </clock>
Dec 05 12:57:51 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:57:51 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:57:51 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:57:51 user nova-compute[75071]:   </cpu>
Dec 05 12:57:51 user nova-compute[75071]:   <devices>
Dec 05 12:57:51 user nova-compute[75071]:     <disk type="file" device="disk">
Dec 05 12:57:51 user nova-compute[75071]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 05 12:57:51 user nova-compute[75071]:       <source file="/opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk"/>
Dec 05 12:57:51 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:57:51 user nova-compute[75071]:     </disk>
Dec 05 12:57:51 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:57:51 user nova-compute[75071]:       <mac address="fa:16:3e:27:ed:ca"/>
Dec 05 12:57:51 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:57:51 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:57:51 user nova-compute[75071]:       <target dev="tapc53ce8ad-40"/>
Dec 05 12:57:51 user nova-compute[75071]:     </interface>
Dec 05 12:57:51 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:57:51 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/console.log" append="off"/>
Dec 05 12:57:51 user nova-compute[75071]:     </serial>
Dec 05 12:57:51 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:57:51 user nova-compute[75071]:     <video>
Dec 05 12:57:51 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:57:51 user nova-compute[75071]:     </video>
Dec 05 12:57:51 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:57:51 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:57:51 user nova-compute[75071]:     </rng>
Dec 05 12:57:51 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:57:51 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:57:51 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:57:51 user nova-compute[75071]:     </memballoon>
Dec 05 12:57:51 user nova-compute[75071]:   </devices>
Dec 05 12:57:51 user nova-compute[75071]: </domain>
Dec 05 12:57:51 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:57:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1857407549',display_name='tempest-VolumesSnapshotTestJSON-instance-1857407549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1857407549',id=50,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrpVibjEvhNOa6iPbXLo0fPNAdYHcvtaJW6BcQHKlqmFeu2itOj3fQ1OSbAWQqyuUsYM95lt/i9+aK7ngOaafFMmuxyPeltXvx7bOt5DcT3XtOaSAzhNr5YEqUMwEjXQw==',key_name='tempest-keypair-373877285',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b12207f9ede84297ad7b3919e28b91ee',ramdisk_id='',reservation_id='r-jsva06z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-570207846',owner_user_name='tempest-VolumesSnapshotTestJSON-570207846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7565c1aa17c04008bf6b18f9d1266789',uuid=d467afb8-5ec3-4edd-b894-3894122515e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "address": "fa:16:3e:27:ed:ca", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53ce8ad-40", "ovs_interfaceid": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Converting VIF {"id": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "address": "fa:16:3e:27:ed:ca", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53ce8ad-40", "ovs_interfaceid": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:ed:ca,bridge_name='br-int',has_traffic_filtering=True,id=c53ce8ad-40f6-4b44-b067-3b9b770123ac,network=Network(d5f7a21d-7394-431d-b06f-677d94876d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53ce8ad-40') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG os_vif [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:ed:ca,bridge_name='br-int',has_traffic_filtering=True,id=c53ce8ad-40f6-4b44-b067-3b9b770123ac,network=Network(d5f7a21d-7394-431d-b06f-677d94876d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53ce8ad-40') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dbdf8e1b-f091-5c9e-966f-644b37cdbc05', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc53ce8ad-40, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc53ce8ad-40, col_values=(('qos', UUID('74f509ed-fb4d-4722-a714-bb8bd1f274f1')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc53ce8ad-40, col_values=(('external_ids', {'iface-id': 'c53ce8ad-40f6-4b44-b067-3b9b770123ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:ed:ca', 'vm-uuid': 'd467afb8-5ec3-4edd-b894-3894122515e1'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:51 user nova-compute[75071]: INFO os_vif [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:ed:ca,bridge_name='br-int',has_traffic_filtering=True,id=c53ce8ad-40f6-4b44-b067-3b9b770123ac,network=Network(d5f7a21d-7394-431d-b06f-677d94876d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53ce8ad-40')
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] No VIF found with MAC fa:16:3e:27:ed:ca, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.network.neutron [req-2c36b2c2-4e30-46de-9332-11b0eb3814f9 req-a39caee5-2b20-44bd-bc48-e3953b88fdc6 service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Updated VIF entry in instance network info cache for port c53ce8ad-40f6-4b44-b067-3b9b770123ac. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG nova.network.neutron [req-2c36b2c2-4e30-46de-9332-11b0eb3814f9 req-a39caee5-2b20-44bd-bc48-e3953b88fdc6 service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Updating instance_info_cache with network_info: [{"id": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "address": "fa:16:3e:27:ed:ca", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53ce8ad-40", "ovs_interfaceid": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:57:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2c36b2c2-4e30-46de-9332-11b0eb3814f9 req-a39caee5-2b20-44bd-bc48-e3953b88fdc6 service nova] Releasing lock "refresh_cache-d467afb8-5ec3-4edd-b894-3894122515e1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:57:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-84e25a40-d135-41a5-8381-16f7fb6ff3d5 req-c0568f70-7f90-4161-bd81-c224656a03ef service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Received event network-vif-plugged-c53ce8ad-40f6-4b44-b067-3b9b770123ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:57:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-84e25a40-d135-41a5-8381-16f7fb6ff3d5 req-c0568f70-7f90-4161-bd81-c224656a03ef service nova] Acquiring lock "d467afb8-5ec3-4edd-b894-3894122515e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:57:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-84e25a40-d135-41a5-8381-16f7fb6ff3d5 req-c0568f70-7f90-4161-bd81-c224656a03ef service nova] Lock "d467afb8-5ec3-4edd-b894-3894122515e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:57:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-84e25a40-d135-41a5-8381-16f7fb6ff3d5 req-c0568f70-7f90-4161-bd81-c224656a03ef service nova] Lock "d467afb8-5ec3-4edd-b894-3894122515e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:57:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-84e25a40-d135-41a5-8381-16f7fb6ff3d5 req-c0568f70-7f90-4161-bd81-c224656a03ef service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] No waiting events found dispatching network-vif-plugged-c53ce8ad-40f6-4b44-b067-3b9b770123ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:57:53 user nova-compute[75071]: WARNING nova.compute.manager [req-84e25a40-d135-41a5-8381-16f7fb6ff3d5 req-c0568f70-7f90-4161-bd81-c224656a03ef service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Received unexpected event network-vif-plugged-c53ce8ad-40f6-4b44-b067-3b9b770123ac for instance with vm_state building and task_state spawning.
Dec 05 12:57:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:54 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:57:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:57:55 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Instance spawned successfully.
Dec 05 12:57:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:57:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:57:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:57:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:57:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:57:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:57:55 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:57:55 user nova-compute[75071]: INFO nova.compute.manager [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Took 5.12 seconds to spawn the instance on the hypervisor.
Dec 05 12:57:55 user nova-compute[75071]: DEBUG nova.compute.manager [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:57:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-bddb5175-d9d2-41c7-bcbc-56485bd64458 req-80665e02-164b-4a0e-9df4-2023eb22e8fc service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Received event network-vif-plugged-c53ce8ad-40f6-4b44-b067-3b9b770123ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:57:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bddb5175-d9d2-41c7-bcbc-56485bd64458 req-80665e02-164b-4a0e-9df4-2023eb22e8fc service nova] Acquiring lock "d467afb8-5ec3-4edd-b894-3894122515e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:57:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bddb5175-d9d2-41c7-bcbc-56485bd64458 req-80665e02-164b-4a0e-9df4-2023eb22e8fc service nova] Lock "d467afb8-5ec3-4edd-b894-3894122515e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:57:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-bddb5175-d9d2-41c7-bcbc-56485bd64458 req-80665e02-164b-4a0e-9df4-2023eb22e8fc service nova] Lock "d467afb8-5ec3-4edd-b894-3894122515e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:57:55 user nova-compute[75071]: DEBUG nova.compute.manager [req-bddb5175-d9d2-41c7-bcbc-56485bd64458 req-80665e02-164b-4a0e-9df4-2023eb22e8fc service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] No waiting events found dispatching network-vif-plugged-c53ce8ad-40f6-4b44-b067-3b9b770123ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:57:55 user nova-compute[75071]: WARNING nova.compute.manager [req-bddb5175-d9d2-41c7-bcbc-56485bd64458 req-80665e02-164b-4a0e-9df4-2023eb22e8fc service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Received unexpected event network-vif-plugged-c53ce8ad-40f6-4b44-b067-3b9b770123ac for instance with vm_state building and task_state spawning.
Dec 05 12:57:55 user nova-compute[75071]: INFO nova.compute.manager [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Took 5.72 seconds to build instance.
Dec 05 12:57:55 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-89634c43-1a5b-48ef-8990-8a6a5389713f tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "d467afb8-5ec3-4edd-b894-3894122515e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.816s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:57:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-e8b78015-7342-4d13-bd6a-ca777b16dd05 req-b6c46210-6880-48e9-a37d-326d6968e600 service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Received event network-changed-ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-e8b78015-7342-4d13-bd6a-ca777b16dd05 req-b6c46210-6880-48e9-a37d-326d6968e600 service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Refreshing instance network info cache due to event network-changed-ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e8b78015-7342-4d13-bd6a-ca777b16dd05 req-b6c46210-6880-48e9-a37d-326d6968e600 service nova] Acquiring lock "refresh_cache-8cd0a34e-bf3d-4d87-a80d-c87da59e2400" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e8b78015-7342-4d13-bd6a-ca777b16dd05 req-b6c46210-6880-48e9-a37d-326d6968e600 service nova] Acquired lock "refresh_cache-8cd0a34e-bf3d-4d87-a80d-c87da59e2400" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-e8b78015-7342-4d13-bd6a-ca777b16dd05 req-b6c46210-6880-48e9-a37d-326d6968e600 service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Refreshing network info cache for port ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976 {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-e8b78015-7342-4d13-bd6a-ca777b16dd05 req-b6c46210-6880-48e9-a37d-326d6968e600 service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Updated VIF entry in instance network info cache for port ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG nova.network.neutron [req-e8b78015-7342-4d13-bd6a-ca777b16dd05 req-b6c46210-6880-48e9-a37d-326d6968e600 service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Updating instance_info_cache with network_info: [{"id": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "address": "fa:16:3e:62:45:c8", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab68749a-0f", "ovs_interfaceid": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e8b78015-7342-4d13-bd6a-ca777b16dd05 req-b6c46210-6880-48e9-a37d-326d6968e600 service nova] Releasing lock "refresh_cache-8cd0a34e-bf3d-4d87-a80d-c87da59e2400" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:57:59 user nova-compute[75071]: INFO nova.compute.manager [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Terminating instance
Dec 05 12:57:59 user nova-compute[75071]: DEBUG nova.compute.manager [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-e2c9c1ca-31e7-4e42-80bb-5cfb6b858891 req-f87e1bcb-36ae-43c0-afe3-6267b0d2c557 service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Received event network-vif-unplugged-ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e2c9c1ca-31e7-4e42-80bb-5cfb6b858891 req-f87e1bcb-36ae-43c0-afe3-6267b0d2c557 service nova] Acquiring lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e2c9c1ca-31e7-4e42-80bb-5cfb6b858891 req-f87e1bcb-36ae-43c0-afe3-6267b0d2c557 service nova] Lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-e2c9c1ca-31e7-4e42-80bb-5cfb6b858891 req-f87e1bcb-36ae-43c0-afe3-6267b0d2c557 service nova] Lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-e2c9c1ca-31e7-4e42-80bb-5cfb6b858891 req-f87e1bcb-36ae-43c0-afe3-6267b0d2c557 service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] No waiting events found dispatching network-vif-unplugged-ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:57:59 user nova-compute[75071]: DEBUG nova.compute.manager [req-e2c9c1ca-31e7-4e42-80bb-5cfb6b858891 req-f87e1bcb-36ae-43c0-afe3-6267b0d2c557 service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Received event network-vif-unplugged-ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976 for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 12:58:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Instance destroyed successfully.
Dec 05 12:58:00 user nova-compute[75071]: DEBUG nova.objects.instance [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lazy-loading 'resources' on Instance uuid 8cd0a34e-bf3d-4d87-a80d-c87da59e2400 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1918204683',display_name='tempest-TestVolumeBootPattern-server-1918204683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1918204683',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEBRikV+rtdEtghEQfmH+IM9/Mf1uSkOrTuZKMd3fh01GANS6sbLHxh5KDsp9Ng70B85S/CxxQKzaJLbSYZ6L85stWFiwwGN+NjfmI3mt1Tl5tjNPt0cjz/NZ+xBmahPA==',key_name='tempest-TestVolumeBootPattern-1615085816',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:56:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e87e18fa15d84a858a5e6c8306589285',ramdisk_id='',reservation_id='r-bi0b89i5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2021686022',owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:56:23Z,user_data=None,user_id='c40b4872327a40968c5e7a5f89cd137a',uuid=8cd0a34e-bf3d-4d87-a80d-c87da59e2400,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "address": "fa:16:3e:62:45:c8", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab68749a-0f", "ovs_interfaceid": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converting VIF {"id": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "address": "fa:16:3e:62:45:c8", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab68749a-0f", "ovs_interfaceid": "ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:45:c8,bridge_name='br-int',has_traffic_filtering=True,id=ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab68749a-0f') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_vif [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:45:c8,bridge_name='br-int',has_traffic_filtering=True,id=ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab68749a-0f') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab68749a-0f, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d0d6c80-ef44-4f21-92eb-08646b47b3e7) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:58:00 user nova-compute[75071]: INFO os_vif [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:45:c8,bridge_name='br-int',has_traffic_filtering=True,id=ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab68749a-0f')
Dec 05 12:58:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBJNEDGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:58:00 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a84111-abf5-49a1-a3cd-1214e3b0d24b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 12:58:00 user nova-compute[75071]: No targets found.
Dec 05 12:58:00 user nova-compute[75071]: iSNS:
Dec 05 12:58:00 user nova-compute[75071]: No targets found.
Dec 05 12:58:00 user nova-compute[75071]: STATIC:
Dec 05 12:58:00 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d
Dec 05 12:58:00 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 12:58:00 user nova-compute[75071]:                 Iface Name: default
Dec 05 12:58:00 user nova-compute[75071]: FIRMWARE:
Dec 05 12:58:00 user nova-compute[75071]: No targets found.
Dec 05 12:58:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 12:58:00 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 12:58:00 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b73d8a4-724f-4ea8-869d-2e64b52cd68e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66b41b8-01a4-4376-9e8e-f53f7f2cbe75]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 12:58:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 12:58:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f824076b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e9df33-c706-4f55-8ccc-388127d855d3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[077e0be0-acdc-4253-a63e-74cf4b5202a5]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f448f56-c07f-4fb9-b02c-67167b7deaef]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2e0ec6-019f-4c14-abd7-0c1266b04dbb]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26332653363343335', '/dev/disk/by-id/scsi-1SCST_BIOb78d46e3-c2e3c4356993e82f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b78d46e3') {{(pid=85641) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a2fd83-0c64-4f8b-8505-9eaf22a3be9f]: (4, None) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfdfdbe-71f6-4ad5-bc2a-648362004c8e]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bc6800-9ce1-4cc9-8ce9-72003b61ea3f]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d, portal: 172.16.0.220,3260]
Dec 05 12:58:00 user nova-compute[75071]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d, portal: 172.16.0.220,3260] successful.
Dec 05 12:58:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a31fb4-e89c-405e-b061-f037dccdb338]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] <== disconnect_volume: return (319ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 12:58:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Deleting instance files /opt/stack/data/nova/instances/8cd0a34e-bf3d-4d87-a80d-c87da59e2400_del
Dec 05 12:58:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Deletion of /opt/stack/data/nova/instances/8cd0a34e-bf3d-4d87-a80d-c87da59e2400_del complete
Dec 05 12:58:00 user nova-compute[75071]: INFO nova.compute.manager [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Took 1.19 seconds to destroy the instance on the hypervisor.
Dec 05 12:58:00 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 12:58:00 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 12:58:01 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:58:01 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Took 0.69 seconds to deallocate network for instance.
Dec 05 12:58:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-2a284740-aa56-462c-9de5-3779dd2b4045 req-dd2d4afd-6da6-4797-8b88-780368003b20 service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Received event network-vif-deleted-ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:58:01 user nova-compute[75071]: INFO nova.compute.manager [req-2a284740-aa56-462c-9de5-3779dd2b4045 req-dd2d4afd-6da6-4797-8b88-780368003b20 service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Neutron deleted interface ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976; detaching it from the instance and deleting it from the info cache
Dec 05 12:58:01 user nova-compute[75071]: DEBUG nova.network.neutron [req-2a284740-aa56-462c-9de5-3779dd2b4045 req-dd2d4afd-6da6-4797-8b88-780368003b20 service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:58:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-2a284740-aa56-462c-9de5-3779dd2b4045 req-dd2d4afd-6da6-4797-8b88-780368003b20 service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Detach interface failed, port_id=ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976, reason: Instance 8cd0a34e-bf3d-4d87-a80d-c87da59e2400 could not be found. {{(pid=75071) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 05 12:58:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-85864043-ddef-43d2-8a14-2d259dbea8bd req-c1e23b1c-0f87-4ee1-a8ef-a18f357eb74e service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Received event network-vif-plugged-ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976 {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:58:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-85864043-ddef-43d2-8a14-2d259dbea8bd req-c1e23b1c-0f87-4ee1-a8ef-a18f357eb74e service nova] Acquiring lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:58:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-85864043-ddef-43d2-8a14-2d259dbea8bd req-c1e23b1c-0f87-4ee1-a8ef-a18f357eb74e service nova] Lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:58:01 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-85864043-ddef-43d2-8a14-2d259dbea8bd req-c1e23b1c-0f87-4ee1-a8ef-a18f357eb74e service nova] Lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:58:01 user nova-compute[75071]: DEBUG nova.compute.manager [req-85864043-ddef-43d2-8a14-2d259dbea8bd req-c1e23b1c-0f87-4ee1-a8ef-a18f357eb74e service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] No waiting events found dispatching network-vif-plugged-ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976 {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:58:01 user nova-compute[75071]: WARNING nova.compute.manager [req-85864043-ddef-43d2-8a14-2d259dbea8bd req-c1e23b1c-0f87-4ee1-a8ef-a18f357eb74e service nova] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Received unexpected event network-vif-plugged-ab68749a-0fdc-4f8b-b6d5-e7d0d2ef5976 for instance with vm_state active and task_state deleting.
Dec 05 12:58:02 user nova-compute[75071]: INFO nova.compute.manager [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: 8cd0a34e-bf3d-4d87-a80d-c87da59e2400] Took 0.84 seconds to detach 1 volumes for instance.
Dec 05 12:58:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:58:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:58:02 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:58:02 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:58:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:58:02 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Deleted allocations for instance 8cd0a34e-bf3d-4d87-a80d-c87da59e2400
Dec 05 12:58:02 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-8bcb50b6-ab5f-47eb-ac48-d415844e654f tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "8cd0a34e-bf3d-4d87-a80d-c87da59e2400" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.209s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:58:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:58:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:58:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:58:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:58:12 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:58:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:58:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:58:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:58:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:58:16 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:58:16 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:58:18 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:58:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:58:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:58:18 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:58:18 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:58:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:58:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:58:18 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:58:19 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:58:19 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:58:19 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:58:19 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8904MB free_disk=24.97006607055664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:58:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:58:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:58:19 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance d467afb8-5ec3-4edd-b894-3894122515e1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:58:19 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:58:19 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:58:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:58:19 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:58:19 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:58:19 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:58:19 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:58:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:58:20 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:58:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:58:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:58:23 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:58:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:58:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:58:28 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:58:28 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 12:58:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:58:32 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:58:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:58:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 12:58:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-d467afb8-5ec3-4edd-b894-3894122515e1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:58:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-d467afb8-5ec3-4edd-b894-3894122515e1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:58:32 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:58:32 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lazy-loading 'info_cache' on Instance uuid d467afb8-5ec3-4edd-b894-3894122515e1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:58:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Updating instance_info_cache with network_info: [{"id": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "address": "fa:16:3e:27:ed:ca", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53ce8ad-40", "ovs_interfaceid": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:58:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-d467afb8-5ec3-4edd-b894-3894122515e1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:58:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:58:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:58:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:58:41 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:58:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 12:58:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 12:58:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:58:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 12:58:51 user nova-compute[75071]: INFO nova.compute.claims [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Claim successful on node user
Dec 05 12:58:51 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.277s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 12:58:51 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 12:58:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG nova.policy [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c40b4872327a40968c5e7a5f89cd137a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87e18fa15d84a858a5e6c8306589285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 12:58:51 user nova-compute[75071]: INFO nova.virt.block_device [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Booting with volume 65085adc-56bb-4667-b4d1-46714871846d at /dev/vda
Dec 05 12:58:51 user nova-compute[75071]: DEBUG os_brick.utils [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6c88ce-adf3-48b1-a461-07a286db759d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[25669696-a5af-441b-a451-ca540293c14a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a9bd1d-cdc0-44de-9ace-0bf81515228a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d06334-741a-4a06-bb94-e6427d85eaf0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:58:51 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:58:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f14c70b-5b1e-4124-a3ff-04a70a0a7b92]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG os_brick.utils [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:58:51 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Updating existing volume attachment record: 46bc69c6-6c11-461f-862d-2d6512cf7a27 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:58:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:58:52 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Successfully created port: ed58348d-6d66-45e5-b29a-5e3fc86ba7dd {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 12:58:52 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Successfully updated port: ed58348d-6d66-45e5-b29a-5e3fc86ba7dd {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 12:58:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:58:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquired lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:58:52 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 12:58:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-9b0da5b6-27b6-40db-9de2-9ee488551504 req-f040acc6-3a43-422a-bbda-113fcf252d4d service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Received event network-changed-ed58348d-6d66-45e5-b29a-5e3fc86ba7dd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:58:52 user nova-compute[75071]: DEBUG nova.compute.manager [req-9b0da5b6-27b6-40db-9de2-9ee488551504 req-f040acc6-3a43-422a-bbda-113fcf252d4d service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Refreshing instance network info cache due to event network-changed-ed58348d-6d66-45e5-b29a-5e3fc86ba7dd. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:58:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9b0da5b6-27b6-40db-9de2-9ee488551504 req-f040acc6-3a43-422a-bbda-113fcf252d4d service nova] Acquiring lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:58:52 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 12:58:53 user nova-compute[75071]: DEBUG nova.network.neutron [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Updating instance_info_cache with network_info: [{"id": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "address": "fa:16:3e:1f:b4:44", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped58348d-6d", "ovs_interfaceid": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:58:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Releasing lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:58:53 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Instance network_info: |[{"id": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "address": "fa:16:3e:1f:b4:44", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped58348d-6d", "ovs_interfaceid": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 12:58:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9b0da5b6-27b6-40db-9de2-9ee488551504 req-f040acc6-3a43-422a-bbda-113fcf252d4d service nova] Acquired lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:58:53 user nova-compute[75071]: DEBUG nova.network.neutron [req-9b0da5b6-27b6-40db-9de2-9ee488551504 req-f040acc6-3a43-422a-bbda-113fcf252d4d service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Refreshing network info cache for port ed58348d-6d66-45e5-b29a-5e3fc86ba7dd {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:58:53 user nova-compute[75071]: DEBUG nova.network.neutron [req-9b0da5b6-27b6-40db-9de2-9ee488551504 req-f040acc6-3a43-422a-bbda-113fcf252d4d service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Updated VIF entry in instance network info cache for port ed58348d-6d66-45e5-b29a-5e3fc86ba7dd. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:58:53 user nova-compute[75071]: DEBUG nova.network.neutron [req-9b0da5b6-27b6-40db-9de2-9ee488551504 req-f040acc6-3a43-422a-bbda-113fcf252d4d service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Updating instance_info_cache with network_info: [{"id": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "address": "fa:16:3e:1f:b4:44", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped58348d-6d", "ovs_interfaceid": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:58:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-9b0da5b6-27b6-40db-9de2-9ee488551504 req-f040acc6-3a43-422a-bbda-113fcf252d4d service nova] Releasing lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:58:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 12:59:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Creating image(s)
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Ensure instance console log exists: /opt/stack/data/nova/instances/f4639baf-60e3-466e-bbc5-6268a6e28b6a/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Start _get_guest_xml network_info=[{"id": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "address": "fa:16:3e:1f:b4:44", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped58348d-6d", "ovs_interfaceid": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '46bc69c6-6c11-461f-862d-2d6512cf7a27', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBJNEDGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f4639baf-60e3-466e-bbc5-6268a6e28b6a', 'attached_at': '', 'detached_at': '', 'volume_id': '65085adc-56bb-4667-b4d1-46714871846d', 'serial': '65085adc-56bb-4667-b4d1-46714871846d'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 12:59:00 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:59:00 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBJNEDGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:59:00 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:59:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:59:00 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:59:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:59:00 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:59:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c866fb30-afaa-4cb4-96c7-c05fd5a370d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:59:00 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a04a1ba-fa62-43c6-9e36-e91f85d3e919]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d] added
Dec 05 12:59:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afe9e2f-a90e-446b-9dfa-cbc5ded3edfb]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2309e94c-34e6-4689-957e-d66553a56a00]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBJNEDGm {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PBJNEDGm" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5e3d02-dc6b-413c-ae24-a0f35a205f41]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PBJNEDGm'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9702e7ae-63bb-4ab9-be8a-6a1261346cd8]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aae6ebc-f392-4537-a4b3-f2740e27fafe]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 05 12:59:01 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 05 12:59:01 user nova-compute[75071]:  {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:59:01 user nova-compute[75071]: WARNING os_brick.initiator.connectors.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 05 12:59:01 user nova-compute[75071]: 
Dec 05 12:59:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04ad299-984e-4904-b894-0cf042c15b42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d, portal: 172.16.0.220,3260]
Dec 05 12:59:01 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d, portal: 172.16.0.220,3260] successful.
Dec 05 12:59:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cd2f3c-4791-4bf9-9230-fa4c1a8bd8dc]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a1dd72-ef18-4cba-a594-ab59e66950dc]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 12:59:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 12:59:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ae8e08-1198-49ab-819e-5136c09a7065]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:59:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBJNEDGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26332653363343335', 'path': '/dev/sdb'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332653363343335', 'path': '/dev/sdb'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:58:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-827896882',display_name='tempest-TestVolumeBootPattern-server-827896882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-827896882',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEBRikV+rtdEtghEQfmH+IM9/Mf1uSkOrTuZKMd3fh01GANS6sbLHxh5KDsp9Ng70B85S/CxxQKzaJLbSYZ6L85stWFiwwGN+NjfmI3mt1Tl5tjNPt0cjz/NZ+xBmahPA==',key_name='tempest-TestVolumeBootPattern-1615085816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e87e18fa15d84a858a5e6c8306589285',ramdisk_id='',reservation_id='r-9mt1yuox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2021686022',owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:58:52Z,user_data=None,user_id='c40b4872327a40968c5e7a5f89cd137a',uuid=f4639baf-60e3-466e-bbc5-6268a6e28b6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "address": "fa:16:3e:1f:b4:44", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped58348d-6d", "ovs_interfaceid": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converting VIF {"id": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "address": "fa:16:3e:1f:b4:44", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped58348d-6d", "ovs_interfaceid": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:b4:44,bridge_name='br-int',has_traffic_filtering=True,id=ed58348d-6d66-45e5-b29a-5e3fc86ba7dd,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped58348d-6d') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG nova.objects.instance [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lazy-loading 'pci_devices' on Instance uuid f4639baf-60e3-466e-bbc5-6268a6e28b6a {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] End _get_guest_xml xml=<domain type="kvm">
Dec 05 12:59:02 user nova-compute[75071]:   <uuid>f4639baf-60e3-466e-bbc5-6268a6e28b6a</uuid>
Dec 05 12:59:02 user nova-compute[75071]:   <name>instance-00000033</name>
Dec 05 12:59:02 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 12:59:02 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 12:59:02 user nova-compute[75071]:   <metadata>
Dec 05 12:59:02 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 12:59:02 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 12:59:02 user nova-compute[75071]:       <nova:name>tempest-TestVolumeBootPattern-server-827896882</nova:name>
Dec 05 12:59:02 user nova-compute[75071]:       <nova:creationTime>2023-12-05 12:59:00</nova:creationTime>
Dec 05 12:59:02 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 12:59:02 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 12:59:02 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 12:59:02 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 12:59:02 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 12:59:02 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 12:59:02 user nova-compute[75071]:       </nova:flavor>
Dec 05 12:59:02 user nova-compute[75071]:       <nova:owner>
Dec 05 12:59:02 user nova-compute[75071]:         <nova:user uuid="c40b4872327a40968c5e7a5f89cd137a">tempest-TestVolumeBootPattern-2021686022-project-member</nova:user>
Dec 05 12:59:02 user nova-compute[75071]:         <nova:project uuid="e87e18fa15d84a858a5e6c8306589285">tempest-TestVolumeBootPattern-2021686022</nova:project>
Dec 05 12:59:02 user nova-compute[75071]:       </nova:owner>
Dec 05 12:59:02 user nova-compute[75071]:       <nova:ports>
Dec 05 12:59:02 user nova-compute[75071]:         <nova:port uuid="ed58348d-6d66-45e5-b29a-5e3fc86ba7dd">
Dec 05 12:59:02 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 05 12:59:02 user nova-compute[75071]:         </nova:port>
Dec 05 12:59:02 user nova-compute[75071]:       </nova:ports>
Dec 05 12:59:02 user nova-compute[75071]:     </nova:instance>
Dec 05 12:59:02 user nova-compute[75071]:   </metadata>
Dec 05 12:59:02 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 12:59:02 user nova-compute[75071]:     <system>
Dec 05 12:59:02 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 12:59:02 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 12:59:02 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 12:59:02 user nova-compute[75071]:       <entry name="serial">f4639baf-60e3-466e-bbc5-6268a6e28b6a</entry>
Dec 05 12:59:02 user nova-compute[75071]:       <entry name="uuid">f4639baf-60e3-466e-bbc5-6268a6e28b6a</entry>
Dec 05 12:59:02 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 12:59:02 user nova-compute[75071]:     </system>
Dec 05 12:59:02 user nova-compute[75071]:   </sysinfo>
Dec 05 12:59:02 user nova-compute[75071]:   <os>
Dec 05 12:59:02 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 12:59:02 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 12:59:02 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 12:59:02 user nova-compute[75071]:   </os>
Dec 05 12:59:02 user nova-compute[75071]:   <features>
Dec 05 12:59:02 user nova-compute[75071]:     <acpi/>
Dec 05 12:59:02 user nova-compute[75071]:     <apic/>
Dec 05 12:59:02 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 12:59:02 user nova-compute[75071]:   </features>
Dec 05 12:59:02 user nova-compute[75071]:   <clock offset="utc">
Dec 05 12:59:02 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 12:59:02 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 12:59:02 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 12:59:02 user nova-compute[75071]:   </clock>
Dec 05 12:59:02 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 12:59:02 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 12:59:02 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 12:59:02 user nova-compute[75071]:   </cpu>
Dec 05 12:59:02 user nova-compute[75071]:   <devices>
Dec 05 12:59:02 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 12:59:02 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:59:02 user nova-compute[75071]:       <source dev="/dev/sdb"/>
Dec 05 12:59:02 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 12:59:02 user nova-compute[75071]:       <serial>65085adc-56bb-4667-b4d1-46714871846d</serial>
Dec 05 12:59:02 user nova-compute[75071]:     </disk>
Dec 05 12:59:02 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 12:59:02 user nova-compute[75071]:       <mac address="fa:16:3e:1f:b4:44"/>
Dec 05 12:59:02 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:59:02 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 12:59:02 user nova-compute[75071]:       <target dev="taped58348d-6d"/>
Dec 05 12:59:02 user nova-compute[75071]:     </interface>
Dec 05 12:59:02 user nova-compute[75071]:     <serial type="pty">
Dec 05 12:59:02 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/f4639baf-60e3-466e-bbc5-6268a6e28b6a/console.log" append="off"/>
Dec 05 12:59:02 user nova-compute[75071]:     </serial>
Dec 05 12:59:02 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 12:59:02 user nova-compute[75071]:     <video>
Dec 05 12:59:02 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 12:59:02 user nova-compute[75071]:     </video>
Dec 05 12:59:02 user nova-compute[75071]:     <rng model="virtio">
Dec 05 12:59:02 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 12:59:02 user nova-compute[75071]:     </rng>
Dec 05 12:59:02 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 12:59:02 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 12:59:02 user nova-compute[75071]:       <stats period="10"/>
Dec 05 12:59:02 user nova-compute[75071]:     </memballoon>
Dec 05 12:59:02 user nova-compute[75071]:   </devices>
Dec 05 12:59:02 user nova-compute[75071]: </domain>
Dec 05 12:59:02 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:58:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-827896882',display_name='tempest-TestVolumeBootPattern-server-827896882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-827896882',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEBRikV+rtdEtghEQfmH+IM9/Mf1uSkOrTuZKMd3fh01GANS6sbLHxh5KDsp9Ng70B85S/CxxQKzaJLbSYZ6L85stWFiwwGN+NjfmI3mt1Tl5tjNPt0cjz/NZ+xBmahPA==',key_name='tempest-TestVolumeBootPattern-1615085816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e87e18fa15d84a858a5e6c8306589285',ramdisk_id='',reservation_id='r-9mt1yuox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2021686022',owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T12:58:52Z,user_data=None,user_id='c40b4872327a40968c5e7a5f89cd137a',uuid=f4639baf-60e3-466e-bbc5-6268a6e28b6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "address": "fa:16:3e:1f:b4:44", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped58348d-6d", "ovs_interfaceid": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converting VIF {"id": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "address": "fa:16:3e:1f:b4:44", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped58348d-6d", "ovs_interfaceid": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:b4:44,bridge_name='br-int',has_traffic_filtering=True,id=ed58348d-6d66-45e5-b29a-5e3fc86ba7dd,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped58348d-6d') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG os_vif [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:b4:44,bridge_name='br-int',has_traffic_filtering=True,id=ed58348d-6d66-45e5-b29a-5e3fc86ba7dd,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped58348d-6d') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb703927-6610-5bbc-8cb4-3508c335581b', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped58348d-6d, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped58348d-6d, col_values=(('qos', UUID('067d5e24-f32e-4724-9564-3f19fc2b2ced')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped58348d-6d, col_values=(('external_ids', {'iface-id': 'ed58348d-6d66-45e5-b29a-5e3fc86ba7dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:b4:44', 'vm-uuid': 'f4639baf-60e3-466e-bbc5-6268a6e28b6a'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:02 user nova-compute[75071]: INFO os_vif [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:b4:44,bridge_name='br-int',has_traffic_filtering=True,id=ed58348d-6d66-45e5-b29a-5e3fc86ba7dd,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped58348d-6d')
Dec 05 12:59:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:59:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] No VIF found with MAC fa:16:3e:1f:b4:44, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:59:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-a27a747f-7559-4784-ae73-3db97a398505 req-ad6916e9-bde2-4188-b38e-f25dc6146c41 service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Received event network-vif-plugged-ed58348d-6d66-45e5-b29a-5e3fc86ba7dd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:59:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a27a747f-7559-4784-ae73-3db97a398505 req-ad6916e9-bde2-4188-b38e-f25dc6146c41 service nova] Acquiring lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:59:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a27a747f-7559-4784-ae73-3db97a398505 req-ad6916e9-bde2-4188-b38e-f25dc6146c41 service nova] Lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:59:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a27a747f-7559-4784-ae73-3db97a398505 req-ad6916e9-bde2-4188-b38e-f25dc6146c41 service nova] Lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:59:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-a27a747f-7559-4784-ae73-3db97a398505 req-ad6916e9-bde2-4188-b38e-f25dc6146c41 service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] No waiting events found dispatching network-vif-plugged-ed58348d-6d66-45e5-b29a-5e3fc86ba7dd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:59:03 user nova-compute[75071]: WARNING nova.compute.manager [req-a27a747f-7559-4784-ae73-3db97a398505 req-ad6916e9-bde2-4188-b38e-f25dc6146c41 service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Received unexpected event network-vif-plugged-ed58348d-6d66-45e5-b29a-5e3fc86ba7dd for instance with vm_state building and task_state spawning.
Dec 05 12:59:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-5d5efccb-5ec4-4047-a175-e1e4924a8a76 req-78a5a25c-d06c-4ba9-8cbd-e300e4bf8954 service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Received event network-vif-plugged-ed58348d-6d66-45e5-b29a-5e3fc86ba7dd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:59:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5d5efccb-5ec4-4047-a175-e1e4924a8a76 req-78a5a25c-d06c-4ba9-8cbd-e300e4bf8954 service nova] Acquiring lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:59:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5d5efccb-5ec4-4047-a175-e1e4924a8a76 req-78a5a25c-d06c-4ba9-8cbd-e300e4bf8954 service nova] Lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:59:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-5d5efccb-5ec4-4047-a175-e1e4924a8a76 req-78a5a25c-d06c-4ba9-8cbd-e300e4bf8954 service nova] Lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:59:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-5d5efccb-5ec4-4047-a175-e1e4924a8a76 req-78a5a25c-d06c-4ba9-8cbd-e300e4bf8954 service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] No waiting events found dispatching network-vif-plugged-ed58348d-6d66-45e5-b29a-5e3fc86ba7dd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 12:59:05 user nova-compute[75071]: WARNING nova.compute.manager [req-5d5efccb-5ec4-4047-a175-e1e4924a8a76 req-78a5a25c-d06c-4ba9-8cbd-e300e4bf8954 service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Received unexpected event network-vif-plugged-ed58348d-6d66-45e5-b29a-5e3fc86ba7dd for instance with vm_state building and task_state spawning.
Dec 05 12:59:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 12:59:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 12:59:05 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Instance spawned successfully.
Dec 05 12:59:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 12:59:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:59:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:59:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:59:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:59:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:59:06 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 12:59:06 user nova-compute[75071]: INFO nova.compute.manager [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Took 5.54 seconds to spawn the instance on the hypervisor.
Dec 05 12:59:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 12:59:06 user nova-compute[75071]: INFO nova.compute.manager [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Took 14.94 seconds to build instance.
Dec 05 12:59:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-b1bcb564-6281-4c34-8f86-56e6058663aa tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.048s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:59:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:09 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:13 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:59:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:59:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:59:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:59:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:59:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:59:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:59:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:18 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:59:18 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 12:59:19 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:59:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:20 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:59:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:59:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:59:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:59:20 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 12:59:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 12:59:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:21 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:59:21 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 12:59:21 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8769MB free_disk=24.968219757080078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 12:59:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:59:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:59:21 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance d467afb8-5ec3-4edd-b894-3894122515e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:59:21 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance f4639baf-60e3-466e-bbc5-6268a6e28b6a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 12:59:21 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 12:59:21 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 12:59:21 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Refreshing inventories for resource provider 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 12:59:21 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Updating ProviderTree inventory for provider 25beb694-9dd7-475f-9657-74a5f0368417 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 12:59:21 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Updating inventory in ProviderTree for provider 25beb694-9dd7-475f-9657-74a5f0368417 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 12:59:21 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Refreshing aggregate associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 12:59:21 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Refreshing trait associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 12:59:21 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 12:59:21 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 12:59:21 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 12:59:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.334s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:59:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:22 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:59:22 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:59:23 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:59:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:32 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 12:59:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 12:59:32 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 12:59:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-d467afb8-5ec3-4edd-b894-3894122515e1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:59:32 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-d467afb8-5ec3-4edd-b894-3894122515e1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:59:32 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 12:59:32 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lazy-loading 'info_cache' on Instance uuid d467afb8-5ec3-4edd-b894-3894122515e1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:59:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Updating instance_info_cache with network_info: [{"id": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "address": "fa:16:3e:27:ed:ca", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53ce8ad-40", "ovs_interfaceid": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:59:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-d467afb8-5ec3-4edd-b894-3894122515e1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:59:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 12:59:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-2e385a89-355b-41fd-a77b-de18167c35d4 req-22ed594d-8983-460e-8f13-9c3101b957ef service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Received event network-changed-c53ce8ad-40f6-4b44-b067-3b9b770123ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 12:59:40 user nova-compute[75071]: DEBUG nova.compute.manager [req-2e385a89-355b-41fd-a77b-de18167c35d4 req-22ed594d-8983-460e-8f13-9c3101b957ef service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Refreshing instance network info cache due to event network-changed-c53ce8ad-40f6-4b44-b067-3b9b770123ac. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 12:59:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2e385a89-355b-41fd-a77b-de18167c35d4 req-22ed594d-8983-460e-8f13-9c3101b957ef service nova] Acquiring lock "refresh_cache-d467afb8-5ec3-4edd-b894-3894122515e1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 12:59:40 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2e385a89-355b-41fd-a77b-de18167c35d4 req-22ed594d-8983-460e-8f13-9c3101b957ef service nova] Acquired lock "refresh_cache-d467afb8-5ec3-4edd-b894-3894122515e1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 12:59:40 user nova-compute[75071]: DEBUG nova.network.neutron [req-2e385a89-355b-41fd-a77b-de18167c35d4 req-22ed594d-8983-460e-8f13-9c3101b957ef service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Refreshing network info cache for port c53ce8ad-40f6-4b44-b067-3b9b770123ac {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "d467afb8-5ec3-4edd-b894-3894122515e1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "d467afb8-5ec3-4edd-b894-3894122515e1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG nova.objects.instance [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lazy-loading 'flavor' on Instance uuid d467afb8-5ec3-4edd-b894-3894122515e1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:59:41 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Ignoring supplied device name: /dev/vdb
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "d467afb8-5ec3-4edd-b894-3894122515e1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "d467afb8-5ec3-4edd-b894-3894122515e1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "d467afb8-5ec3-4edd-b894-3894122515e1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 12:59:41 user nova-compute[75071]: INFO nova.compute.manager [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Attaching volume 221b04da-d2c8-4b97-bb53-fcff20efa7ad to /dev/vdb
Dec 05 12:59:41 user nova-compute[75071]: DEBUG os_brick.utils [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[593ab790-6596-4a25-85f3-9d676b7288b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG nova.network.neutron [req-2e385a89-355b-41fd-a77b-de18167c35d4 req-22ed594d-8983-460e-8f13-9c3101b957ef service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Updated VIF entry in instance network info cache for port c53ce8ad-40f6-4b44-b067-3b9b770123ac. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG nova.network.neutron [req-2e385a89-355b-41fd-a77b-de18167c35d4 req-22ed594d-8983-460e-8f13-9c3101b957ef service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Updating instance_info_cache with network_info: [{"id": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "address": "fa:16:3e:27:ed:ca", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53ce8ad-40", "ovs_interfaceid": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[763b76ba-782a-4982-a717-35242551fdb0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-2e385a89-355b-41fd-a77b-de18167c35d4 req-22ed594d-8983-460e-8f13-9c3101b957ef service nova] Releasing lock "refresh_cache-d467afb8-5ec3-4edd-b894-3894122515e1" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[18861ed3-7b0c-4e65-8f8c-52ec531a0a39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[05186915-d061-410f-af6b-475be4f7820f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 12:59:41 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 12:59:41 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdce63ea-6661-4e44-94b7-653983c40521]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG os_brick.utils [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:59:41 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Updating existing volume attachment record: be7594d7-d094-4071-8527-e6152bde5956 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 12:59:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:59:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JhOedRAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 12:59:50 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:59:50 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 12:59:50 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3301e7c1-29aa-4395-ad88-2bd3cd83a53b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 12:59:50 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[551490fb-4ccc-42ab-bb30-cda2946e6784]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad] added
Dec 05 12:59:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f11027-40bc-41cc-8ea3-92a5f6eef09e]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[88299c42-79de-45ab-838a-604ada311330]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JhOedRAQ {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JhOedRAQ" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c1b862-ed80-406e-8cf2-3c14455d137a]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JhOedRAQ'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e1d11c-df49-400e-94fd-9aaa3248d3b9]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed40a220-bd93-4e2a-a99d-872ff94e8cbc]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 12:59:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 12:59:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fe6fb2-d36e-4e1b-914b-9a75a5d414d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad, portal: 172.16.0.220,3260]
Dec 05 12:59:50 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad, portal: 172.16.0.220,3260] successful.
Dec 05 12:59:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[75384a15-656c-4e88-9fc7-6606ae01db38]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f266df-d4eb-4242-b418-4a16d55bd025]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 12:59:50 user nova-compute[75071]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad (non-flash)
Dec 05 12:59:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 12:59:50 user nova-compute[75071]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad (non-flash)
Dec 05 12:59:50 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a4449c-d483-48a5-92aa-5cff71546e2e]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 12:59:50 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JhOedRAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 12:59:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 12:59:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23662353562336437', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 12:59:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662353562336437', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 12:59:51 user nova-compute[75071]: DEBUG nova.objects.instance [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lazy-loading 'flavor' on Instance uuid d467afb8-5ec3-4edd-b894-3894122515e1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 12:59:51 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] attach device xml: <disk type="block" device="disk">
Dec 05 12:59:51 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 12:59:51 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Dec 05 12:59:51 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 12:59:51 user nova-compute[75071]:   <serial>221b04da-d2c8-4b97-bb53-fcff20efa7ad</serial>
Dec 05 12:59:51 user nova-compute[75071]: </disk>
Dec 05 12:59:51 user nova-compute[75071]:  {{(pid=75071) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 05 12:59:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:59:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 12:59:52 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] No VIF found with MAC fa:16:3e:27:ed:ca, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 12:59:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:52 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-4ac97dea-a3b6-4356-95ab-18603f072021 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "d467afb8-5ec3-4edd-b894-3894122515e1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.145s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 12:59:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 12:59:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 12:59:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:59:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 12:59:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 12:59:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:00:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:00:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 13:00:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:00:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:00:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "d467afb8-5ec3-4edd-b894-3894122515e1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:00:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "d467afb8-5ec3-4edd-b894-3894122515e1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:00:14 user nova-compute[75071]: INFO nova.compute.manager [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Detaching volume 221b04da-d2c8-4b97-bb53-fcff20efa7ad
Dec 05 13:00:14 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "d467afb8-5ec3-4edd-b894-3894122515e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:00:14 user nova-compute[75071]: INFO nova.virt.block_device [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Attempting to driver detach volume 221b04da-d2c8-4b97-bb53-fcff20efa7ad from mountpoint /dev/vdb
Dec 05 13:00:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Attempting to detach device vdb from instance d467afb8-5ec3-4edd-b894-3894122515e1 from the persistent domain config. {{(pid=75071) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 05 13:00:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:00:14 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:00:14 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Dec 05 13:00:14 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:00:14 user nova-compute[75071]:   <serial>221b04da-d2c8-4b97-bb53-fcff20efa7ad</serial>
Dec 05 13:00:14 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:00:14 user nova-compute[75071]: </disk>
Dec 05 13:00:14 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:00:14 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Successfully detached device vdb from instance d467afb8-5ec3-4edd-b894-3894122515e1 from the persistent domain config.
Dec 05 13:00:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d467afb8-5ec3-4edd-b894-3894122515e1 from the live domain config. {{(pid=75071) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 05 13:00:14 user nova-compute[75071]: DEBUG nova.virt.libvirt.guest [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] detach device xml: <disk type="block" device="disk">
Dec 05 13:00:14 user nova-compute[75071]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:00:14 user nova-compute[75071]:   <source dev="/dev/sdc"/>
Dec 05 13:00:14 user nova-compute[75071]:   <target dev="vdb" bus="virtio"/>
Dec 05 13:00:14 user nova-compute[75071]:   <serial>221b04da-d2c8-4b97-bb53-fcff20efa7ad</serial>
Dec 05 13:00:14 user nova-compute[75071]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 05 13:00:14 user nova-compute[75071]: </disk>
Dec 05 13:00:14 user nova-compute[75071]:  {{(pid=75071) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 05 13:00:14 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:00:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:15 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d467afb8-5ec3-4edd-b894-3894122515e1 {{(pid=75071) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 05 13:00:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:00:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:00:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:20 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:00:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:00:20 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:00:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:00:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:00:20 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:00:20 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:00:20 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 13:00:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:00:20 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk --force-share --output=json {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:21 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:00:21 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:00:21 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:00:21 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8882MB free_disk=24.966899871826172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:00:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:00:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:00:21 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance d467afb8-5ec3-4edd-b894-3894122515e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 13:00:21 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance f4639baf-60e3-466e-bbc5-6268a6e28b6a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 13:00:21 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:00:21 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:00:21 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:00:21 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:00:21 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:00:21 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:00:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:00:22 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:00:22 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:00:24 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:00:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:00:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:33 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:00:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:00:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:00:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:00:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:00:34 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Updating instance_info_cache with network_info: [{"id": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "address": "fa:16:3e:1f:b4:44", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped58348d-6d", "ovs_interfaceid": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:00:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:00:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:00:35 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d467afb8-5ec3-4edd-b894-3894122515e1 is timed out.
Dec 05 13:00:35 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Successfully detached device vdb from instance d467afb8-5ec3-4edd-b894-3894122515e1 from the live domain config.
Dec 05 13:00:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JhOedRAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:00:35 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58ea787-a50a-4f20-946e-cab47201fc28]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:00:35 user nova-compute[75071]: No targets found.
Dec 05 13:00:35 user nova-compute[75071]: iSNS:
Dec 05 13:00:35 user nova-compute[75071]: No targets found.
Dec 05 13:00:35 user nova-compute[75071]: STATIC:
Dec 05 13:00:35 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d
Dec 05 13:00:35 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:00:35 user nova-compute[75071]:                 Iface Name: default
Dec 05 13:00:35 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad
Dec 05 13:00:35 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:00:35 user nova-compute[75071]:                 Iface Name: default
Dec 05 13:00:35 user nova-compute[75071]: FIRMWARE:
Dec 05 13:00:35 user nova-compute[75071]: No targets found.
Dec 05 13:00:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:00:35 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:00:35 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f230d7e-8e81-4a08-b181-60c50410b6a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5ad80c-6779-4aef-a481-67cd4e8be9e6]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 13:00:35 user nova-compute[75071]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad (non-flash)
Dec 05 13:00:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 13:00:35 user nova-compute[75071]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad (non-flash)
Dec 05 13:00:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f826413aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[78934989-0815-4ae4-aa16-8b673ce74130]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c464af99-52a4-450b-b9a7-11aa9e11921e]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd13878a-bd37-4eec-a6c4-ad0deab29d18]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0886d887-b821-4bea-b4a0-55c26600fb86]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ed5267-e59f-4694-a958-43170260fac4]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf69d9a7-f0d9-4346-b269-88e13ebdadca]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad, portal: 172.16.0.220,3260]
Dec 05 13:00:35 user nova-compute[75071]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad, portal: 172.16.0.220,3260] successful.
Dec 05 13:00:35 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9704a80-97f2-4d5e-aac5-eb0b4d679726]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] <== disconnect_volume: return (269ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:00:35 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG nova.objects.instance [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lazy-loading 'flavor' on Instance uuid d467afb8-5ec3-4edd-b894-3894122515e1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-57f2bd8d-d47e-4bc2-bd7e-f0291444b3f1 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "d467afb8-5ec3-4edd-b894-3894122515e1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.704s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "d467afb8-5ec3-4edd-b894-3894122515e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.590s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "d467afb8-5ec3-4edd-b894-3894122515e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "d467afb8-5ec3-4edd-b894-3894122515e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "d467afb8-5ec3-4edd-b894-3894122515e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:00:36 user nova-compute[75071]: INFO nova.compute.manager [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Terminating instance
Dec 05 13:00:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-38a633fb-cc1c-42f3-b20b-677f710f6bc9 req-be4fdef3-cbc3-457e-97ff-1b74950b37da service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Received event network-vif-unplugged-c53ce8ad-40f6-4b44-b067-3b9b770123ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-38a633fb-cc1c-42f3-b20b-677f710f6bc9 req-be4fdef3-cbc3-457e-97ff-1b74950b37da service nova] Acquiring lock "d467afb8-5ec3-4edd-b894-3894122515e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-38a633fb-cc1c-42f3-b20b-677f710f6bc9 req-be4fdef3-cbc3-457e-97ff-1b74950b37da service nova] Lock "d467afb8-5ec3-4edd-b894-3894122515e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-38a633fb-cc1c-42f3-b20b-677f710f6bc9 req-be4fdef3-cbc3-457e-97ff-1b74950b37da service nova] Lock "d467afb8-5ec3-4edd-b894-3894122515e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-38a633fb-cc1c-42f3-b20b-677f710f6bc9 req-be4fdef3-cbc3-457e-97ff-1b74950b37da service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] No waiting events found dispatching network-vif-unplugged-c53ce8ad-40f6-4b44-b067-3b9b770123ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG nova.compute.manager [req-38a633fb-cc1c-42f3-b20b-677f710f6bc9 req-be4fdef3-cbc3-457e-97ff-1b74950b37da service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Received event network-vif-unplugged-c53ce8ad-40f6-4b44-b067-3b9b770123ac for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:36 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Instance destroyed successfully.
Dec 05 13:00:36 user nova-compute[75071]: DEBUG nova.objects.instance [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lazy-loading 'resources' on Instance uuid d467afb8-5ec3-4edd-b894-3894122515e1 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:57:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1857407549',display_name='tempest-VolumesSnapshotTestJSON-instance-1857407549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1857407549',id=50,image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrpVibjEvhNOa6iPbXLo0fPNAdYHcvtaJW6BcQHKlqmFeu2itOj3fQ1OSbAWQqyuUsYM95lt/i9+aK7ngOaafFMmuxyPeltXvx7bOt5DcT3XtOaSAzhNr5YEqUMwEjXQw==',key_name='tempest-keypair-373877285',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:57:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b12207f9ede84297ad7b3919e28b91ee',ramdisk_id='',reservation_id='r-jsva06z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b161e746-a23e-4c74-ab8c-45ef211d5e66',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-570207846',owner_user_name='tempest-VolumesSnapshotTestJSON-570207846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:57:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7565c1aa17c04008bf6b18f9d1266789',uuid=d467afb8-5ec3-4edd-b894-3894122515e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "address": "fa:16:3e:27:ed:ca", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53ce8ad-40", "ovs_interfaceid": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Converting VIF {"id": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "address": "fa:16:3e:27:ed:ca", "network": {"id": "d5f7a21d-7394-431d-b06f-677d94876d45", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-95522392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b12207f9ede84297ad7b3919e28b91ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc53ce8ad-40", "ovs_interfaceid": "c53ce8ad-40f6-4b44-b067-3b9b770123ac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:ed:ca,bridge_name='br-int',has_traffic_filtering=True,id=c53ce8ad-40f6-4b44-b067-3b9b770123ac,network=Network(d5f7a21d-7394-431d-b06f-677d94876d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53ce8ad-40') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG os_vif [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:ed:ca,bridge_name='br-int',has_traffic_filtering=True,id=c53ce8ad-40f6-4b44-b067-3b9b770123ac,network=Network(d5f7a21d-7394-431d-b06f-677d94876d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53ce8ad-40') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc53ce8ad-40, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74f509ed-fb4d-4722-a714-bb8bd1f274f1) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:00:36 user nova-compute[75071]: INFO os_vif [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:ed:ca,bridge_name='br-int',has_traffic_filtering=True,id=c53ce8ad-40f6-4b44-b067-3b9b770123ac,network=Network(d5f7a21d-7394-431d-b06f-677d94876d45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc53ce8ad-40')
Dec 05 13:00:36 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JhOedRAQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:00:36 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:00:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:00:36 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0060be-a152-4f29-8845-ff29c10fff4b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:00:37 user nova-compute[75071]: No targets found.
Dec 05 13:00:37 user nova-compute[75071]: iSNS:
Dec 05 13:00:37 user nova-compute[75071]: No targets found.
Dec 05 13:00:37 user nova-compute[75071]: STATIC:
Dec 05 13:00:37 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d
Dec 05 13:00:37 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:00:37 user nova-compute[75071]:                 Iface Name: default
Dec 05 13:00:37 user nova-compute[75071]: FIRMWARE:
Dec 05 13:00:37 user nova-compute[75071]: No targets found.
Dec 05 13:00:37 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:00:37 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:00:37 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:221b04da-d2c8-4b97-bb53-fcff20efa7ad', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c33c991-886a-407d-8c8a-2ad7ffecba43]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a07238-bfce-499d-8ad4-1db9a7c275f3]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 13:00:37 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 13:00:37 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8264139000>, {}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Disconnecting from: [] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.062s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] <== disconnect_volume: return (63ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:00:37 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Deleting instance files /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1_del
Dec 05 13:00:37 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Deletion of /opt/stack/data/nova/instances/d467afb8-5ec3-4edd-b894-3894122515e1_del complete
Dec 05 13:00:37 user nova-compute[75071]: INFO nova.compute.manager [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Took 0.93 seconds to destroy the instance on the hypervisor.
Dec 05 13:00:37 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:00:37 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Took 0.69 seconds to deallocate network for instance.
Dec 05 13:00:37 user nova-compute[75071]: DEBUG nova.compute.manager [req-a6cf6f2e-7b08-4fa5-bb0a-7be6ac3507d9 req-88a16900-c999-4ef1-9e2a-c612382c3add service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Received event network-vif-deleted-c53ce8ad-40f6-4b44-b067-3b9b770123ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:00:37 user nova-compute[75071]: WARNING nova.volume.cinder [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Attachment be7594d7-d094-4071-8527-e6152bde5956 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = be7594d7-d094-4071-8527-e6152bde5956. (HTTP 404) (Request-ID: req-2583ecf3-624c-4ee0-b99d-41b7761ab817)
Dec 05 13:00:37 user nova-compute[75071]: INFO nova.compute.manager [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Took 0.02 seconds to detach 1 volumes for instance.
Dec 05 13:00:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:00:37 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:00:38 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:00:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:00:38 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Deleted allocations for instance d467afb8-5ec3-4edd-b894-3894122515e1
Dec 05 13:00:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-cb07b8d8-069e-40ac-bff5-88f54deccc41 tempest-VolumesSnapshotTestJSON-570207846 tempest-VolumesSnapshotTestJSON-570207846-project-member] Lock "d467afb8-5ec3-4edd-b894-3894122515e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.969s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:00:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-fb2149d7-84c6-44b8-a9ae-c3d45a1838d3 req-a653c353-055f-412a-9980-9bb217b2dfea service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Received event network-vif-plugged-c53ce8ad-40f6-4b44-b067-3b9b770123ac {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:00:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fb2149d7-84c6-44b8-a9ae-c3d45a1838d3 req-a653c353-055f-412a-9980-9bb217b2dfea service nova] Acquiring lock "d467afb8-5ec3-4edd-b894-3894122515e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:00:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fb2149d7-84c6-44b8-a9ae-c3d45a1838d3 req-a653c353-055f-412a-9980-9bb217b2dfea service nova] Lock "d467afb8-5ec3-4edd-b894-3894122515e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:00:38 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-fb2149d7-84c6-44b8-a9ae-c3d45a1838d3 req-a653c353-055f-412a-9980-9bb217b2dfea service nova] Lock "d467afb8-5ec3-4edd-b894-3894122515e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:00:38 user nova-compute[75071]: DEBUG nova.compute.manager [req-fb2149d7-84c6-44b8-a9ae-c3d45a1838d3 req-a653c353-055f-412a-9980-9bb217b2dfea service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] No waiting events found dispatching network-vif-plugged-c53ce8ad-40f6-4b44-b067-3b9b770123ac {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:00:38 user nova-compute[75071]: WARNING nova.compute.manager [req-fb2149d7-84c6-44b8-a9ae-c3d45a1838d3 req-a653c353-055f-412a-9980-9bb217b2dfea service nova] [instance: d467afb8-5ec3-4edd-b894-3894122515e1] Received unexpected event network-vif-plugged-c53ce8ad-40f6-4b44-b067-3b9b770123ac for instance with vm_state deleted and task_state None.
Dec 05 13:00:41 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-d03656ec-af9c-408a-a4a5-e28ffa3e58ba req-3f00d2eb-6257-4f4a-9344-1bb9774e01ce service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Received event network-changed-ed58348d-6d66-45e5-b29a-5e3fc86ba7dd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:00:42 user nova-compute[75071]: DEBUG nova.compute.manager [req-d03656ec-af9c-408a-a4a5-e28ffa3e58ba req-3f00d2eb-6257-4f4a-9344-1bb9774e01ce service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Refreshing instance network info cache due to event network-changed-ed58348d-6d66-45e5-b29a-5e3fc86ba7dd. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:00:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d03656ec-af9c-408a-a4a5-e28ffa3e58ba req-3f00d2eb-6257-4f4a-9344-1bb9774e01ce service nova] Acquiring lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:00:42 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d03656ec-af9c-408a-a4a5-e28ffa3e58ba req-3f00d2eb-6257-4f4a-9344-1bb9774e01ce service nova] Acquired lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:00:42 user nova-compute[75071]: DEBUG nova.network.neutron [req-d03656ec-af9c-408a-a4a5-e28ffa3e58ba req-3f00d2eb-6257-4f4a-9344-1bb9774e01ce service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Refreshing network info cache for port ed58348d-6d66-45e5-b29a-5e3fc86ba7dd {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:00:43 user nova-compute[75071]: DEBUG nova.network.neutron [req-d03656ec-af9c-408a-a4a5-e28ffa3e58ba req-3f00d2eb-6257-4f4a-9344-1bb9774e01ce service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Updated VIF entry in instance network info cache for port ed58348d-6d66-45e5-b29a-5e3fc86ba7dd. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:00:43 user nova-compute[75071]: DEBUG nova.network.neutron [req-d03656ec-af9c-408a-a4a5-e28ffa3e58ba req-3f00d2eb-6257-4f4a-9344-1bb9774e01ce service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Updating instance_info_cache with network_info: [{"id": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "address": "fa:16:3e:1f:b4:44", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped58348d-6d", "ovs_interfaceid": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:00:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-d03656ec-af9c-408a-a4a5-e28ffa3e58ba req-3f00d2eb-6257-4f4a-9344-1bb9774e01ce service nova] Releasing lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:00:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "fb17060e-2095-493c-b8dd-25fd6a35c805" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "fb17060e-2095-493c-b8dd-25fd6a35c805" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Starting instance... {{(pid=75071) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75071) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 05 13:00:51 user nova-compute[75071]: INFO nova.compute.claims [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Claim successful on node user
Dec 05 13:00:51 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.195s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Start building networks asynchronously for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Allocating IP information in the background. {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] allocate_for_instance() {{(pid=75071) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 05 13:00:51 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 05 13:00:51 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Start building block device mappings for instance. {{(pid=75071) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG nova.policy [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c40b4872327a40968c5e7a5f89cd137a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e87e18fa15d84a858a5e6c8306589285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75071) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 05 13:00:51 user nova-compute[75071]: INFO nova.virt.block_device [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Booting with volume 38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 at /dev/vda
Dec 05 13:00:51 user nova-compute[75071]: DEBUG os_brick.utils [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddabe8d-8d11-487e-92d4-ba7f9d893939]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50a6dccb79e0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[851e9f83-3f79-414b-b133-ce1f652e5b2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d184767d-d46d-4a9e-aa2f-b041cadd87a0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d124d1e-4151-4aea-aec1-95b6d4b8f998]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Running cmd (subprocess): nvme version {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] 'nvme version' failed. Not Retrying. {{(pid=75071) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] nvme not present on system {{(pid=75071) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 05 13:00:51 user nova-compute[75071]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 05 13:00:51 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d61f42-a304-4af2-9df3-7a27ace0ea68]: (4, '') {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75071) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.lightos [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] LIGHTOS: no hostnqn found. {{(pid=75071) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG os_brick.utils [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50a6dccb79e0', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG nova.virt.block_device [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Updating existing volume attachment record: b534df80-edba-4723-813a-7f0515973bb5 {{(pid=75071) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 05 13:00:51 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:52 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Successfully created port: b28c37fc-5801-408a-932f-0fad9b82579b {{(pid=75071) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 05 13:00:53 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Successfully updated port: b28c37fc-5801-408a-932f-0fad9b82579b {{(pid=75071) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 05 13:00:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "refresh_cache-fb17060e-2095-493c-b8dd-25fd6a35c805" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:00:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquired lock "refresh_cache-fb17060e-2095-493c-b8dd-25fd6a35c805" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:00:53 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Building network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 05 13:00:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-44fa1d95-4bfa-4e41-af02-a83134b4ea4b req-18cca200-b302-4405-96bb-80ce60f9169d service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Received event network-changed-b28c37fc-5801-408a-932f-0fad9b82579b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:00:53 user nova-compute[75071]: DEBUG nova.compute.manager [req-44fa1d95-4bfa-4e41-af02-a83134b4ea4b req-18cca200-b302-4405-96bb-80ce60f9169d service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Refreshing instance network info cache due to event network-changed-b28c37fc-5801-408a-932f-0fad9b82579b. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:00:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44fa1d95-4bfa-4e41-af02-a83134b4ea4b req-18cca200-b302-4405-96bb-80ce60f9169d service nova] Acquiring lock "refresh_cache-fb17060e-2095-493c-b8dd-25fd6a35c805" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:00:53 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Instance cache missing network info. {{(pid=75071) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 05 13:00:53 user nova-compute[75071]: DEBUG nova.network.neutron [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Updating instance_info_cache with network_info: [{"id": "b28c37fc-5801-408a-932f-0fad9b82579b", "address": "fa:16:3e:83:8c:17", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28c37fc-58", "ovs_interfaceid": "b28c37fc-5801-408a-932f-0fad9b82579b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:00:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Releasing lock "refresh_cache-fb17060e-2095-493c-b8dd-25fd6a35c805" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:00:53 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Instance network_info: |[{"id": "b28c37fc-5801-408a-932f-0fad9b82579b", "address": "fa:16:3e:83:8c:17", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28c37fc-58", "ovs_interfaceid": "b28c37fc-5801-408a-932f-0fad9b82579b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75071) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 05 13:00:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44fa1d95-4bfa-4e41-af02-a83134b4ea4b req-18cca200-b302-4405-96bb-80ce60f9169d service nova] Acquired lock "refresh_cache-fb17060e-2095-493c-b8dd-25fd6a35c805" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:00:53 user nova-compute[75071]: DEBUG nova.network.neutron [req-44fa1d95-4bfa-4e41-af02-a83134b4ea4b req-18cca200-b302-4405-96bb-80ce60f9169d service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Refreshing network info cache for port b28c37fc-5801-408a-932f-0fad9b82579b {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:00:53 user nova-compute[75071]: DEBUG nova.network.neutron [req-44fa1d95-4bfa-4e41-af02-a83134b4ea4b req-18cca200-b302-4405-96bb-80ce60f9169d service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Updated VIF entry in instance network info cache for port b28c37fc-5801-408a-932f-0fad9b82579b. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:00:53 user nova-compute[75071]: DEBUG nova.network.neutron [req-44fa1d95-4bfa-4e41-af02-a83134b4ea4b req-18cca200-b302-4405-96bb-80ce60f9169d service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Updating instance_info_cache with network_info: [{"id": "b28c37fc-5801-408a-932f-0fad9b82579b", "address": "fa:16:3e:83:8c:17", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28c37fc-58", "ovs_interfaceid": "b28c37fc-5801-408a-932f-0fad9b82579b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:00:53 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-44fa1d95-4bfa-4e41-af02-a83134b4ea4b req-18cca200-b302-4405-96bb-80ce60f9169d service nova] Releasing lock "refresh_cache-fb17060e-2095-493c-b8dd-25fd6a35c805" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:00:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:00:59 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Start spawning the instance on the hypervisor. {{(pid=75071) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Creating instance directory {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 05 13:01:00 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Creating image(s)
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Did not create local disks {{(pid=75071) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Ensure instance console log exists: /opt/stack/data/nova/instances/fb17060e-2095-493c-b8dd-25fd6a35c805/console.log {{(pid=75071) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Start _get_guest_xml network_info=[{"id": "b28c37fc-5801-408a-932f-0fad9b82579b", "address": "fa:16:3e:83:8c:17", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28c37fc-58", "ovs_interfaceid": "b28c37fc-5801-408a-932f-0fad9b82579b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'b534df80-edba-4723-813a-7f0515973bb5', 'device_type': 'disk', 'delete_on_termination': False, 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btRWjyCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fb17060e-2095-493c-b8dd-25fd6a35c805', 'attached_at': '', 'detached_at': '', 'volume_id': '38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7', 'serial': '38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7'}, 'guest_format': None, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 05 13:01:00 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:01:00 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] CPU controller missing on host. {{(pid=75071) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.host [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] CPU controller found on host. {{(pid=75071) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75071) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-05T12:12:51Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Flavor limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Image limits 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Flavor pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Image pref 0:0:0 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75071) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Got 1 possible topologies {{(pid=75071) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.hardware [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75071) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Calling os-brick to attach iSCSI Volume {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btRWjyCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:01:00 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:01:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:01:00 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:01:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:01:00 user nova-compute[75071]: INFO os_brick.initiator.connectors.iscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[720fe504-a795-4cba-b718-9cd71f6f3169]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 05 13:01:00 user nova-compute[75071]:  {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9302e66-f33b-4c6d-9f95-b90aba2dea09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7] added\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7] added
Dec 05 13:01:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39eeba5-0b36-441c-b239-ef5406c74df6]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbba235-5593-4281-9035-17b74fdbcdbc]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btRWjyCD {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v btRWjyCD" returned: 0 in 0.030s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf31638-4a71-4e6b-aa8b-11a025c80df0]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'btRWjyCD'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6473e71-f635-4947-af43-3daf6806d934]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40ae296-db00-4947-a55c-9c9ed5cc0d90]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 13:01:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 13:01:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --login {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a615b291-a3b1-413b-b9a3-3da79372258e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7, portal: 172.16.0.220,3260]
Dec 05 13:01:00 user nova-compute[75071]: Login to [iface: default, target: iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7, portal: 172.16.0.220,3260] successful.
Dec 05 13:01:00 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:01:00 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:01:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:01:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[45779808-2a7d-4f88-887a-1fd3d8525155]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:01:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:01:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:01:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:01:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[204c400d-9a82-4346-b08c-43b6d9bd9bf9]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:01:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 13:01:01 user nova-compute[75071]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 (non-flash)
Dec 05 13:01:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:01:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 13:01:01 user nova-compute[75071]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 (non-flash)
Dec 05 13:01:01 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:01:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:01:01 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Connected to 172.16.0.220:3260 {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 05 13:01:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=75071) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 05 13:01:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75071) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 05 13:01:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:01:01 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:01:01 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9491881-e820-4d56-a4c0-d5ff1590a3f5]: (4, ('- - 0', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:01:01 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: None {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:01:01 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75071) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btRWjyCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75071) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23530373433333762', 'path': '/dev/sdc'} {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530373433333762', 'path': '/dev/sdc'} {{(pid=75071) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-320458190',display_name='tempest-TestVolumeBootPattern-server-320458190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-320458190',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEBRikV+rtdEtghEQfmH+IM9/Mf1uSkOrTuZKMd3fh01GANS6sbLHxh5KDsp9Ng70B85S/CxxQKzaJLbSYZ6L85stWFiwwGN+NjfmI3mt1Tl5tjNPt0cjz/NZ+xBmahPA==',key_name='tempest-TestVolumeBootPattern-1615085816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e87e18fa15d84a858a5e6c8306589285',ramdisk_id='',reservation_id='r-6ua828fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2021686022',owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:00:52Z,user_data=None,user_id='c40b4872327a40968c5e7a5f89cd137a',uuid=fb17060e-2095-493c-b8dd-25fd6a35c805,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b28c37fc-5801-408a-932f-0fad9b82579b", "address": "fa:16:3e:83:8c:17", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28c37fc-58", "ovs_interfaceid": "b28c37fc-5801-408a-932f-0fad9b82579b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75071) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converting VIF {"id": "b28c37fc-5801-408a-932f-0fad9b82579b", "address": "fa:16:3e:83:8c:17", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28c37fc-58", "ovs_interfaceid": "b28c37fc-5801-408a-932f-0fad9b82579b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:8c:17,bridge_name='br-int',has_traffic_filtering=True,id=b28c37fc-5801-408a-932f-0fad9b82579b,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb28c37fc-58') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG nova.objects.instance [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lazy-loading 'pci_devices' on Instance uuid fb17060e-2095-493c-b8dd-25fd6a35c805 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] End _get_guest_xml xml=<domain type="kvm">
Dec 05 13:01:02 user nova-compute[75071]:   <uuid>fb17060e-2095-493c-b8dd-25fd6a35c805</uuid>
Dec 05 13:01:02 user nova-compute[75071]:   <name>instance-00000034</name>
Dec 05 13:01:02 user nova-compute[75071]:   <memory>524288</memory>
Dec 05 13:01:02 user nova-compute[75071]:   <vcpu>1</vcpu>
Dec 05 13:01:02 user nova-compute[75071]:   <metadata>
Dec 05 13:01:02 user nova-compute[75071]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 05 13:01:02 user nova-compute[75071]:       <nova:package version="0.0.0"/>
Dec 05 13:01:02 user nova-compute[75071]:       <nova:name>tempest-TestVolumeBootPattern-server-320458190</nova:name>
Dec 05 13:01:02 user nova-compute[75071]:       <nova:creationTime>2023-12-05 13:01:00</nova:creationTime>
Dec 05 13:01:02 user nova-compute[75071]:       <nova:flavor name="m1.tiny">
Dec 05 13:01:02 user nova-compute[75071]:         <nova:memory>512</nova:memory>
Dec 05 13:01:02 user nova-compute[75071]:         <nova:disk>1</nova:disk>
Dec 05 13:01:02 user nova-compute[75071]:         <nova:swap>0</nova:swap>
Dec 05 13:01:02 user nova-compute[75071]:         <nova:ephemeral>0</nova:ephemeral>
Dec 05 13:01:02 user nova-compute[75071]:         <nova:vcpus>1</nova:vcpus>
Dec 05 13:01:02 user nova-compute[75071]:       </nova:flavor>
Dec 05 13:01:02 user nova-compute[75071]:       <nova:owner>
Dec 05 13:01:02 user nova-compute[75071]:         <nova:user uuid="c40b4872327a40968c5e7a5f89cd137a">tempest-TestVolumeBootPattern-2021686022-project-member</nova:user>
Dec 05 13:01:02 user nova-compute[75071]:         <nova:project uuid="e87e18fa15d84a858a5e6c8306589285">tempest-TestVolumeBootPattern-2021686022</nova:project>
Dec 05 13:01:02 user nova-compute[75071]:       </nova:owner>
Dec 05 13:01:02 user nova-compute[75071]:       <nova:ports>
Dec 05 13:01:02 user nova-compute[75071]:         <nova:port uuid="b28c37fc-5801-408a-932f-0fad9b82579b">
Dec 05 13:01:02 user nova-compute[75071]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 05 13:01:02 user nova-compute[75071]:         </nova:port>
Dec 05 13:01:02 user nova-compute[75071]:       </nova:ports>
Dec 05 13:01:02 user nova-compute[75071]:     </nova:instance>
Dec 05 13:01:02 user nova-compute[75071]:   </metadata>
Dec 05 13:01:02 user nova-compute[75071]:   <sysinfo type="smbios">
Dec 05 13:01:02 user nova-compute[75071]:     <system>
Dec 05 13:01:02 user nova-compute[75071]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 05 13:01:02 user nova-compute[75071]:       <entry name="product">OpenStack Nova</entry>
Dec 05 13:01:02 user nova-compute[75071]:       <entry name="version">0.0.0</entry>
Dec 05 13:01:02 user nova-compute[75071]:       <entry name="serial">fb17060e-2095-493c-b8dd-25fd6a35c805</entry>
Dec 05 13:01:02 user nova-compute[75071]:       <entry name="uuid">fb17060e-2095-493c-b8dd-25fd6a35c805</entry>
Dec 05 13:01:02 user nova-compute[75071]:       <entry name="family">Virtual Machine</entry>
Dec 05 13:01:02 user nova-compute[75071]:     </system>
Dec 05 13:01:02 user nova-compute[75071]:   </sysinfo>
Dec 05 13:01:02 user nova-compute[75071]:   <os>
Dec 05 13:01:02 user nova-compute[75071]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 05 13:01:02 user nova-compute[75071]:     <boot dev="hd"/>
Dec 05 13:01:02 user nova-compute[75071]:     <smbios mode="sysinfo"/>
Dec 05 13:01:02 user nova-compute[75071]:   </os>
Dec 05 13:01:02 user nova-compute[75071]:   <features>
Dec 05 13:01:02 user nova-compute[75071]:     <acpi/>
Dec 05 13:01:02 user nova-compute[75071]:     <apic/>
Dec 05 13:01:02 user nova-compute[75071]:     <vmcoreinfo/>
Dec 05 13:01:02 user nova-compute[75071]:   </features>
Dec 05 13:01:02 user nova-compute[75071]:   <clock offset="utc">
Dec 05 13:01:02 user nova-compute[75071]:     <timer name="pit" tickpolicy="delay"/>
Dec 05 13:01:02 user nova-compute[75071]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 05 13:01:02 user nova-compute[75071]:     <timer name="hpet" present="no"/>
Dec 05 13:01:02 user nova-compute[75071]:   </clock>
Dec 05 13:01:02 user nova-compute[75071]:   <cpu mode="custom" match="exact">
Dec 05 13:01:02 user nova-compute[75071]:     <model>Nehalem</model>
Dec 05 13:01:02 user nova-compute[75071]:     <topology sockets="1" cores="1" threads="1"/>
Dec 05 13:01:02 user nova-compute[75071]:   </cpu>
Dec 05 13:01:02 user nova-compute[75071]:   <devices>
Dec 05 13:01:02 user nova-compute[75071]:     <disk type="block" device="disk">
Dec 05 13:01:02 user nova-compute[75071]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 05 13:01:02 user nova-compute[75071]:       <source dev="/dev/sdc"/>
Dec 05 13:01:02 user nova-compute[75071]:       <target dev="vda" bus="virtio"/>
Dec 05 13:01:02 user nova-compute[75071]:       <serial>38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7</serial>
Dec 05 13:01:02 user nova-compute[75071]:     </disk>
Dec 05 13:01:02 user nova-compute[75071]:     <interface type="ethernet">
Dec 05 13:01:02 user nova-compute[75071]:       <mac address="fa:16:3e:83:8c:17"/>
Dec 05 13:01:02 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 13:01:02 user nova-compute[75071]:       <mtu size="1442"/>
Dec 05 13:01:02 user nova-compute[75071]:       <target dev="tapb28c37fc-58"/>
Dec 05 13:01:02 user nova-compute[75071]:     </interface>
Dec 05 13:01:02 user nova-compute[75071]:     <serial type="pty">
Dec 05 13:01:02 user nova-compute[75071]:       <log file="/opt/stack/data/nova/instances/fb17060e-2095-493c-b8dd-25fd6a35c805/console.log" append="off"/>
Dec 05 13:01:02 user nova-compute[75071]:     </serial>
Dec 05 13:01:02 user nova-compute[75071]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 05 13:01:02 user nova-compute[75071]:     <video>
Dec 05 13:01:02 user nova-compute[75071]:       <model type="virtio"/>
Dec 05 13:01:02 user nova-compute[75071]:     </video>
Dec 05 13:01:02 user nova-compute[75071]:     <rng model="virtio">
Dec 05 13:01:02 user nova-compute[75071]:       <backend model="random">/dev/urandom</backend>
Dec 05 13:01:02 user nova-compute[75071]:     </rng>
Dec 05 13:01:02 user nova-compute[75071]:     <controller type="usb" index="0" model="none"/>
Dec 05 13:01:02 user nova-compute[75071]:     <memballoon model="virtio">
Dec 05 13:01:02 user nova-compute[75071]:       <stats period="10"/>
Dec 05 13:01:02 user nova-compute[75071]:     </memballoon>
Dec 05 13:01:02 user nova-compute[75071]:   </devices>
Dec 05 13:01:02 user nova-compute[75071]: </domain>
Dec 05 13:01:02 user nova-compute[75071]:  {{(pid=75071) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-320458190',display_name='tempest-TestVolumeBootPattern-server-320458190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-320458190',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEBRikV+rtdEtghEQfmH+IM9/Mf1uSkOrTuZKMd3fh01GANS6sbLHxh5KDsp9Ng70B85S/CxxQKzaJLbSYZ6L85stWFiwwGN+NjfmI3mt1Tl5tjNPt0cjz/NZ+xBmahPA==',key_name='tempest-TestVolumeBootPattern-1615085816',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e87e18fa15d84a858a5e6c8306589285',ramdisk_id='',reservation_id='r-6ua828fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2021686022',owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-05T13:00:52Z,user_data=None,user_id='c40b4872327a40968c5e7a5f89cd137a',uuid=fb17060e-2095-493c-b8dd-25fd6a35c805,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b28c37fc-5801-408a-932f-0fad9b82579b", "address": "fa:16:3e:83:8c:17", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28c37fc-58", "ovs_interfaceid": "b28c37fc-5801-408a-932f-0fad9b82579b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converting VIF {"id": "b28c37fc-5801-408a-932f-0fad9b82579b", "address": "fa:16:3e:83:8c:17", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28c37fc-58", "ovs_interfaceid": "b28c37fc-5801-408a-932f-0fad9b82579b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:8c:17,bridge_name='br-int',has_traffic_filtering=True,id=b28c37fc-5801-408a-932f-0fad9b82579b,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb28c37fc-58') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG os_vif [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:8c:17,bridge_name='br-int',has_traffic_filtering=True,id=b28c37fc-5801-408a-932f-0fad9b82579b,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb28c37fc-58') {{(pid=75071) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5207579b-3bdb-5d1d-999c-d56da6c61dc3', '_type': 'linux-noop'}}, row=False) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb28c37fc-58, may_exist=True, interface_attrs={}) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb28c37fc-58, col_values=(('qos', UUID('803a60ac-51f9-4001-9e3e-0f6874bca4d7')),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb28c37fc-58, col_values=(('external_ids', {'iface-id': 'b28c37fc-5801-408a-932f-0fad9b82579b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:8c:17', 'vm-uuid': 'fb17060e-2095-493c-b8dd-25fd6a35c805'}),), if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:02 user nova-compute[75071]: INFO os_vif [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:8c:17,bridge_name='br-int',has_traffic_filtering=True,id=b28c37fc-5801-408a-932f-0fad9b82579b,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb28c37fc-58')
Dec 05 13:01:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] No BDM found with device name vda, not building metadata. {{(pid=75071) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 05 13:01:02 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] No VIF found with MAC fa:16:3e:83:8c:17, not building metadata {{(pid=75071) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 05 13:01:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-f38fbdc8-7f68-480d-b554-55bdad29c7ea req-a043fd6d-14c6-4355-9d4f-de3391e83d53 service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Received event network-vif-plugged-b28c37fc-5801-408a-932f-0fad9b82579b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:01:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f38fbdc8-7f68-480d-b554-55bdad29c7ea req-a043fd6d-14c6-4355-9d4f-de3391e83d53 service nova] Acquiring lock "fb17060e-2095-493c-b8dd-25fd6a35c805-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:01:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f38fbdc8-7f68-480d-b554-55bdad29c7ea req-a043fd6d-14c6-4355-9d4f-de3391e83d53 service nova] Lock "fb17060e-2095-493c-b8dd-25fd6a35c805-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:01:03 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-f38fbdc8-7f68-480d-b554-55bdad29c7ea req-a043fd6d-14c6-4355-9d4f-de3391e83d53 service nova] Lock "fb17060e-2095-493c-b8dd-25fd6a35c805-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:01:03 user nova-compute[75071]: DEBUG nova.compute.manager [req-f38fbdc8-7f68-480d-b554-55bdad29c7ea req-a043fd6d-14c6-4355-9d4f-de3391e83d53 service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] No waiting events found dispatching network-vif-plugged-b28c37fc-5801-408a-932f-0fad9b82579b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:01:03 user nova-compute[75071]: WARNING nova.compute.manager [req-f38fbdc8-7f68-480d-b554-55bdad29c7ea req-a043fd6d-14c6-4355-9d4f-de3391e83d53 service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Received unexpected event network-vif-plugged-b28c37fc-5801-408a-932f-0fad9b82579b for instance with vm_state building and task_state spawning.
Dec 05 13:01:04 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-a4618861-07de-4eef-be48-150ca76278a4 req-46c20933-b651-48e0-8440-69dfbaaee9fb service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Received event network-vif-plugged-b28c37fc-5801-408a-932f-0fad9b82579b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:01:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a4618861-07de-4eef-be48-150ca76278a4 req-46c20933-b651-48e0-8440-69dfbaaee9fb service nova] Acquiring lock "fb17060e-2095-493c-b8dd-25fd6a35c805-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:01:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a4618861-07de-4eef-be48-150ca76278a4 req-46c20933-b651-48e0-8440-69dfbaaee9fb service nova] Lock "fb17060e-2095-493c-b8dd-25fd6a35c805-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:01:05 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a4618861-07de-4eef-be48-150ca76278a4 req-46c20933-b651-48e0-8440-69dfbaaee9fb service nova] Lock "fb17060e-2095-493c-b8dd-25fd6a35c805-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:01:05 user nova-compute[75071]: DEBUG nova.compute.manager [req-a4618861-07de-4eef-be48-150ca76278a4 req-46c20933-b651-48e0-8440-69dfbaaee9fb service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] No waiting events found dispatching network-vif-plugged-b28c37fc-5801-408a-932f-0fad9b82579b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:01:05 user nova-compute[75071]: WARNING nova.compute.manager [req-a4618861-07de-4eef-be48-150ca76278a4 req-46c20933-b651-48e0-8440-69dfbaaee9fb service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Received unexpected event network-vif-plugged-b28c37fc-5801-408a-932f-0fad9b82579b for instance with vm_state building and task_state spawning.
Dec 05 13:01:05 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Instance event wait completed in 0 seconds for  {{(pid=75071) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 05 13:01:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Guest created on hypervisor {{(pid=75071) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 05 13:01:05 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Instance spawned successfully.
Dec 05 13:01:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 05 13:01:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Found default for hw_cdrom_bus of ide {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:01:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Found default for hw_disk_bus of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:01:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Found default for hw_input_bus of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:01:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Found default for hw_pointer_model of None {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:01:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Found default for hw_video_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:01:05 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Found default for hw_vif_model of virtio {{(pid=75071) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 05 13:01:06 user nova-compute[75071]: INFO nova.compute.manager [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Took 5.31 seconds to spawn the instance on the hypervisor.
Dec 05 13:01:06 user nova-compute[75071]: DEBUG nova.compute.manager [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Checking state {{(pid=75071) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 05 13:01:06 user nova-compute[75071]: INFO nova.compute.manager [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Took 14.69 seconds to build instance.
Dec 05 13:01:06 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-2e2d5371-168c-48e7-9e86-a72004071157 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "fb17060e-2095-493c-b8dd-25fd6a35c805" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.817s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:01:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:14 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:01:15 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:01:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:17 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:01:19 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:20 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:01:20 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:01:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:01:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:22 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:01:22 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:01:22 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:01:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:01:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:01:22 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:01:22 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:01:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 13:01:22 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 13:01:23 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:01:23 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:01:23 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8821MB free_disk=24.984622955322266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:01:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:01:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:01:23 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance f4639baf-60e3-466e-bbc5-6268a6e28b6a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 13:01:23 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance fb17060e-2095-493c-b8dd-25fd6a35c805 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 13:01:23 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:01:23 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:01:23 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:01:23 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:01:23 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:01:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:01:24 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:26 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:01:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:29 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:33 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:01:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:01:33 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 13:01:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:01:33 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:01:33 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:01:33 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lazy-loading 'info_cache' on Instance uuid f4639baf-60e3-466e-bbc5-6268a6e28b6a {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:01:34 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Updating instance_info_cache with network_info: [{"id": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "address": "fa:16:3e:1f:b4:44", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped58348d-6d", "ovs_interfaceid": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:01:34 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:01:34 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:01:34 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:01:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:01:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 13:01:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:01:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:01:52 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:56 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:01:57 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:02 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:07 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:12 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:02:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:02:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:02:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 13:02:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:02:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:02:17 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:17 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:02:17 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:02:17 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:02:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:02:21 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:02:22 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:23 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:02:23 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:02:23 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:02:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:02:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:02:23 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:02:23 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:02:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 13:02:23 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 13:02:24 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:02:24 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:02:24 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=8962MB free_disk=24.983139038085938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:02:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:02:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:02:24 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance f4639baf-60e3-466e-bbc5-6268a6e28b6a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 13:02:24 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance fb17060e-2095-493c-b8dd-25fd6a35c805 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 13:02:24 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:02:24 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:02:24 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:02:24 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:02:24 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:02:24 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:02:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:02:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:02:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 13:02:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:02:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:02:27 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:02:28 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:02:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:02:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 13:02:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:02:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:02:32 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:02:35 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:02:35 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:02:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-fb17060e-2095-493c-b8dd-25fd6a35c805" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:02:35 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-fb17060e-2095-493c-b8dd-25fd6a35c805" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:02:35 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:02:36 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Updating instance_info_cache with network_info: [{"id": "b28c37fc-5801-408a-932f-0fad9b82579b", "address": "fa:16:3e:83:8c:17", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28c37fc-58", "ovs_interfaceid": "b28c37fc-5801-408a-932f-0fad9b82579b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:02:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-fb17060e-2095-493c-b8dd-25fd6a35c805" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:02:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:02:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:02:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 13:02:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:02:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:02:37 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:02:42 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:02:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-79d527cb-31c9-40c8-b91a-06bd1250e081 req-df467e37-0302-4374-a3a2-19f85b4ec547 service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Received event network-changed-b28c37fc-5801-408a-932f-0fad9b82579b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:02:43 user nova-compute[75071]: DEBUG nova.compute.manager [req-79d527cb-31c9-40c8-b91a-06bd1250e081 req-df467e37-0302-4374-a3a2-19f85b4ec547 service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Refreshing instance network info cache due to event network-changed-b28c37fc-5801-408a-932f-0fad9b82579b. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:02:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-79d527cb-31c9-40c8-b91a-06bd1250e081 req-df467e37-0302-4374-a3a2-19f85b4ec547 service nova] Acquiring lock "refresh_cache-fb17060e-2095-493c-b8dd-25fd6a35c805" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:02:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-79d527cb-31c9-40c8-b91a-06bd1250e081 req-df467e37-0302-4374-a3a2-19f85b4ec547 service nova] Acquired lock "refresh_cache-fb17060e-2095-493c-b8dd-25fd6a35c805" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:02:43 user nova-compute[75071]: DEBUG nova.network.neutron [req-79d527cb-31c9-40c8-b91a-06bd1250e081 req-df467e37-0302-4374-a3a2-19f85b4ec547 service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Refreshing network info cache for port b28c37fc-5801-408a-932f-0fad9b82579b {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:02:43 user nova-compute[75071]: DEBUG nova.network.neutron [req-79d527cb-31c9-40c8-b91a-06bd1250e081 req-df467e37-0302-4374-a3a2-19f85b4ec547 service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Updated VIF entry in instance network info cache for port b28c37fc-5801-408a-932f-0fad9b82579b. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:02:43 user nova-compute[75071]: DEBUG nova.network.neutron [req-79d527cb-31c9-40c8-b91a-06bd1250e081 req-df467e37-0302-4374-a3a2-19f85b4ec547 service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Updating instance_info_cache with network_info: [{"id": "b28c37fc-5801-408a-932f-0fad9b82579b", "address": "fa:16:3e:83:8c:17", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28c37fc-58", "ovs_interfaceid": "b28c37fc-5801-408a-932f-0fad9b82579b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:02:43 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-79d527cb-31c9-40c8-b91a-06bd1250e081 req-df467e37-0302-4374-a3a2-19f85b4ec547 service nova] Releasing lock "refresh_cache-fb17060e-2095-493c-b8dd-25fd6a35c805" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:02:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-0cc6e60a-a609-4967-ac1a-f5039ee58bd7 req-9fa2a9e7-06e8-45a9-be94-11d5bc15f834 service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Received event network-changed-b28c37fc-5801-408a-932f-0fad9b82579b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:02:44 user nova-compute[75071]: DEBUG nova.compute.manager [req-0cc6e60a-a609-4967-ac1a-f5039ee58bd7 req-9fa2a9e7-06e8-45a9-be94-11d5bc15f834 service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Refreshing instance network info cache due to event network-changed-b28c37fc-5801-408a-932f-0fad9b82579b. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:02:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0cc6e60a-a609-4967-ac1a-f5039ee58bd7 req-9fa2a9e7-06e8-45a9-be94-11d5bc15f834 service nova] Acquiring lock "refresh_cache-fb17060e-2095-493c-b8dd-25fd6a35c805" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:02:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0cc6e60a-a609-4967-ac1a-f5039ee58bd7 req-9fa2a9e7-06e8-45a9-be94-11d5bc15f834 service nova] Acquired lock "refresh_cache-fb17060e-2095-493c-b8dd-25fd6a35c805" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:02:44 user nova-compute[75071]: DEBUG nova.network.neutron [req-0cc6e60a-a609-4967-ac1a-f5039ee58bd7 req-9fa2a9e7-06e8-45a9-be94-11d5bc15f834 service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Refreshing network info cache for port b28c37fc-5801-408a-932f-0fad9b82579b {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:02:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "fb17060e-2095-493c-b8dd-25fd6a35c805" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:02:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "fb17060e-2095-493c-b8dd-25fd6a35c805" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:02:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "fb17060e-2095-493c-b8dd-25fd6a35c805-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:02:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "fb17060e-2095-493c-b8dd-25fd6a35c805-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:02:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "fb17060e-2095-493c-b8dd-25fd6a35c805-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:02:44 user nova-compute[75071]: INFO nova.compute.manager [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Terminating instance
Dec 05 13:02:44 user nova-compute[75071]: DEBUG nova.compute.manager [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:02:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:44 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:44 user nova-compute[75071]: DEBUG nova.network.neutron [req-0cc6e60a-a609-4967-ac1a-f5039ee58bd7 req-9fa2a9e7-06e8-45a9-be94-11d5bc15f834 service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Updated VIF entry in instance network info cache for port b28c37fc-5801-408a-932f-0fad9b82579b. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:02:44 user nova-compute[75071]: DEBUG nova.network.neutron [req-0cc6e60a-a609-4967-ac1a-f5039ee58bd7 req-9fa2a9e7-06e8-45a9-be94-11d5bc15f834 service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Updating instance_info_cache with network_info: [{"id": "b28c37fc-5801-408a-932f-0fad9b82579b", "address": "fa:16:3e:83:8c:17", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28c37fc-58", "ovs_interfaceid": "b28c37fc-5801-408a-932f-0fad9b82579b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:02:44 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-0cc6e60a-a609-4967-ac1a-f5039ee58bd7 req-9fa2a9e7-06e8-45a9-be94-11d5bc15f834 service nova] Releasing lock "refresh_cache-fb17060e-2095-493c-b8dd-25fd6a35c805" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Instance destroyed successfully.
Dec 05 13:02:45 user nova-compute[75071]: DEBUG nova.objects.instance [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lazy-loading 'resources' on Instance uuid fb17060e-2095-493c-b8dd-25fd6a35c805 {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T13:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-320458190',display_name='tempest-TestVolumeBootPattern-server-320458190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-320458190',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEBRikV+rtdEtghEQfmH+IM9/Mf1uSkOrTuZKMd3fh01GANS6sbLHxh5KDsp9Ng70B85S/CxxQKzaJLbSYZ6L85stWFiwwGN+NjfmI3mt1Tl5tjNPt0cjz/NZ+xBmahPA==',key_name='tempest-TestVolumeBootPattern-1615085816',keypairs=<?>,launch_index=0,launched_at=2023-12-05T13:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e87e18fa15d84a858a5e6c8306589285',ramdisk_id='',reservation_id='r-6ua828fz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2021686022',owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T13:01:06Z,user_data=None,user_id='c40b4872327a40968c5e7a5f89cd137a',uuid=fb17060e-2095-493c-b8dd-25fd6a35c805,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b28c37fc-5801-408a-932f-0fad9b82579b", "address": "fa:16:3e:83:8c:17", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28c37fc-58", "ovs_interfaceid": "b28c37fc-5801-408a-932f-0fad9b82579b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converting VIF {"id": "b28c37fc-5801-408a-932f-0fad9b82579b", "address": "fa:16:3e:83:8c:17", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb28c37fc-58", "ovs_interfaceid": "b28c37fc-5801-408a-932f-0fad9b82579b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:8c:17,bridge_name='br-int',has_traffic_filtering=True,id=b28c37fc-5801-408a-932f-0fad9b82579b,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb28c37fc-58') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_vif [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:8c:17,bridge_name='br-int',has_traffic_filtering=True,id=b28c37fc-5801-408a-932f-0fad9b82579b,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb28c37fc-58') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb28c37fc-58, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=803a60ac-51f9-4001-9e3e-0f6874bca4d7) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:45 user nova-compute[75071]: INFO os_vif [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:8c:17,bridge_name='br-int',has_traffic_filtering=True,id=b28c37fc-5801-408a-932f-0fad9b82579b,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb28c37fc-58')
Dec 05 13:02:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'btRWjyCD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:02:45 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1320c6-79cb-4be5-a2dc-547c4c3027bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:02:45 user nova-compute[75071]: No targets found.
Dec 05 13:02:45 user nova-compute[75071]: iSNS:
Dec 05 13:02:45 user nova-compute[75071]: No targets found.
Dec 05 13:02:45 user nova-compute[75071]: STATIC:
Dec 05 13:02:45 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7
Dec 05 13:02:45 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:02:45 user nova-compute[75071]:                 Iface Name: default
Dec 05 13:02:45 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d
Dec 05 13:02:45 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:02:45 user nova-compute[75071]:                 Iface Name: default
Dec 05 13:02:45 user nova-compute[75071]: FIRMWARE:
Dec 05 13:02:45 user nova-compute[75071]: No targets found.
Dec 05 13:02:45 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:02:45 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:02:45 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2bb56f-2c0b-415c-b52e-3a42aaaef33c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[be549ee0-305e-463a-b5c5-d5fa32d07e6f]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 13:02:45 user nova-compute[75071]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 (non-flash)
Dec 05 13:02:45 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 13:02:45 user nova-compute[75071]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 (non-flash)
Dec 05 13:02:45 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f827c1dedd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7'): ({'sdc'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Removing single pathed devices sdc {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a5d53c-deb8-4fb3-9ebb-f13f4fe945f2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3f6f36-49c1-42a9-b358-32faac59eaf7]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Flushing IO for device /dev/sdc {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a70ebe-ff31-46dc-bcee-65dc351a53d1]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c285375d-b20b-478b-ab2c-14352f67d461]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] SCSI volumes sdc have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b60231e-813f-45e0-9dbc-884bf59bc7f6]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73da239-459b-435f-8fa9-9b8da89e1684]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7, portal: 172.16.0.220,3260]
Dec 05 13:02:45 user nova-compute[75071]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7, portal: 172.16.0.220,3260] successful.
Dec 05 13:02:45 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38dc9fb0-3bdc-424b-9fe6-0befd1b66ef7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c1763c-7c7d-4aa9-958a-9b2064c809cc]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] <== disconnect_volume: return (314ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:02:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Deleting instance files /opt/stack/data/nova/instances/fb17060e-2095-493c-b8dd-25fd6a35c805_del
Dec 05 13:02:45 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Deletion of /opt/stack/data/nova/instances/fb17060e-2095-493c-b8dd-25fd6a35c805_del complete
Dec 05 13:02:45 user nova-compute[75071]: INFO nova.compute.manager [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Took 1.15 seconds to destroy the instance on the hypervisor.
Dec 05 13:02:45 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:02:45 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:02:46 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:02:46 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Took 0.40 seconds to deallocate network for instance.
Dec 05 13:02:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec2cfd5f-e8f5-440e-938c-9627dc7c4628 req-486c49f2-0427-40bd-80dc-1a119f5dc47a service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Received event network-vif-deleted-b28c37fc-5801-408a-932f-0fad9b82579b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:02:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-692782be-cfab-4baa-81f0-65e66980a1f8 req-ee0df585-f4dd-44c1-b5a1-f249ad8aafbc service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Received event network-vif-unplugged-b28c37fc-5801-408a-932f-0fad9b82579b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:02:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-692782be-cfab-4baa-81f0-65e66980a1f8 req-ee0df585-f4dd-44c1-b5a1-f249ad8aafbc service nova] Acquiring lock "fb17060e-2095-493c-b8dd-25fd6a35c805-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:02:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-692782be-cfab-4baa-81f0-65e66980a1f8 req-ee0df585-f4dd-44c1-b5a1-f249ad8aafbc service nova] Lock "fb17060e-2095-493c-b8dd-25fd6a35c805-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:02:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-692782be-cfab-4baa-81f0-65e66980a1f8 req-ee0df585-f4dd-44c1-b5a1-f249ad8aafbc service nova] Lock "fb17060e-2095-493c-b8dd-25fd6a35c805-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:02:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-692782be-cfab-4baa-81f0-65e66980a1f8 req-ee0df585-f4dd-44c1-b5a1-f249ad8aafbc service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] No waiting events found dispatching network-vif-unplugged-b28c37fc-5801-408a-932f-0fad9b82579b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:02:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-692782be-cfab-4baa-81f0-65e66980a1f8 req-ee0df585-f4dd-44c1-b5a1-f249ad8aafbc service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Received event network-vif-unplugged-b28c37fc-5801-408a-932f-0fad9b82579b for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:02:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-692782be-cfab-4baa-81f0-65e66980a1f8 req-ee0df585-f4dd-44c1-b5a1-f249ad8aafbc service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Received event network-vif-plugged-b28c37fc-5801-408a-932f-0fad9b82579b {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:02:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-692782be-cfab-4baa-81f0-65e66980a1f8 req-ee0df585-f4dd-44c1-b5a1-f249ad8aafbc service nova] Acquiring lock "fb17060e-2095-493c-b8dd-25fd6a35c805-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:02:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-692782be-cfab-4baa-81f0-65e66980a1f8 req-ee0df585-f4dd-44c1-b5a1-f249ad8aafbc service nova] Lock "fb17060e-2095-493c-b8dd-25fd6a35c805-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:02:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-692782be-cfab-4baa-81f0-65e66980a1f8 req-ee0df585-f4dd-44c1-b5a1-f249ad8aafbc service nova] Lock "fb17060e-2095-493c-b8dd-25fd6a35c805-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:02:46 user nova-compute[75071]: DEBUG nova.compute.manager [req-692782be-cfab-4baa-81f0-65e66980a1f8 req-ee0df585-f4dd-44c1-b5a1-f249ad8aafbc service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] No waiting events found dispatching network-vif-plugged-b28c37fc-5801-408a-932f-0fad9b82579b {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:02:46 user nova-compute[75071]: WARNING nova.compute.manager [req-692782be-cfab-4baa-81f0-65e66980a1f8 req-ee0df585-f4dd-44c1-b5a1-f249ad8aafbc service nova] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Received unexpected event network-vif-plugged-b28c37fc-5801-408a-932f-0fad9b82579b for instance with vm_state active and task_state deleting.
Dec 05 13:02:46 user nova-compute[75071]: INFO nova.compute.manager [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: fb17060e-2095-493c-b8dd-25fd6a35c805] Took 0.80 seconds to detach 1 volumes for instance.
Dec 05 13:02:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:02:46 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:02:47 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:02:47 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:02:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:02:47 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Deleted allocations for instance fb17060e-2095-493c-b8dd-25fd6a35c805
Dec 05 13:02:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-827aa34a-81e7-4d62-8c3a-a5b64444b371 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "fb17060e-2095-493c-b8dd-25fd6a35c805" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.680s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:02:50 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:02:55 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:00 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:05 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:10 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:15 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:17 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:03:19 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:03:19 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:03:20 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:22 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:03:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:03:23 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:03:25 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:25 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:03:25 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:03:25 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:03:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:03:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:03:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:03:25 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:03:25 user nova-compute[75071]: DEBUG nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75071) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 05 13:03:26 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:03:26 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:03:26 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=9024MB free_disk=24.982276916503906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:03:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:03:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:03:26 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Instance f4639baf-60e3-466e-bbc5-6268a6e28b6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75071) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 05 13:03:26 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:03:26 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:03:26 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:03:26 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:03:26 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:03:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:03:26 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:03:28 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:03:30 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:35 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:36 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:03:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:03:36 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 13:03:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:03:36 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquired lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:03:36 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Forcefully refreshing network info cache for instance {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 05 13:03:36 user nova-compute[75071]: DEBUG nova.objects.instance [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lazy-loading 'info_cache' on Instance uuid f4639baf-60e3-466e-bbc5-6268a6e28b6a {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:03:37 user nova-compute[75071]: DEBUG nova.network.neutron [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Updating instance_info_cache with network_info: [{"id": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "address": "fa:16:3e:1f:b4:44", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped58348d-6d", "ovs_interfaceid": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:03:37 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Releasing lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:03:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Updated the network info_cache for instance {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 05 13:03:37 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:03:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances with incomplete migration  {{(pid=75071) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 05 13:03:40 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:41 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:03:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Cleaning up deleted instances {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 05 13:03:41 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] There are 0 instances to clean {{(pid=75071) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 05 13:03:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:47 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec274563-0052-4812-80dc-478d9ab05f84 req-b2001f07-64cc-4203-a6fe-75123ccd24ff service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Received event network-changed-ed58348d-6d66-45e5-b29a-5e3fc86ba7dd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:03:47 user nova-compute[75071]: DEBUG nova.compute.manager [req-ec274563-0052-4812-80dc-478d9ab05f84 req-b2001f07-64cc-4203-a6fe-75123ccd24ff service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Refreshing instance network info cache due to event network-changed-ed58348d-6d66-45e5-b29a-5e3fc86ba7dd. {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 05 13:03:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec274563-0052-4812-80dc-478d9ab05f84 req-b2001f07-64cc-4203-a6fe-75123ccd24ff service nova] Acquiring lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 05 13:03:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec274563-0052-4812-80dc-478d9ab05f84 req-b2001f07-64cc-4203-a6fe-75123ccd24ff service nova] Acquired lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 05 13:03:47 user nova-compute[75071]: DEBUG nova.network.neutron [req-ec274563-0052-4812-80dc-478d9ab05f84 req-b2001f07-64cc-4203-a6fe-75123ccd24ff service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Refreshing network info cache for port ed58348d-6d66-45e5-b29a-5e3fc86ba7dd {{(pid=75071) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 05 13:03:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:03:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:03:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:03:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:03:47 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:03:47 user nova-compute[75071]: INFO nova.compute.manager [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Terminating instance
Dec 05 13:03:47 user nova-compute[75071]: DEBUG nova.compute.manager [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Start destroying the instance on the hypervisor. {{(pid=75071) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-05d7a2bd-8887-481a-a68a-35098e7c4835 req-49c5dfc8-68a5-431d-af8b-34b33faa5f08 service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Received event network-vif-unplugged-ed58348d-6d66-45e5-b29a-5e3fc86ba7dd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-05d7a2bd-8887-481a-a68a-35098e7c4835 req-49c5dfc8-68a5-431d-af8b-34b33faa5f08 service nova] Acquiring lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-05d7a2bd-8887-481a-a68a-35098e7c4835 req-49c5dfc8-68a5-431d-af8b-34b33faa5f08 service nova] Lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-05d7a2bd-8887-481a-a68a-35098e7c4835 req-49c5dfc8-68a5-431d-af8b-34b33faa5f08 service nova] Lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-05d7a2bd-8887-481a-a68a-35098e7c4835 req-49c5dfc8-68a5-431d-af8b-34b33faa5f08 service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] No waiting events found dispatching network-vif-unplugged-ed58348d-6d66-45e5-b29a-5e3fc86ba7dd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG nova.compute.manager [req-05d7a2bd-8887-481a-a68a-35098e7c4835 req-49c5dfc8-68a5-431d-af8b-34b33faa5f08 service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Received event network-vif-unplugged-ed58348d-6d66-45e5-b29a-5e3fc86ba7dd for instance with task_state deleting. {{(pid=75071) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG nova.network.neutron [req-ec274563-0052-4812-80dc-478d9ab05f84 req-b2001f07-64cc-4203-a6fe-75123ccd24ff service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Updated VIF entry in instance network info cache for port ed58348d-6d66-45e5-b29a-5e3fc86ba7dd. {{(pid=75071) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG nova.network.neutron [req-ec274563-0052-4812-80dc-478d9ab05f84 req-b2001f07-64cc-4203-a6fe-75123ccd24ff service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Updating instance_info_cache with network_info: [{"id": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "address": "fa:16:3e:1f:b4:44", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped58348d-6d", "ovs_interfaceid": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-ec274563-0052-4812-80dc-478d9ab05f84 req-b2001f07-64cc-4203-a6fe-75123ccd24ff service nova] Releasing lock "refresh_cache-f4639baf-60e3-466e-bbc5-6268a6e28b6a" {{(pid=75071) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 05 13:03:48 user nova-compute[75071]: INFO nova.virt.libvirt.driver [-] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Instance destroyed successfully.
Dec 05 13:03:48 user nova-compute[75071]: DEBUG nova.objects.instance [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lazy-loading 'resources' on Instance uuid f4639baf-60e3-466e-bbc5-6268a6e28b6a {{(pid=75071) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.vif [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-05T12:58:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-827896882',display_name='tempest-TestVolumeBootPattern-server-827896882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-827896882',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEBRikV+rtdEtghEQfmH+IM9/Mf1uSkOrTuZKMd3fh01GANS6sbLHxh5KDsp9Ng70B85S/CxxQKzaJLbSYZ6L85stWFiwwGN+NjfmI3mt1Tl5tjNPt0cjz/NZ+xBmahPA==',key_name='tempest-TestVolumeBootPattern-1615085816',keypairs=<?>,launch_index=0,launched_at=2023-12-05T12:59:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e87e18fa15d84a858a5e6c8306589285',ramdisk_id='',reservation_id='r-9mt1yuox',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2021686022',owner_user_name='tempest-TestVolumeBootPattern-2021686022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-05T12:59:06Z,user_data=None,user_id='c40b4872327a40968c5e7a5f89cd137a',uuid=f4639baf-60e3-466e-bbc5-6268a6e28b6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "address": "fa:16:3e:1f:b4:44", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped58348d-6d", "ovs_interfaceid": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converting VIF {"id": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "address": "fa:16:3e:1f:b4:44", "network": {"id": "17ec9bcd-df60-4cf6-8102-134b8012d9c3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1530246334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e87e18fa15d84a858a5e6c8306589285", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped58348d-6d", "ovs_interfaceid": "ed58348d-6d66-45e5-b29a-5e3fc86ba7dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG nova.network.os_vif_util [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:b4:44,bridge_name='br-int',has_traffic_filtering=True,id=ed58348d-6d66-45e5-b29a-5e3fc86ba7dd,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped58348d-6d') {{(pid=75071) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG os_vif [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:b4:44,bridge_name='br-int',has_traffic_filtering=True,id=ed58348d-6d66-45e5-b29a-5e3fc86ba7dd,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped58348d-6d') {{(pid=75071) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped58348d-6d, bridge=br-int, if_exists=True) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=067d5e24-f32e-4724-9564-3f19fc2b2ced) {{(pid=75071) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:03:48 user nova-compute[75071]: INFO os_vif [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:b4:44,bridge_name='br-int',has_traffic_filtering=True,id=ed58348d-6d66-45e5-b29a-5e3fc86ba7dd,network=Network(17ec9bcd-df60-4cf6-8102-134b8012d9c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped58348d-6d')
Dec 05 13:03:48 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] calling os-brick to detach iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f8264767070>, {'target_iqn': 'iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PBJNEDGm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 05 13:03:48 user nova-compute[75071]: WARNING os_brick.initiator.connectors.base [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 05 13:03:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d03fc3-e309-4fda-916f-529dee41dd46]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 05 13:03:48 user nova-compute[75071]: No targets found.
Dec 05 13:03:48 user nova-compute[75071]: iSNS:
Dec 05 13:03:48 user nova-compute[75071]: No targets found.
Dec 05 13:03:48 user nova-compute[75071]: STATIC:
Dec 05 13:03:48 user nova-compute[75071]: Target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d
Dec 05 13:03:48 user nova-compute[75071]:         Portal: 172.16.0.220:3260,-1
Dec 05 13:03:48 user nova-compute[75071]:                 Iface Name: default
Dec 05 13:03:48 user nova-compute[75071]: FIRMWARE:
Dec 05 13:03:48 user nova-compute[75071]: No targets found.
Dec 05 13:03:48 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 05 13:03:48 user nova-compute[75071]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 05 13:03:48 user nova-compute[75071]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75071) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d', 0)] {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d85333-58a8-41c0-a894-d1ef746b470d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[1743cb66-81cf-4dac-ba43-17be8d03d7f6]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 13:03:48 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d (non-flash)
Dec 05 13:03:48 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f827c19d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d'): ({'sdb'}, set())}) {{(pid=75071) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Removing single pathed devices sdb {{(pid=75071) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fb42bf-7b4e-4e0a-a93e-4c59f166c259]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbbc648-823f-4675-b265-1b5c7551600b]: (4, ('ok\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Flushing IO for device /dev/sdb {{(pid=75071) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bac6b5c-6efb-4275-9057-c6c0c8fa1f83]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75071) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[7961161a-3337-4d64-9d02-95a3e34e5b38]: (4, ('1', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG os_brick.initiator.linuxscsi [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] SCSI volumes sdb have been removed. {{(pid=75071) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26332653363343335', '/dev/disk/by-id/scsi-1SCST_BIOb78d46e3-c2e3c4356993e82f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b78d46e3') {{(pid=85641) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[2448cb27-2a0e-4f5b-8be3-dec944c4798e]: (4, None) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d')] {{(pid=75071) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e7495b-44b7-4680-89a9-85fab2162b11]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:03:48 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --logout {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:03:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:03:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b20d24b-d4ba-4579-9531-9faf5b299ea0]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:03:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d, portal: 172.16.0.220,3260]
Dec 05 13:03:49 user nova-compute[75071]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d, portal: 172.16.0.220,3260] successful.
Dec 05 13:03:49 user nova-compute[75071]:  stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:03:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op delete {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 05 13:03:49 user nova-compute[75071]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65085adc-56bb-4667-b4d1-46714871846d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85641) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 05 13:03:49 user nova-compute[75071]: DEBUG oslo.privsep.daemon [-] privsep: reply[f047883d-2c58-4dd0-bcb4-d6075105e14d]: (4, ('', '')) {{(pid=85641) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 05 13:03:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75071) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 05 13:03:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.base [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 05 13:03:49 user nova-compute[75071]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] <== disconnect_volume: return (305ms) None {{(pid=75071) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 05 13:03:49 user nova-compute[75071]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Disconnected iSCSI Volume {{(pid=75071) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 05 13:03:49 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Deleting instance files /opt/stack/data/nova/instances/f4639baf-60e3-466e-bbc5-6268a6e28b6a_del
Dec 05 13:03:49 user nova-compute[75071]: INFO nova.virt.libvirt.driver [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Deletion of /opt/stack/data/nova/instances/f4639baf-60e3-466e-bbc5-6268a6e28b6a_del complete
Dec 05 13:03:49 user nova-compute[75071]: INFO nova.compute.manager [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Took 1.14 seconds to destroy the instance on the hypervisor.
Dec 05 13:03:49 user nova-compute[75071]: DEBUG oslo.service.loopingcall [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75071) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 05 13:03:49 user nova-compute[75071]: DEBUG nova.compute.manager [-] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Deallocating network for instance {{(pid=75071) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 05 13:03:49 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] deallocate_for_instance() {{(pid=75071) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 05 13:03:49 user nova-compute[75071]: DEBUG nova.network.neutron [-] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Updating instance_info_cache with network_info: [] {{(pid=75071) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 05 13:03:49 user nova-compute[75071]: INFO nova.compute.manager [-] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Took 0.42 seconds to deallocate network for instance.
Dec 05 13:03:50 user nova-compute[75071]: INFO nova.compute.manager [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Took 0.75 seconds to detach 1 volumes for instance.
Dec 05 13:03:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:03:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:03:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-a05e0a52-a068-4334-b99c-8405d90e0920 req-65e5b02f-7b7e-45ef-9641-8bfb15df2646 service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Received event network-vif-plugged-ed58348d-6d66-45e5-b29a-5e3fc86ba7dd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:03:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a05e0a52-a068-4334-b99c-8405d90e0920 req-65e5b02f-7b7e-45ef-9641-8bfb15df2646 service nova] Acquiring lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:03:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a05e0a52-a068-4334-b99c-8405d90e0920 req-65e5b02f-7b7e-45ef-9641-8bfb15df2646 service nova] Lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:03:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [req-a05e0a52-a068-4334-b99c-8405d90e0920 req-65e5b02f-7b7e-45ef-9641-8bfb15df2646 service nova] Lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:03:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-a05e0a52-a068-4334-b99c-8405d90e0920 req-65e5b02f-7b7e-45ef-9641-8bfb15df2646 service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] No waiting events found dispatching network-vif-plugged-ed58348d-6d66-45e5-b29a-5e3fc86ba7dd {{(pid=75071) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 05 13:03:50 user nova-compute[75071]: WARNING nova.compute.manager [req-a05e0a52-a068-4334-b99c-8405d90e0920 req-65e5b02f-7b7e-45ef-9641-8bfb15df2646 service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Received unexpected event network-vif-plugged-ed58348d-6d66-45e5-b29a-5e3fc86ba7dd for instance with vm_state deleted and task_state None.
Dec 05 13:03:50 user nova-compute[75071]: DEBUG nova.compute.manager [req-a05e0a52-a068-4334-b99c-8405d90e0920 req-65e5b02f-7b7e-45ef-9641-8bfb15df2646 service nova] [instance: f4639baf-60e3-466e-bbc5-6268a6e28b6a] Received event network-vif-deleted-ed58348d-6d66-45e5-b29a-5e3fc86ba7dd {{(pid=75071) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 05 13:03:50 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:03:50 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:03:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:03:50 user nova-compute[75071]: INFO nova.scheduler.client.report [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Deleted allocations for instance f4639baf-60e3-466e-bbc5-6268a6e28b6a
Dec 05 13:03:50 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-04a04dfb-0275-447e-af0a-e6ea127c6743 tempest-TestVolumeBootPattern-2021686022 tempest-TestVolumeBootPattern-2021686022-project-member] Lock "f4639baf-60e3-466e-bbc5-6268a6e28b6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.618s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:03:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:03:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:04:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:04:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:04:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:04:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 13:04:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:04:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:04:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:04:13 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:04:17 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:04:18 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:04:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:04:21 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:04:22 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:04:22 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75071) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 05 13:04:23 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:04:25 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:04:25 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:04:25 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager.update_available_resource {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:04:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:04:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:04:25 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:04:25 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Auditing locally available compute resources for user (node: user) {{(pid=75071) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 05 13:04:26 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:04:26 user nova-compute[75071]: WARNING nova.virt.libvirt.driver [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 05 13:04:26 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Hypervisor/Node resource view: name=user free_ram=9158MB free_disk=24.98139190673828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}] {{(pid=75071) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 05 13:04:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 05 13:04:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 05 13:04:26 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 05 13:04:26 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75071) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 05 13:04:26 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Refreshing inventories for resource provider 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 05 13:04:26 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Updating ProviderTree inventory for provider 25beb694-9dd7-475f-9657-74a5f0368417 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 05 13:04:26 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Updating inventory in ProviderTree for provider 25beb694-9dd7-475f-9657-74a5f0368417 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 05 13:04:26 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Refreshing aggregate associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, aggregates: None {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 05 13:04:26 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Refreshing trait associations for resource provider 25beb694-9dd7-475f-9657-74a5f0368417, traits: COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_ACCELERATORS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_E1000E {{(pid=75071) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 05 13:04:26 user nova-compute[75071]: DEBUG nova.compute.provider_tree [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed in ProviderTree for provider: 25beb694-9dd7-475f-9657-74a5f0368417 {{(pid=75071) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 05 13:04:26 user nova-compute[75071]: DEBUG nova.scheduler.client.report [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Inventory has not changed for provider 25beb694-9dd7-475f-9657-74a5f0368417 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75071) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 05 13:04:26 user nova-compute[75071]: DEBUG nova.compute.resource_tracker [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Compute_service record updated for user:user {{(pid=75071) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 05 13:04:26 user nova-compute[75071]: DEBUG oslo_concurrency.lockutils [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=75071) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 05 13:04:28 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:04:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:04:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:04:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 13:04:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:04:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:04:28 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:04:29 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._sync_power_states {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:04:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:04:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:04:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75071) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 05 13:04:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:04:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75071) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 05 13:04:33 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:04:37 user nova-compute[75071]: DEBUG oslo_service.periodic_task [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75071) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 05 13:04:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Starting heal instance info cache {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 05 13:04:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Rebuilding the list of instances to heal {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 05 13:04:37 user nova-compute[75071]: DEBUG nova.compute.manager [None req-d9151cca-0395-402e-bf35-2cf9da2d424e None None] Didn't find any instances for network info cache update. {{(pid=75071) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 05 13:04:38 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:04:43 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 05 13:04:45 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:04:46 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:04:48 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:04:49 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:04:53 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:04:58 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:05:03 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 05 13:05:08 user nova-compute[75071]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75071) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}